QuestionQ104

VerifiedIngesting and processing the data

You must insert minute-resolution data from 50,000 sensors into a BigQuery table. You anticipate substantial growth in data volume and require the data to be available within 1 minute of ingestion for real-time analysis of aggregated trends. What should you do?

Explanation

Cloud Dataflow supports scalable streaming pipelines with low latency and is appropriate for processing sensor data at scale and writing it to BigQuery. BigQuery guidance specifically recommends Dataflow when custom streaming sources or preprocessing must be streamed into BigQuery at large throughput; streaming data supports near-real-time analysis.

Learn more

Community Discussion

No comments yet. Be the first to start the discussion!