QuestionQ7

Data Preparation and Ingestion

You are working on a project that requires analyzing daily social media data. You have 100 GB of JSON-formatted data in Cloud Storage, and it continues to grow. You need to transform and load this data into BigQuery for analysis. You want to follow the Google-recommended approach. What should you do?

Explanation

Dataflow is designed for scalable batch and streaming data pipelines: it can read data from Cloud Storage, apply transformations, and write the transformed results to BigQuery. Google Cloud provides Cloud Storage-to-BigQuery Dataflow templates that include transformation support, making it appropriate for a growing 100 GB JSON workload.

Learn more

Community Discussion

No comments yet. Be the first to start the discussion!