Associate Data Practitioner

By Google · Question Mode

QuestionQ6

Data Pipeline Orchestration

You need to build a new data pipeline and want a serverless solution that meets these requirements:

  • Data streams from Pub/Sub and is processed in real time.
  • Data is transformed before storage.
  • Data is stored in a location that allows SQL analysis with Looker.

Question Image

Which Google Cloud services should you recommend for the pipeline?

Explanation

Dataflow provides managed real-time stream processing from Pub/Sub and can transform the records before writing them. BigQuery is a SQL data warehouse that Looker can query for analysis. Google Cloud’s Dataflow architecture explicitly describes Pub/Sub ingestion, Dataflow transformation, BigQuery storage, and Looker BI analysis.

Learn more

Community Discussion

No comments yet. Be the first to start the discussion!