QuestionQ4

Data Pipeline Orchestration

You need to build a data pipeline that streams event data from applications in multiple Google Cloud regions into BigQuery for near-real-time analysis. The data must be transformed before it is loaded. You want to build the pipeline through a visual interface. What should you do?

Explanation

Dataflow Job Builder is a visual Google Cloud console interface for creating and running Dataflow pipelines without code. It supports Pub/Sub input, transformation steps, and BigQuery output, including streaming from Pub/Sub to BigQuery with transformations.

Learn more

Community Discussion

No comments yet. Be the first to start the discussion!