Professional Data Engineer

By Google · Question Mode

QuestionQ10

Maintaining and automating data workloads

You need to orchestrate a pipeline across several Google Cloud services: a batch Dataflow job, followed by a BigQuery query job and then a Vertex AI batch prediction. The logic is sequential. You want a lightweight, serverless orchestration solution with minimal operational overhead. Which service should you use?

Explanation

Cloud Workflows is a fully managed, serverless service for executing Google Cloud services in an explicitly defined order. Its connectors support Dataflow jobs, BigQuery, and Vertex AI, making it suitable for a sequential cross-service pipeline without managing orchestration infrastructure.

Learn more

Community Discussion

No comments yet. Be the first to start the discussion!