QuestionQ24

VerifiedData Pipeline Orchestration

Your organization must implement near-real-time analytics for thousands of events that arrive each second in Pub/Sub. The incoming messages need transformations. You need to configure a pipeline that processes, transforms, and loads the data into BigQuery while minimizing development effort. What should you do?

Explanation

The Google-provided Pub/Sub-to-BigQuery Dataflow template is a streaming pipeline that reads Pub/Sub messages and writes them to BigQuery. It can apply a user-defined function to transform each incoming message, providing a managed, low-development solution for high-volume near-real-time processing.

Learn more

Community Discussion

No comments yet. Be the first to start the discussion!