Professional Cloud Developer

By Google · Question Mode

QuestionQ2

Integrating applications with Google Cloud services

You are building an application component to collect user-behavior data and stream it into BigQuery. You plan to use the BigQuery Storage Write API. You must ensure that data arriving in BigQuery contains no duplicates. You want to achieve this by using the simplest operational approach. What should you do?

Explanation

An application-created committed write stream, used with stream offsets, provides exactly-once write semantics in the BigQuery Storage Write API. The default stream provides only at-least-once semantics and can produce duplicates; external Kafka or Pub/Sub deduplication adds unnecessary operational complexity.

Learn more

Community Discussion

No comments yet. Be the first to start the discussion!