QuestionQ2

Integrating applications with Google Cloud services

You are building an application component to collect user-behavior data and stream it into BigQuery. You plan to use the BigQuery Storage Write API. You must ensure that data arriving in BigQuery contains no duplicates. You want to achieve this by using the simplest operational approach. What should you do?

  • A Create a write stream in the default type.
  • B Create a write stream in the committed type.
  • C Configure a Kafka cluster. Use a primary universally unique identifier (UUID) for duplicate messages.
  • D Configure a Pub/Sub topic. Use Cloud Functions to subscribe to the topic and remove any duplicates.
Explanation

An application-created committed write stream, used with stream offsets, provides exactly-once write semantics in the BigQuery Storage Write API. The default stream provides only at-least-once semantics and can produce duplicates; external Kafka or Pub/Sub deduplication adds unnecessary operational complexity.

Learn more

Community Discussion

No comments yet. Be the first to start the discussion!