QuestionQ29

Ingesting and processing the data

You have designed an Apache Beam processing pipeline that reads from a Pub/Sub topic. The topic has a one-day message-retention duration and writes to a Cloud Storage bucket. You must choose a bucket location and processing strategy that prevent data loss during a regional outage with an RPO of 15 minutes. What should you do?

Explanation

Cloud Storage turbo replication is available only for dual-region buckets and is designed to replicate newly written objects to both regions within a 15-minute RPO. Default replication has a 12-hour RPO, so neither a standard dual- or multi-region bucket nor a regional bucket satisfies the requirement. Pub/Sub topic retention permits replay of retained acknowledged messages, enabling a secondary-region Dataflow job to reprocess an overlap after failover.

Learn more

Community Discussion

No comments yet. Be the first to start the discussion!