Associate Data Practitioner

By Google · Question Mode

QuestionQ12

Data Pipeline Orchestration

You have a Dataflow pipeline that processes website-traffic logs stored in Cloud Storage and writes the processed output to BigQuery. The pipeline is failing intermittently. You need to troubleshoot the problem. What should you do?

Explanation

Cloud Logging provides the pipeline error messages needed to diagnose intermittent failures, and Cloud Monitoring exposes operational metrics such as CPU utilization and memory usage that can help identify resource pressure or other conditions associated with those failures.

Community Discussion

No comments yet. Be the first to start the discussion!