QuestionQ41

VerifiedEnsuring the successful operation of a cloud solution

Your company was recently impacted by a service disruption that caused multiple Dataflow jobs to get stuck, resulting in significant downtime in downstream applications and revenue loss. You were able to resolve the issue by identifying and fixing an error you found in the code. You need to design a solution with minimal management effort to identify when jobs are stuck in the future to ensure that this issue does not occur again. What should you do?

Explanation

Data freshness is a native Dataflow metric that directly indicates whether jobs are processing data promptly or falling behind; when jobs become stuck, this metric increases sharply. Cloud Monitoring's built-in integration with Dataflow metrics enables alerting with minimal custom code or operational overhead, providing the most straightforward detection mechanism.

Community Discussion

No comments yet. Be the first to start the discussion!