QuestionQ3

VerifiedData Operations and Support

A company operates a data-processing pipeline with several dozen steps. The pipeline must send real-time alerts whenever a step succeeds or fails. It uses a combination of Amazon S3 buckets, AWS Lambda functions, and AWS Step Functions state machines.

A data engineer needs to create a solution that monitors the entire pipeline.

Which solution meets these requirements?

Explanation

AWS Step Functions automatically sends execution-status-change events to Amazon EventBridge. An EventBridge rule can match successful and failed execution statuses and publish each matching event to an Amazon SNS topic, enabling real-time notifications without adding S3-based notification logic or relying on CloudTrail API events.

Learn more

Community Discussion

No comments yet. Be the first to start the discussion!