QuestionQ62

VerifiedData Ingestion and Transformation

A company is building a log-streaming pipeline with Amazon Data Firehose. The pipeline streams Amazon CloudWatch Logs data to an Amazon S3 bucket. The company’s analytics team must use the data for audits. The pipeline must send only relevant logs to the S3 bucket in a format compatible with the team’s analysis.

Which solution meets these requirements while maintaining reliable performance?

Explanation

CloudWatch Logs subscription filters use filter patterns to restrict which log events are delivered to a destination, including an Amazon Data Firehose delivery stream. Amazon Data Firehose can synchronously invoke AWS Lambda to transform incoming records before delivering the transformed output to Amazon S3, providing both selective delivery and the required analysis format.

Learn more

Community Discussion

No comments yet. Be the first to start the discussion!