QuestionQ4

VerifiedData Operations and Support

A data engineer must run a data-transformation job whenever a user adds a file to an Amazon S3 bucket. The job will run for under 1 minute. It must send its output to the data engineer in an email message. The data engineer expects users to add one file every hour of the day.

Which solution meets these requirements in the MOST operationally efficient way?

Explanation

Amazon S3 can invoke an AWS Lambda function when an object is created, enabling the transformation to run only when a file arrives. AWS Lambda is well suited to a sub-minute job and eliminates infrastructure polling and cluster management. The function can publish the transformed output to an Amazon SNS topic, and an email subscription to that topic delivers the output to the data engineer.

Learn more

Community Discussion

No comments yet. Be the first to start the discussion!