QuestionQ11
VerifiedData Operations and SupportA company uses the AWS Glue Data Catalog to index data uploaded to an Amazon S3 bucket each day. The company uses daily batch processes in an extract, transform, and load (ETL) pipeline to upload data from external sources to the S3 bucket.
The company runs a daily report on the S3 data. On some days, it runs the report before all daily data has been uploaded to the S3 bucket. A data engineer must be able to send a message identifying any incomplete data to an existing Amazon Simple Notification Service (Amazon SNS) topic.
Which solution meets this requirement with the LEAST operational overhead?
Community Discussion