A company uses an Amazon S3 bucket to integrate multiple data sources into a centralized data lake. The company must perform multiple transformations and data-cleaning processes on the data so that the data is accessible to business partners.
The company requires a solution that enables multiple business partners to run SQL queries on the centralized data lake during normal business hours.
Which solution meets these requirements MOST cost-effectively?
An ecommerce company gathers daily customer transaction logs in CSV format and stores those logs in Amazon S3. The company uses Amazon Athena to scan a subset of attributes from the logs on the same day that it receives each log.
Query times are growing because transaction volume is increasing. The company wants to improve query performance.
Which solution will satisfy these requirements with the SHORTEST query times?
Community Discussion
A company operates a data-processing pipeline with several dozen steps. The pipeline must send real-time alerts whenever a step succeeds or fails. It uses a combination of Amazon S3 buckets, AWS Lambda functions, and AWS Step Functions state machines.
A data engineer needs to create a solution that monitors the entire pipeline.
Which solution meets these requirements?
Community Discussion
A data engineer must run a data-transformation job whenever a user adds a file to an Amazon S3 bucket. The job will run for under 1 minute. It must send its output to the data engineer in an email message. The data engineer expects users to add one file every hour of the day.
Which solution meets these requirements in the MOST operationally efficient way?
Community Discussion
A data engineer uses an AWS Glue crawler to catalog data stored in an Amazon S3 bucket. The S3 bucket contains both .csv and .json files. The data engineer configured the crawler to omit the .json files from the catalog.
When the data engineer runs Amazon Athena queries, the queries also process the omitted .json files. The data engineer wants to resolve this issue and needs a solution that will not change the access requirements for the .csv files in the source S3 bucket.
Which solution meets this requirement with the SHORTEST query times?
Community Discussion