QuestionQ55

VerifiedDeployment and Orchestration of ML Workflows

A company keeps time-series user-click data in an Amazon S3 bucket. The raw data contains millions of rows of user activity each day. ML engineers use this data to develop their ML models.

The ML engineers must create daily reports and analyze click trends from the previous 3 days by using Amazon Athena. The company must retain the data for 30 days before it is archived.

Which solution provides the HIGHEST data-retrieval performance?

Explanation

Partitioning the S3 data by date allows Athena queries filtered to the previous three days to prune all other partitions, reducing the data scanned and improving performance. An S3 Lifecycle policy can transition date partitions after the required 30-day retention period to S3 Glacier Flexible Retrieval. Separate buckets do not provide Athena partition pruning and add unnecessary data-management complexity.

Learn more

Community Discussion

No comments yet. Be the first to start the discussion!