QuestionQ2

VerifiedData Store Management

An ecommerce company gathers daily customer transaction logs in CSV format and stores those logs in Amazon S3. The company uses Amazon Athena to scan a subset of attributes from the logs on the same day that it receives each log.

Query times are growing because transaction volume is increasing. The company wants to improve query performance.

Which solution will satisfy these requirements with the SHORTEST query times?

Explanation

ORC is a columnar format, so Athena can read only the requested attributes and use predicate pushdown to skip unnecessary data blocks. Date partitioning reduces the data scanned for daily queries, and storing the data in multiple ORC files lets Athena distribute reads among multiple readers for greater parallelism. A single file per day limits that parallelism; JSON and Avro do not provide columnar column-pruning benefits.

Learn more

Community Discussion

No comments yet. Be the first to start the discussion!