QuestionQ50

Data Ingestion and Transformation

A company must use Amazon Athena to analyze data stored in an Amazon S3 bucket. A data engineer must configure AWS Glue table partitions for year, month, and day. The data engineer must create the partitions daily to accommodate schema changes in the data.

Which solution meets these requirements?

  • A Use AWS Glue DataBrew to create the partitions for the AWS Glue table.
  • B Use an AWS Lambda function to create the partitions for the AWS Glue table.
  • C Set partition projection properties for the AWS Glue table.
  • D Configure an AWS Glue crawler to run on a set schedule.
Explanation

An AWS Glue crawler can scan the Amazon S3 data, infer its schema, identify year/month/day folder partitions, and update the AWS Glue Data Catalog. When scheduled to run daily, it adds newly discovered partitions and updates table metadata for schema changes.

Learn more

Community Discussion

No comments yet. Be the first to start the discussion!