QuestionQ38

Data Ingestion and Transformation

A finance company obtains data from third-party data providers and saves the data as objects in an Amazon S3 bucket.

The company ran an AWS Glue crawler on the objects to create a data catalog. The AWS Glue crawler generated multiple tables, but the company expected the crawler to generate only one table.

The company needs a solution that will ensure the AVS Glue crawler generates only one table.

Which combination of solutions will satisfy this requirement?

Choose two
  • A Ensure that the object format, compression type, and schema are the same for each object.
  • B Ensure that the object format and schema are the same for each object. Do not enforce consistency for the compression type of each object.
  • C Ensure that the schema is the same for each object. Do not enforce consistency for the file format and compression type of each object.
  • D Ensure that the structure of the prefix for each S3 object name is consistent.
  • E Ensure that all S3 object names follow a similar pattern.
Explanation

AWS Glue crawler grouping for Amazon S3 considers data compatibility, including the same data format and compression type, and it considers the structure of the Amazon S3 path. Keeping those attributes consistent allows compatible objects to be grouped into one table; schema consistency by itself or only a similar object-name pattern does not ensure that result. AWS documents these grouping factors in its AWS Glue crawler grouping policy.

Learn more

Community Discussion

No comments yet. Be the first to start the discussion!