QuestionQ101

VerifiedData Security and Governance

A company must establish a data catalog and metadata management for data sources running in the AWS Cloud. The company will use the data catalog to maintain metadata for every object in a set of data stores. The data stores include structured sources, such as Amazon RDS and Amazon Redshift. They also include semistructured sources, such as JSON files and .xml files stored in Amazon S3.

The company requires a solution that updates the data catalog regularly. The solution must also identify changes to the source metadata.

Which solution meets these requirements with the LEAST operational overhead?

Explanation

AWS Glue Data Catalog is a managed metadata repository, and AWS Glue crawlers can connect to Amazon RDS, Amazon Redshift, and Amazon S3. Crawlers infer and store metadata, update the Data Catalog when source schema metadata changes, and support recurring schedules. This supplies automated catalog maintenance across all listed source types without custom metadata-collection code or self-managed catalog databases.

Learn more

Community Discussion

No comments yet. Be the first to start the discussion!