QuestionQ78

VerifiedData Operations and Support

A company keeps datasets in JSON and .csv formats in an Amazon S3 bucket. The company has Amazon RDS for Microsoft SQL Server databases, Amazon DynamoDB tables that use provisioned capacity mode, and an Amazon Redshift cluster. A data engineering team must build a solution that gives data scientists the ability to query every data source by using syntax similar to SQL.

Which solution meets these requirements with the LEAST operational overhead?

Explanation

Amazon Athena is serverless and can query S3 data registered in the AWS Glue Data Catalog using SQL. Athena Federated Query supports querying relational, non-relational, and object data sources in place, including SQL Server, DynamoDB, and Amazon Redshift. Using Glue crawlers and the Data Catalog supplies schema metadata without building and operating transformation pipelines. Redshift Spectrum is intended for querying external data in Amazon S3, while the transformation-based alternatives add unnecessary ETL and data-lake operations.

Learn more

Community Discussion

No comments yet. Be the first to start the discussion!