AWS Certified Data Engineer - Associate DEA-C01Demo

By Amazon · Question Mode

QuestionQ287

Data Ingestion and Transformation

A company operates several extract, transform, and load (ETL) workflows that load data from the company’s operational databases into an Amazon S3-based data lake. The ETL workflows use AWS Glue and Amazon EMR for data processing.

The company wants to enhance the existing architecture to deliver automated orchestration while requiring minimal manual effort.

Which solution meets these requirements with the LEAST operational overhead?

  • A AWS Glue workflows
  • B AWS Step Functions tasks
  • C AWS Lambda functions
  • D Amazon Managed Workflows for Apache Airflow (Amazon MWAA) workflows
Explanation

AWS Step Functions is a fully managed orchestration service with optimized integrations for both AWS Glue and Amazon EMR. Task states can start and synchronously wait for Glue and EMR jobs, enabling automated dependencies, sequencing, retries, and error handling without operating an orchestration platform or writing custom coordination code. AWS Glue workflows orchestrate Glue jobs and crawlers, whereas Step Functions can coordinate the combined Glue-and-EMR workflow.

Learn more

Community Discussion

No comments yet. Be the first to start the discussion!