QuestionQ29

VerifiedData Ingestion and Transformation

A data engineer must use AWS Step Functions to create an orchestration workflow. The workflow must process a large collection of data files in parallel and apply a particular transformation to every file.

Which Step Functions state should the data engineer use to satisfy these requirements?

Explanation

The AWS Step Functions Map state runs the same workflow steps for each item in a dataset and supports concurrent iterations. Its Distributed mode is intended for large-scale parallel workloads, including processing large sets of Amazon S3 objects or other data files.

Learn more

Community Discussion

No comments yet. Be the first to start the discussion!