AWS Certified Data Engineer - Associate DEA-C01Demo

By Amazon · Question Mode

QuestionQ264

Data Ingestion and Transformation

A company uses Amazon S3 as a data lake. It establishes a data warehouse using a multi-node Amazon Redshift cluster. The company arranges the data files in the data lake according to the data source for each file.

The company loads every data file into a single table in the Redshift cluster by using a separate COPY command for each data file location. This method takes a long time to load all data files into the table. The company must speed up data ingestion without increasing the process cost.

Which solution meets these requirements?

  • A Use a provisioned Amazon EMR cluster to copy all the data files into one folder. Use a COPY command to load the data into Amazon Redshift.
  • B Load all the data files in parallel into Amazon Aurora. Run an AWS Glue job to load the data into Amazon Redshift.
  • C Use an AWS Give job to copy all the data files into one folder. Use a COPY command to load the data into Amazon Redshift.
  • D Create a manifest file that contains the data file locations. Use a COPY command to load the data into Amazon Redshift.
Explanation

A manifest file explicitly lists the S3 locations of all required data files, including files in different folders that do not share a prefix. A single Amazon Redshift COPY command that uses the manifest can load the files in parallel across the cluster, eliminating the slower series of separate COPY operations without adding processing services or cost.

Learn more

Community Discussion

No comments yet. Be the first to start the discussion!