QuestionQ22

Data Ingestion and Transformation

A company intends to use Amazon Kinesis Data Firehose to store data in Amazon S3. The source data is made up of 2 MB .csv files. The company must transform the .csv files into JSON format. The company must save the files in Apache Parquet format.

Which solution satisfies these requirements with the LEAST development effort?

  • A Use Kinesis Data Firehose to convert the .csv files to JSON. Use an AWS Lambda function to store the files in Parquet format.
  • B Use Kinesis Data Firehose to convert the .csv files to JSON and to store the files in Parquet format.
  • C Use Kinesis Data Firehose to invoke an AWS Lambda function that transforms the .csv files to JSON and stores the files in Parquet format.
  • D Use Kinesis Data Firehose to invoke an AWS Lambda function that transforms the .csv files to JSON. Use Kinesis Data Firehose to store the files in Parquet format.
Explanation

Amazon Data Firehose can invoke an AWS Lambda function to transform CSV input into JSON, and it can natively convert JSON records to Apache Parquet before delivering them to Amazon S3. Using Lambda only for the CSV-to-JSON transformation avoids implementing Parquet generation in custom code.

Learn more

Community Discussion

No comments yet. Be the first to start the discussion!