DEA-C02: SnowPro Advanced — Data Engineer

By Snowflake · Question Mode

QuestionQ64

VerifiedOfficial exam objectives/topics

A Data Engineer is building a continuous data pipeline that receives data from Amazon Kinesis Data Firehose and loads it into a staging table for later use in the data-transformation process. The average file size is 300–500 MB.

How can the Engineer ensure Snowpipe performs well while minimizing costs?

Explanation

Snowpipe is a serverless service, and Snowflake recommends data files of roughly 100–250 MB or larger for efficient continuous loading. When a source such as Amazon Data Firehose accumulates files larger than the recommended range within a minute, reducing its buffer size triggers delivery of smaller files in that range. This preserves load parallelism while avoiding the unnecessary queue-management overhead associated with too many small files.

Learn more

Community Discussion

No comments yet. Be the first to start the discussion!