QuestionQ19

Data Ingestion and Data Preparation

A company receives transaction data in CSV format that is automatically delivered to an Amazon S3 bucket. Snowpipe is configured with event notifications to ingest files into Snowflake when they arrive in the S3 bucket. There are concerns that the S3 bucket is becoming too large because of already processed files and that some files might have been loaded more than once.

Which actions address these concerns?

Choose two
Explanation

Snowpipe cannot automatically delete staged files after they load successfully. Unneeded files can be deleted periodically with the REMOVE command, or retained storage can be controlled through lifecycle-management rules configured in the cloud storage provider. Snowpipe already maintains file-loading metadata to prevent reloading files with the same name; this is not a separate feature to enable.

Learn more

Community Discussion

No comments yet. Be the first to start the discussion!