SnowPro Advanced Data Engineer

By Snowflake · Question Mode

QuestionQ41

VerifiedImplement Data Pipelines

A CSV file of approximately 1 TB is produced each day on an on-premises server. A corresponding table, internal stage, and file format have already been created in Snowflake to support the data-loading process.

How can loading the CSV file into Snowflake be automated with the least operational overhead?

Explanation

Files on an on-premises server must first be uploaded to a Snowflake internal stage using PUT, which SnowSQL can execute on a schedule. A Snowflake task can then execute COPY INTO from that stage to the target table. An internal stage does not directly access an on-premises filesystem, and the standard Snowpipe auto-ingest workflow is for externally staged cloud-storage files rather than this local-file workflow.

Learn more

Community Discussion

No comments yet. Be the first to start the discussion!