QuestionQ76

Data Loading, Unloading & Connectivity

Bulk data is loaded from an external stage each day by using this command:

COPY INTO source_table -  
  
FROM s3://source/data/files -  
STORAGE_INTEGRATION = s3_source_int  
FILE_FORMAT = (FORMAT_NAME = source_format)  
PATTERN='sales.*[.]csv';  

How is the data loaded?

Explanation

Snowflake records file-load metadata for a target table and uses it by default to avoid reloading files that were successfully loaded before. Because this COPY command does not set FORCE = TRUE, it loads newly eligible files matching sales.*[.]csv and skips previously loaded files when their load status is known.

Learn more

Community Discussion

No comments yet. Be the first to start the discussion!