SnowPro Advanced Architect

By Snowflake · Question Mode

QuestionQ87

Architecture Overview

The diagram illustrates the Snowpipe auto-ingest process with Amazon Simple Notification Service (SNS), using these steps:

  1. Data files are loaded into a stage.
  2. An Amazon S3 event notification, published through SNS, notifies Snowpipe—via Amazon Simple Queue Service (SQS)—that files are ready to load. Snowpipe copies the files to a queue.
  3. A Snowflake-provided virtual warehouse loads data from the queued files into the target table according to the parameters defined in the specified pipe.

If an AWS Administrator accidentally deletes the SQS subscription to the SNS topic in Step 2, what will occur to the pipe that references the topic to receive event messages from Amazon S3?

Question Image

Explanation

Deleting the SQS subscription to the SNS topic stops every pipe that references that topic from receiving Amazon S3 event messages. Reusing the same SNS topic requires waiting 72 hours for Amazon SNS to clear the deleted subscription and then recreating the pipe. To restore ingestion immediately, create an SNS topic with a different name and recreate the pipe with that new topic in its definition.

Learn more

Community Discussion

No comments yet. Be the first to start the discussion!