QuestionQ50

Performance, Cost, and Resource Optimization

A company uses Snowflake on Azure in the Netherlands. Its analyst team also has JSON-formatted data stored in an Amazon S3 bucket in the AWS Singapore Region that it wants to analyze.

The Architect has received these requirements:

  1. Provide access to data that changes frequently.
  2. Minimize egress costs.
  3. Maintain low latency.

How can these requirements be satisfied with the LEAST operational overhead?

Explanation

Collocating the S3 data in Azure Blob Storage near the Azure-hosted Snowflake account avoids repeatedly accessing data across cloud providers and distant regions, reducing query latency and ongoing cross-cloud egress exposure. Snowpipe is a serverless continuous-ingestion service that automatically loads newly arriving files from an Azure external stage into a Snowflake table, making it suitable for frequently changing JSON data with low operational overhead. Snowflake notes that cloud providers can charge egress when data moves from its origin network and region to the cloud and region hosting the Snowflake account.

Learn more

Community Discussion

No comments yet. Be the first to start the discussion!