QuestionQ116

Architecture Overview

An Architect is designing several data pipelines to ingest, transform, and consume data in Snowflake to support a newly developed application. Although the development team has substantial SQL expertise, most members have little Python experience.

Which architectural design meets these requirements with the least operational overhead?

Explanation

Dynamic tables let a SQL-focused team define a multi-stage pipeline declaratively while Snowflake automatically manages dependency ordering and refresh scheduling. Setting TARGET_LAG = DOWNSTREAM on every intermediate dynamic table avoids independent, unnecessary refresh schedules; the final dynamic table’s time-based target lag drives refreshes through the DAG. Snowflake: Migrate from streams and tasks to dynamic tables

Learn more

Community Discussion

No comments yet. Be the first to start the discussion!