QuestionQ70

VerifiedData Pipeline Orchestration

You are designing a BigQuery data warehouse with a team of experienced SQL developers. You need to recommend a cost-effective, fully managed, serverless solution for building ELT processes using SQL pipelines. The solution must provide source-code control, environment parameterization, and data-quality checks. What should you do?

Explanation

Dataform is a managed service for developing, version-controlling, orchestrating, and running SQL transformation workflows in BigQuery. It supports Git-based source control, environment-specific compilation settings, dependency-aware workflow execution and monitoring, and data-quality assertions.

Learn more

Community Discussion

No comments yet. Be the first to start the discussion!