QuestionQ11

Data Pipeline Orchestration

Your company plans to implement a data-transformation (ETL) pipeline for its BigQuery data warehouse. You need to identify a managed transformation solution that lets users develop with SQL and JavaScript, provides version control, supports modular code, and includes data quality checks. What should you do?

Explanation

Dataform is a managed BigQuery transformation service that uses SQLX and JavaScript, supports version-controlled repositories, enables reusable modular code, and provides data-quality assertions. These assertions test output and source data as part of the transformation workflow.

Learn more

Community Discussion

No comments yet. Be the first to start the discussion!