Associate Data Practitioner

By Google · Question Mode

QuestionQ60

Data Pipeline Orchestration

After a recent company acquisition, you inherited an on-premises data infrastructure that must be moved to Google Cloud. The acquired system includes 250 Apache Airflow directed acyclic graphs (DAGs) that orchestrate data pipelines. You need to migrate these pipelines to a Google Cloud managed service with minimal effort. What should you do?

Explanation

Cloud Composer is Google Cloud’s managed Apache Airflow service. Existing Airflow DAG files can be migrated by copying them to the environment’s /dags folder, where Composer synchronizes and schedules them, avoiding a rewrite into another orchestration or pipeline service.

Learn more

Community Discussion

No comments yet. Be the first to start the discussion!