QuestionQ133

VerifiedMaintaining and automating data workloads

You are building the CI/CD cycle for the code of the directed acyclic graphs (DAGs) that run in Cloud Composer. Your team has two Cloud Composer instances: one for development and one for production. The team uses a Git repository to maintain and develop the DAG code. You want the DAGs to be deployed automatically to Cloud Composer when a specific tag is pushed to the Git repository. What should you do?

Explanation

Cloud Composer stores DAG files in its environment Cloud Storage bucket and synchronizes them to its Airflow components. Therefore, Cloud Build should deploy and test the DAG code by copying it to the development environment’s bucket, then copy the validated code to the production environment’s bucket. KubernetesPodOperator is used to run Kubernetes workloads from a DAG, not to deploy DAG definitions to Cloud Composer.

Learn more

Community Discussion

No comments yet. Be the first to start the discussion!