QuestionQ84
VerifiedMaintaining and automating data workloadsYou are deploying an Apache Airflow directed acyclic graph (DAG) in a Cloud Composer 2 instance. Incoming files in a Cloud Storage bucket are processed by the DAG, one file at a time. The Cloud Composer instance is deployed in a subnetwork without Internet access. Rather than running the DAG on a schedule, you want it to run reactively whenever a new file arrives. What should you do?
Community Discussion