QuestionQ121

VerifiedDesigning data processing systems

You are designing an architecture that processes data from Cloud Storage to BigQuery by using Dataflow. The network team has supplied the Shared VPC network and subnetwork that your pipelines must use. You need to enable deployment of the pipeline on the Shared VPC network. What should you do?

Explanation

A Shared VPC subnetwork used by Dataflow must grant the Compute Network User role (roles/compute.networkUser) to the Dataflow service agent, typically at the specified subnet level in the host project. This permits Dataflow to use the shared subnet when it creates and manages worker VMs; the Dataflow Admin role does not supply this network-use permission.

Learn more

Community Discussion

No comments yet. Be the first to start the discussion!