QuestionQ94

VerifiedIngesting and processing the data

You are deploying a batch pipeline in Dataflow. The pipeline reads data from Cloud Storage, transforms it, and then writes it to BigQuery. The security team has enabled an organizational constraint in Google Cloud that requires every Compute Engine instance to use only internal IP addresses and no external IP addresses. What should you do?

Explanation

Dataflow workers that use only internal IP addresses require Private Google Access on their subnetwork to reach Google APIs and services, including Cloud Storage and BigQuery. This is required when external IP addresses are disabled.

Learn more

Community Discussion

No comments yet. Be the first to start the discussion!