QuestionQ123

VerifiedIngesting and processing the data

You are troubleshooting a Dataflow pipeline that moves data from Cloud Storage to BigQuery. You discovered that the Dataflow worker nodes cannot communicate with each other. Your networking team uses Google Cloud network tags to define firewall rules. You need to identify the issue while following Google-recommended networking security practices. What should you do?

Explanation

Dataflow workers that require direct inter-worker communication must be allowed to send and receive traffic on TCP ports 12345 and 12346. Firewall rules should target and source the Dataflow network tag so that access is limited to the worker VMs instead of being opened broadly across the subnet.

Learn more

Community Discussion

No comments yet. Be the first to start the discussion!