Professional Data Engineer

By Google · Question Mode

QuestionQ16

Maintaining and automating data workloads

You must deploy extra dependencies to every node of a Cloud Dataproc cluster at startup by using an existing initialization action. Company security policies require Cloud Dataproc nodes to have no Internet access, so public initialization actions cannot retrieve resources. What should you do?

Explanation

Dataproc initialization actions can download job dependencies from Cloud Storage. When cluster nodes lack Internet access, dependencies should be placed in Cloud Storage and accessed through private Google connectivity; staging them in a bucket within the VPC Service Controls perimeter preserves the required security boundary.

Learn more

Community Discussion

No comments yet. Be the first to start the discussion!