Professional Data Engineer

By Google · Question Mode

QuestionQ7

Storing the data

Your company is migrating its 30-node Apache Hadoop cluster to the cloud. It wants to reuse Hadoop jobs it has already created and minimize cluster management as much as possible. It also needs to persist data beyond the cluster’s lifetime. What should you do?

Explanation

Cloud Dataproc is a fully managed service for Apache Hadoop workloads, reducing cluster-management overhead while supporting existing Hadoop jobs. Its automatically installed Cloud Storage connector exposes Cloud Storage through Hadoop-compatible paths, and data stored in Cloud Storage persists after the Dataproc cluster is shut down.

Learn more

Community Discussion

No comments yet. Be the first to start the discussion!