QuestionQ93

VerifiedIngesting and processing the data

Your platform in an on-premises environment produces 100 GB of data each day, consisting of millions of structured JSON text files. The on-premises environment is not accessible from the public internet. You want to use Google Cloud products to query and explore the platform data. What should you do?

Explanation

Storage Transfer Service for on-premises data uses transfer agents in the on-premises environment to move files to Cloud Storage without requiring the source environment to be publicly reachable. BigQuery Data Transfer Service can schedule recurring loads from Cloud Storage into BigQuery and supports newline-delimited JSON files, enabling the data to be queried and explored in BigQuery.

Learn more

Community Discussion

No comments yet. Be the first to start the discussion!