QuestionQ115

VerifiedStoring the data

You are designing storage for 20 TB of text files while deploying a data pipeline on Google Cloud. Your input data is in CSV format. You want to minimize the cost of querying aggregate values for multiple users who will query the data in Cloud Storage with multiple engines. Which storage service and schema design should you use?

Explanation

Cloud Storage provides economical shared storage for CSV files that can be accessed by multiple query engines. A permanent BigQuery external table defines a reusable schema over the Cloud Storage data and can be shared with users who have access to the underlying files. Temporary external tables are for one-time or ad hoc queries and cannot be shared.

Learn more

Community Discussion

No comments yet. Be the first to start the discussion!