QuestionQ132

VerifiedMaintaining and automating data workloads

You work for an economic consulting firm that helps companies identify economic trends as they occur. As part of your analysis, you use Google BigQuery to correlate customer data with the average prices of the 100 most common goods sold, including bread, gasoline, milk, and others. The average prices for these goods are updated every 30 minutes. You need to ensure that this data remains current so you can combine it with other BigQuery data as cost-effectively as possible.

What should you do?

Explanation

A Cloud Storage-backed BigQuery external table (federated data source) lets BigQuery query the current data in Cloud Storage directly and join it with native BigQuery tables, without repeatedly loading data into BigQuery or building a Dataflow pipeline. This best fits frequently refreshed, small external data that must remain current with minimal operational overhead.

Learn more

Community Discussion

No comments yet. Be the first to start the discussion!