QuestionQ14
VerifiedData Pipeline OrchestrationYou work for an online retail company. The company collects customer purchase data in CSV files and uploads them to Cloud Storage every 10 minutes. The data must be transformed and loaded into BigQuery for analysis. The transformation includes cleaning the data, removing duplicates, and enriching it with product information from a separate table in BigQuery. You need a low-overhead solution that starts data processing as soon as files are uploaded to Cloud Storage. What should you do?
Community Discussion