QuestionQ44

Data Pipeline Orchestration

Your company’s ecommerce website receives product reviews from customers. Each day, the reviews are loaded as CSV files into a Cloud Storage bucket. The reviews are in several languages and must be translated into Spanish. You need to configure a pipeline that is serverless, efficient, and needs minimal maintenance. What should you do?

Explanation

BigQuery remote functions can invoke code deployed on Cloud Run functions or Cloud Run from GoogleSQL. A Cloud Run function can call the Cloud Translation API, and a BigQuery scheduled query can run this translation for newly loaded reviews each day. This provides a managed, serverless ingestion-and-translation workflow without operating Dataproc or maintaining a custom Dataflow translation pipeline.

Learn more

Community Discussion

No comments yet. Be the first to start the discussion!