QuestionQ82

VerifiedDesigning data processing systems

You are designing a real-time system for a ride-hailing app that identifies areas with high ride demand, so available drivers can be rerouted effectively to meet that demand. The system ingests data from multiple sources into Pub/Sub, processes the data, and stores the results for visualization and analysis in real-time dashboards. The data sources include driver-location updates every 5 seconds and app-based booking events from riders. Data processing requires real-time aggregation of supply and demand data for the previous 30 seconds, every 2 seconds, with results stored in a low-latency system for visualization. What should you do?

Explanation

A hopping window can overlap, enabling a rolling 30-second aggregation to be emitted every 2 seconds. Memorystore for Redis is a fast in-memory store designed for real-time processing and, when combined with Dataflow, provides very-low-latency access for streaming data; this fits real-time dashboard visualization.

Learn more

Community Discussion

No comments yet. Be the first to start the discussion!