QuestionQ24

Applying site reliability engineering practices

You are the on-call Site Reliability Engineer for a microservice deployed in a Google Kubernetes Engine (GKE) Autopilot cluster. Your company operates an online store that publishes order messages to Pub/Sub, and a microservice consumes those messages and updates stock information in the warehousing system. A sales event has increased orders, and stock information is not being updated fast enough. Consequently, many orders are being accepted for products that are out of stock. You review the microservice metrics and compare them with typical levels:

Question Image

You must ensure the warehouse system accurately reflects product inventory when orders are placed while minimizing customer impact. What should you do?

Explanation

Rising oldest-unacknowledged-message age together with a large increase in undelivered messages indicates that Pub/Sub subscribers are not keeping up with the message volume. Adding Pod replicas creates more concurrent subscriber instances and raises processing throughput, reducing the backlog and inventory-update delay. The Pods are not near their CPU or memory limits, so increasing those limits is not the relevant response.

Learn more

Community Discussion

No comments yet. Be the first to start the discussion!