Postmortem -
Read details
Feb 4, 13:48 GMT
Resolved -
Monitored throughout the night, and the menu queues have stayed stable all night and are still currently sitting on zero.
An investigation has been carried out a RCA will follow shortly, along with remediation plans on how to ensure it does not happen again and how we can monitor for queue congestion again.
Feb 3, 08:42 GMT
Monitoring -
All menus have successfully been updated after the queue had processed. We are still unaware of what caused the initial backlog / Jam and are currently investigating and monitoring to ensure the issue does not recur.
Feb 2, 13:50 GMT
Identified -
It was identified that there was a large queue of menu updates waiting to be processed so the queue was purged and a full system wide update initaited.
Feb 2, 13:35 GMT
Investigating -
It has been identified that stores menus are not updating once Menu Groupings are updated.
Feb 2, 12:08 GMT