Resolved
Got the backup working, traffic is back to normal.
Monitoring
Traffic is now served from a backup. Some requests are being rate-limited while capacity recovers.
Identified
Identified the cluster that's failing, working on backup plans.
Investigating
Serving cluster we use to serve the model is down, we are working to restore.
