From 2025-05-11 23:55 UTC up to 2025-05-21 1:05 UTC, approximately for an hour, core Auvious Services in Europe region were malfunctioning, due to the main video component not being able to recover the connection to the event bus after an infrastructure upgrade.
The infrastructure upgrades for Europe region is scheduled to run automatically every Monday at the early hours in European timezones. The upgrade procedure uses rolling upgrades and service is not normally disrupted.
The issue was resolved after our monitoring system alerted the monitoring team and issue was escalated to technical team which restarted the video component which recovered the function of the Auvious system.
The issue so far has been identified as introduced in a framework (Spring Integration/MQTT) update that, and seems to have been fixed in a later version update which was applied the next day. Our tests show that this version doesn't suffer from this issue, however we've implemented some changes in our alerting procedures in order to respond and resolve similar issues faster if similar events occur.