To our monday community, we’d like to share an update about a brief service interruption that occurred on our US servers on Monday, July 1st, 2024.
What Happened:
- At 2:04 AM EST, a bug from a third-party provider caused a configuration error during a database update. This led to a service interruption on our US servers for approximately 15 minutes.
- Some customers may have experienced slowness on the platform leading up to the interruption.
- There was no data loss, security risk, or impact on our EMEA and APAC servers.
Our Response:
- Our monitoring system immediately alerted our R&D teams.
- We promptly opened a support channel with the third-party provider while initiating internal troubleshooting.
- By 2:19 AM EST, service was fully restored, and the platform was functioning as expected.
- Our teams continued to actively monitor performance as a precaution.
What We're Doing to Prevent Similar Issues:
- Our team is working closely with the third-party provider to investigate the root cause of the bug and improve our review processes.
- To mitigate future issues, we are developing a dedicated backup instance for these third-party components.
We sincerely apologize for any inconvenience this interruption caused.
Our top priority is to ensure a stable and exceptional user experience on our platform.
Additional Resources: