On June 19th, 2018, a DB component of our web reporting system got overloaded for about 27 minutes causing the web reporting system to behave abnormally with intermittent access. We apologize for any disruptions this may have caused. In all cases, there was no data loss.
At 11:11 PDT Monday, June 19th a DB component of our web reporting system was overloaded by our notification feature. After figuring out the issue, We decided to turn the notification feature off until we completely fix it. We pushed the fix later and our systems fully recovered by 20:51 PDT Monday, June 19th.
During the period that web reporting system was affected, you were not able to successfully use Amplitude web reporting functionalities. After we turned off the notification feature, you could use all web reporting functionalities except that unable to receive any notifications until we fully resolved the issue and turned the notification feature back on around 20:51 PDT Monday, June 19th.
We have already optimized the notification feature to reduce its load on the DB by a few orders of magnitude. In addition, we have also improved throttling heuristics on other high DB load features. We are confident that similar issues will be unlikely to happen again. We understand that our customers rely on us to find the insight and make decisions, we apologize for the incident and any complications it has caused. We will continue to improve the availability of our web reporting service.
Thank you for your support.