Resolved -
From 16:30 till 17:52 Oct 16th, 2024 PDT, our US data processing component was slower that usual and all US customers experience up to 87 minutes of latency in their incoming data in their charts, streaming exports, or experiments.
There was no data loss during this incident and further actions are not necessary from our customers.
Oct 16, 21:53 PDT
Update -
Our realtime pipeline has caught up. We are monitoring the /batch pipeline to catch up for full recovery. ETA is about one hour from now.
Oct 16, 20:32 PDT
Monitoring -
We have identified the root cause and deployed a fix. We are now monitoring the system to clear the data backlog.
We do not expect to have any data loss during this incident and further actions from our customers are not necessary.
Next update will be in about 2 hours
Oct 16, 18:23 PDT
Update -
We are continuing to investigate this issue.
Oct 16, 17:53 PDT
Investigating -
From 16:30 Oct 16th, 2024 PDT, our US data processing component is slower that usual and all customers are missing the last one hour of their incoming data in their charts, straaming exports, or experiments. As of now, we are not expecting any data loss and further actions are not necessary from our customers.
We are actively working on this issue and will post another update in the next 1 hour.
Oct 16, 17:51 PDT