Resolved -
We appreciate everyone’s patience as we worked through this incident today. All AWS services are now operational, and our affected services have fully recovered and are caught up. Our teams will continue to monitor to ensure everything remains fully operational.
Oct 20, 19:04 EDT
Monitoring -
NextGen Broadcast sends are beginning to process now. We will continue to monitor progress until all sends are caught up and processed.
Oct 20, 18:27 EDT
Update -
There have been no changes since our last update. We are continuing to actively monitor updates from AWS as they work to restore all services. We will continue to actively monitor the situation and work on mitigation options until all services are fully restored. Impact still remains the same for Broadcast sends for our NextGen clients.
Oct 20, 17:37 EDT
Update -
We appreciate your patience as we continue to work through this incident. AWS is continuing to work to resolve this incident in their environment. At the same time, Listrak engineers are actively working on options to start processing NextGen Broadcast sends. We will continue to post updates as steps are taken to fully restore send functionality.
Oct 20, 13:12 EDT
Update -
We are continuing to monitor the status of the incident with our upstream cloud provider. Engineers are also working on mitigation options to enable NextGen Broadcast sends. Once service is restored, previously scheduled sends will begin to process.
Oct 20, 10:34 EDT
Update -
Our help desk provider is also affected by this upstream outage which is preventing client access to https://support.listrak.com. If you are having issues reaching the Listrak Support Portal, please use the chat option in the platform or call 877-362-4556 ext 1
Oct 20, 09:06 EDT
Update -
Performance is fully restored for Product Recommendations. As of 9:00 AM EST, we are still seeing issues with audience generation for NextGen Broadcast sends.
Oct 20, 09:00 EDT
Update -
We are seeing performance degradation with serving Product Recommendation images. The AWS outage has impacted the availability of scaling resources. Our engineers are actively shifting resources to improve performance.
Oct 20, 08:31 EDT
Update -
Our import service is operational again. Engineers are continuing to monitor imports and restart any imports that might have failed during the outage.
Oct 20, 08:18 EDT
Identified -
Beginning around 2:30 AM EST, Amazon Web Services experienced an outage. AWS is continuing to work through issues with multiple services. At this time, this is impacting data imports and NextGen email and SMS sends. Our engineers are continuing to work through mitigation steps while we wait for AWS to return to fully operational.
Oct 20, 07:22 EDT