Foundry Intermittent and network latency
Incident Report for TrueCommerce
Postmortem
  • The TrueCommerce incident began at approximately 9:30 a.m. ET on November 19th resulting in intermittent performance degradation of processing transactions on the TC.net network platform and within the TrueCommerce Foundry platform and Transaction Manager application  
  • The root cause of the issue was related to an unplanned incident within a TrueCommerce technology vendor’s internal networking infrastructure
  • TrueCommerce’s technology vendor resolved the issue at approximately 1:40 p.m. EST
  • Following the resolution of technology vendor issue, it was determined that a full recycle of TrueCommerce’s core platform services was necessary to ensure all services were restored to full health
  • Complications were encountered during the platform recycle and startup process which delayed full restoration of services until approximately 4:30 p.m. ET
  • All platform services were confirmed to be fully restored at approximately 4:30 p.m. EST
  • All queued transactions were cleared following full restoration of services
Posted Nov 20, 2024 - 17:03 EST

Resolved
This incident has been resolved.
Posted Nov 19, 2024 - 17:42 EST
Monitoring
Transaction processing has been restored. Inbound transactions will experience some delay as processing catches up. The team is currently monitoring.
Posted Nov 19, 2024 - 16:34 EST
Update
We are continuing to work on a fix for this issue.
Posted Nov 19, 2024 - 15:44 EST
Identified
We are still experience issues with latency within TrueCommerce Foundry application. The team is still in process of restoring all services.
Posted Nov 19, 2024 - 15:41 EST
Update
We are continuing to monitor for any further issues.
Posted Nov 19, 2024 - 14:59 EST
Monitoring
The latency issue has been resolved. The team is validating that transaction processing has been fully restored.
Posted Nov 19, 2024 - 14:58 EST
Update
We are continuing to investigate. Customer will experience latency navigating the Transaction Manager application and transaction processing with TCNet and ecUtopia. TrueCommerce’s technical team is aware of the issue and working to resolve the issue.
Posted Nov 19, 2024 - 13:47 EST
Update
We are continuing to work on a fix.
Posted Nov 19, 2024 - 13:33 EST
Update
We are continuing to work on a resolution for the issue.
Posted Nov 19, 2024 - 11:45 EST
Update
We are continuing to work on the issue and network transaction is also seeing latency.
Posted Nov 19, 2024 - 11:04 EST
Identified
Our data center provider is experiencing an issue with connectivity. Our team is actively working with them on resolution.
Posted Nov 19, 2024 - 10:00 EST
Investigating
We are currently investigating an issue that's introducing intermittent latency with login and some pages loading with TrueCommerce Foundry.
Posted Nov 19, 2024 - 09:48 EST
This incident affected: Foundry Applications (Transaction Manager, Pack & Ship) and Platform (ecUtopia).