Memory Usage Outage

Incident Report for ZenML Public Services

Resolved

The ZenML SandboxAPI server suffered an outage due to excessive memory consumption, from midnight to approximately 10am CET. Extra alerts have been set up and a threshold for triggering investigation has been implemented. Engineers have been assigned to fix the underlying issue within the Sandbox API code. We are investigating similar issues that might occur in the ZenML Hub and have unblocked any users who were unable to sign up for their Sandbox during the outage.

Posted Jun 28, 2023 - 08:00 UTC