• Service Outage Report - 20260519

Service Outage Report - 20260519

Cause

In this case, the mudfish service failure was caused by an overload on the web server responsible for managing the status of the mudfish nodes. This high load led to an OOM (out of memory) issue, which caused the web server process to be killed and resulted in the outage.

Due to this issue, almost all mudfish nodes did not be shown at the working list of mudfish nodes while all nodes were working properly. We apologize for the inconvenience.

Duration

From 2026-05-19 3:30 AM to 2026-05-19 8:00 AM (PDT)

For approximately 4 hours and 30 minutes, you can't see the list of the working mudfish nodes properly. Other parts were all working.

Actions

As a preventive measure, we are planning to expand the resource capacity of the web server to handle higher loads and prevent future OOM issues.