• Diff for "Service Outage Report - 20181128"
Last updated at 2018-11-28 06:16:01
Differences between revisions 1 and 2
Revision 1 as of 2018-11-28 06:07:41
Size: 653
Editor: loxch
Comment:
Revision 2 as of 2018-11-28 06:09:58
Size: 699
Editor: loxch
Comment:
Deletions are marked like this. Additions are marked like this.
Line 14: Line 14:
 * All services of Mudfish should work fine.

Service Outage Report - 20181128

Summary

This outage is caused by the wrong input validation for Custom Item which leads the crash of internal RTT daemons. Due to these crashs, the load average of the mudfish master server were increased abnormally then it made this service outagt.

Outage Time

  • 2018-11-28 10 AM ~ 2018-11-28 2 PM (KST)
    • For 3 ~ 4 hours, the login / RTT calculation process doesn't work well.

Current Status

  • All services of Mudfish should work fine.
  • Enhanced the input validation for Custom Item.
  • Enhanced the checking of Input Validation for server daemons too and those are currently deployed into the production server.

Service Outage Report - 20181128 (last edited 2018-11-28 06:16:01 by loxch)