• Diff for "Service Outage Report - 20181128"
Last updated at 2018-11-28 06:16:01
Differences between revisions 2 and 3
Revision 2 as of 2018-11-28 06:09:58
Size: 699
Editor: loxch
Comment:
Revision 3 as of 2018-11-28 06:16:01
Size: 698
Editor: loxch
Comment:
Deletions are marked like this. Additions are marked like this.
Line 5: Line 5:
This outage is caused by the wrong input validation for Custom Item which leads the crash of internal RTT daemons. Due to these crashs, the load average of the mudfish master server were increased abnormally then it made this service outagt. This outage is caused by the wrong input validation for Custom Item which leads the crash of internal RTT daemons. Due to these crashs, the load average of the mudfish master server was increased abnormally then it made this service outage.

Service Outage Report - 20181128

Summary

This outage is caused by the wrong input validation for Custom Item which leads the crash of internal RTT daemons. Due to these crashs, the load average of the mudfish master server was increased abnormally then it made this service outage.

Outage Time

  • 2018-11-28 10 AM ~ 2018-11-28 2 PM (KST)
    • For 3 ~ 4 hours, the login / RTT calculation process doesn't work well.

Current Status

  • All services of Mudfish should work fine.
  • Enhanced the input validation for Custom Item.
  • Enhanced the checking of Input Validation for server daemons too and those are currently deployed into the production server.

Service Outage Report - 20181128 (last edited 2018-11-28 06:16:01 by loxch)