Record service drop issue

Alerts

received alerts for financial drop

Checking

Check network dashboard, network servers’ qps are dropping to merely 0

login to that server, check the nginx error logs finding many segfault is happending but core dump function is not enabled

Countermeasure

Using chef

  1. Add monitoring for segfault in /var/log/messages

2. Enable core dump functions for nginx services

Leave a Reply

Your email address will not be published. Required fields are marked *