Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

Usually you notice issues by the server locking up, the clients reporting problems, or messages being missing from the log (which you tend to notice when you search for specific things in the logs).


So how do you know that you're not just getting 80% of "log entry X" just because you get hits for them every now and then?


Logging is usually pretty deterministic.

A request might generate log entries a, b1, c or a, b2, c, depending on some conditions. The exact contents vary by request (otherwise there would be no need to log them), but the type is always the same.

If you find logs for c without either b1/b2 or a, you know log entries went missing.

If you have a 20% miss rate with recording your log entries, and you analyze just 20 log entries, the chance that one of them is missing is already around 98.8%.

If you actually use your logs for anything, it becomes pretty obvious pretty quickly when they are incomplete.




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: