How to determine what log level to use?

Question

I am considering optimizing one of my indices: http://www.elasticsearch.org/guide/reference/api/admin-indices-optimize/

The documentation doesn't mention if optimizing an index interferes with current import processes. Does it block imports, or only impact the efficiency of imports?

Solution 1

I don't think there are any hard-and-fast rules; using the log4j-type levels, my 'rules of thumb' are something like:

• FATAL: the app (or at the very least a thread) is about to die horribly. This is where the info explaining why that's happening goes.
• ERROR: something that the app's doing that it shouldn't. This isn't a user error ('invalid search query'); it's an assertion failure, network problem, etc etc., probably one that is going to abort the current operation
• WARN: something that's concerning but not causing the operation to abort; # of connections in the DB pool getting low, an unusual-but-expected timeout in an operation, etc. I often think of 'WARN' as something that's useful in aggregate; e.g. grep, group, and count them to get a picture of what's affecting the system health
• INFO: Normal logging that's part of the normal operation of the app; diagnostic stuff so you can go back and say 'how often did this broad-level operation happen?', or 'how did the user's data get into this state?'
• DEBUG: Off by default, able to be turned on for debugging specific unexpected problems. This is where you might log detailed information about key method parameters or other information that is useful for finding likely problems in specific 'problematic' areas of the code.
• TRACE: "Seriously, WTF is going on here?!?! I need to log every single statement I execute to find this @#$@ing memory corruption bug before I go insane"

Not set in stone, but a rough idea of how I think of it.

Solution 2

Informally I use this sort of hierarchy,

• DEBUG - actual trace values
• INFO - Something just happened - nothing important, just a flag
• WARN - everything's working, but something isn't quite what was expected
• ERROR - something has happened that will need to be fixed, but we can carry on and do other (independent) activities
• FATAL - a serious enough problem that we shouldn't even carry on

I'll generally release with INFO being logged, but only if I know that log files are actually reviewed (and size isn't an issue), otherwise it's WARN.

Solution 3

Think about who needs to use each level. In my code I keep DEBUG reserved for a developer output, e.g. output that would only help a developer. VERBOSE is used for a normal user when alot of info is needed. INFO I use to normally show major events (e.g. sending a webpage, checking something important).

And FAIL and WARN are pretty self explanatory.

Solution 4

The convention in my team is to use debug if something is calculated in the message, whereas info is used for plain text. So in effect info will show you what's happening and debug will show the values of the things that are happening.

Solution 5

I tend to target INFO towards the user to give them messages that aren't even warnings. DEBUG tends to be for developer use where I output messages to help trace the flow through the code (with values of variables as well).

I also like another level of DEBUG (DEBUG2?) which gives absolute bucketloads of debug information such as hex dumps of all buffers and so on.

View more solutions

Comments

[Casebash]

I think a lot of the INFO or WARN would only help a developers