How much do comments slow down the compiler?

Is it really worth it to force the compiler to have to sort out which statements to skip and which to attend to? Seems like a non-zero slice of time is being wasted by the lexer just to make shit easier for the programmer.

Comments are stripped before everything else is parsed
thttp://en.wikichip.org/wiki/c/phases_of_translation#Translation_phases