I don't see how you can't say something at times. I'm not saying you have to get nasty--but there are times where it is completely understandable to question a players judgement. However, for any negative thing I say, I probably say at least as many (if not more) positive things.
I don't curse at the players, and I also don't try to be a comedian. Every fronton has those types--the ones that bring up something that is really grating to a player or even gets personal. That is probably worse than cursing in some respects.