I don't take them off I wear them and feed the haters... I don't play on pub servers all that much, and I've never gotten too much hate on pub servers but I get a lot of hate on ADK servers, NwA seem fine but on ADK people has asked for me to be kicked called me names etc. I just keep sniping silently and don't get mad.
Dominating haters is the best you can do... not always possible but most of the time haters/trolls are not that good so no big deal.
I don't really like pub servers, got used to the absence of cussing so I get annoyed quickly. I only play outside eGO when I go get owned my nik or codo in MGE, sometimes following Human or playing a bit of turbine/2fort in MiT with impostr