Sounds like what happens when I play spy, the most annoying and funny thing is when a pyro is just running along and as soon as he passes by you he randomly starts spy checking even though you were cloaked the whole time.
It makes you think "OH COMON!"