Unless you know that person...
I find it amusing how a dude can say something completely irritating and annoying, only to chalk it up to being a joke five seconds later when they realize it wasn't well-received.
Everyone reacts differently and no two people are the same, inside and out. So to expect someone to take something lightly when you barely know them or get along with them, is it any surprise that they don't react in a way that you hoped?
For people with no common sense and just bad social skills in general (particularly towards me and a few other poor souls out there subject to the same thing), I have this say;
Rhydas: Unless you know what you're doing, kidding around with me is pretty much a bad idea...