You have been doing it all wrong!
CrazyRussianHacker has a tip for taking off your t-shirt very quickly using only one hand. Just tuck your elbow in, grab the underside of the sleeve with the opposite hand and yank it up over your head.
If you want to impress your lady, come home and take off your shirt the super-fast way, with one hand.