This sounds like a hardware problem, actually. Try cleaning out
the jack -- you could have some dust trapped in there making
the connection fail.
Variation on the theme, but you were right, it was a hardware problem. I didn't have the L plug fully inserted on the headset end of the cord, it was ever so slightly pulled out.