XMMS can output directly to ALSA; it doesn't need a sound server. Gaim probably uses Gstreamer, which you should set to use the ALSA output sink. However, I know nothing about WindowMaker, so I can't help you there; sorry.