If your playing a video game though, Windows Media Player won't be the cause.
What sound card have you got? Or is it onboard? If its onboard, this could be a problem already, but should never be THAT big of a problem... hmm...
Whats your system specs?