There are a buch of possibilities here from the vague description so to narrow this and save you a bit of trouble i am going to ask a few questions
1 Does this happen at random outside of removing the device?
2 Have you done any driver changes / installations of hardware recently?
3 what audio device is it? This sounds most likely an issue directly with the device and its hardware which means possibly a corrupted driver or conflict.
4 What version of Windows are you using?
5 Have you noticed odd slowdowns on games?
6 You mention a sound device have you noticed any changes in sound quality / stuff?
7 Is it a motherboard soundcard or a hardware soundcard that you installed? ( if its one you installed make sure its seated properly and test if it happens anymore this can cause it to.)