It can be your mic or it can be as suggested your sound card. I had a headset that made me really quite i thought it was my sound card but turned out it was the headset.
But before you go out and buy a new mic or headset do what was suggested above and if all fails you might want to get a new mic.