You should check the router.. Some IT stores allow you borrow routers for testing IF you provide them your ID so they can be calling you back, if you're not returning the product soon enough.
I had similar problems with a TeleWell 501 router in phone-line ADSL and as soon as I changed to a Zyxel...