HP Wireless Keyboard

Wondering if anybody else has faced this problem. I own an HP wireless keyboard and mouse.. and both work fine separately. But if I keep a key pressed down (like the shift key), then the mouse stops moving.. any ideas?

Thanks,
AM