Troublesome Compaq Keyboard

A Compaq desktop refuses to boot. Monitor LED turns green then amber right away. I unplug Compaq USB keyboard and computer boots fine. I plug the keyboard back in and it works fine. I remove keyboard from device manager and click Refresh, keyboard installs correctly. Restart,all is well. Shut Down, however, and problem returns. What’s the deal.