Granting Power Users full control of USB devices in Device Manager

I would like to grant Power Users full control of their USB devices (install drivers, change COM ports). A device in particular operates through different COM ports, so they must be able to change ports via Device Manager.

I tried Admin Tools > Local Policies > User Rights Assignment > Load and unload device drivers but this did work.