Can I plug a modem directly into a switch?

So I have a modem with two ports on the back, one that goes to my router and one that goes to my desktop, and every time I want to unplug my desktop port and put it into my PS4 or another pc I have to restart the modem which can be a pain for me. So I was wondering if I plug the second port into a switch then into all my devices if that would negate having to restart my modem every time I plug something new in and if it’s even possible.