It plugs together this way:
--incoming phone line--modem--router--stations
Your modem connects to the modem port on the router. If you later get dsl or cable, the cat-5 cable from a dsl modem or a cable modem will get plugged into the appropriate plug.
Your various computers each have an ethernet card, with a twisted-pair plug. A straight-through cat-5 cable, with RJ-45 plugs at each end, connects each computer with one of the four port sockets on the back of the router.
You will probably need to configure the router. Read the manual, particularly looking for the following subjects:
Logging into the router
Connecting a modem
Dialing numbers, account numbers, password for a modem
How to configure your computers
You will need to log into the router (might use telnet or might use a browser, according to the manual). Once there, you will need to tell the router that it has a modem attached, the number you want the modem to dial when it is time to connect, and the login name and password the router should used to connect to your ISP.
You will need to configure your computers according to the manual. Normally this requires that you select "Obtain an IP address automatically" in your network control panel, under TCP/IP properties. This activates a DHCP client, which will retrieve information from the router when the computer boots up.
Good luck.