LAN using router with hub

I know sharing a high speed cable Internet connection is acomplished by using a router. I have a router for this. To establish a LAN connection between the two Win 98 PCs do I need a hub? The router hooks into the hub and the hub connects to my two PCs?

I have a router with one WAN port and 4 LAN ports. It would be nice just to use the router for establishing the LAN connection.

I guess I was thrown a little off track due to the 4 LAN sockets. Is that just for 4 hubs or PCs thatonly share a Internet connection not to network PCs together? I want to see the hard drive of the other computer and vice versa.

Thanks!