Sorry, but the answer to your question is YES/and NO. Win9x can be used only in a peer to peer networking situation. As for the networking cards (NICS) if they are of the newer type they are plug and play compatible and should be recognized and all the drivers loaded after install and reboot. The only thing you must do after that is configure each machine to see each other.
What I would do is after installation of each NIC. to right click on network neighborhood, goto properties.
You should have at minimum installed Microsoft Networking, Your adapter (NIC), TCP/IP and file and print sharing. If some are missing you can easily add.
Microsoft Networking, and TCP/IP will install by default when a new adapter is installed. The only thing (usually needed) to be added is file and print sharing. All you have to do is click on the add button, choose service and highlight file and print sharing. Then you need to assign one TCP/IP number to each machine. The private IP addresses thatare used are 192.168.0.1 thru 192.168.0.255. So while in network properties highlight TCP/IP and click properties there are many tabs to choose from but you only need to change the first one you see. It will ask to assign a number or define a number. So on pc #1 put in 192.168.0.1 hit ok, then ok it might ask for the 98 cd to load files. After that is done you will need to reboot. Do the same on machine #2 using the number 192.168.0.2 also installing file and print sharing as before. Then one last step almost done. On each machine you need to tell it what to share. This is done thru my copmputer. In my computer right click on yiour c drive and goto sharing and select share, as C with full permission hit ok then a small hand will appear under your c drive denoting its currently shared. Do the same on the other pc and VIOLA you have a small Peer network.
Signed, I know what you are going thru!! GOOD LUCK!