Server Update/replication

I have 21 servers on a LAN and I want too join them to each other via second NIC and a separate switch so that they replicate/update each other with out creating loads of traffic on the LAN, when I tried this the network went crazy so I had to remove the connections to the switch and go back to the drawing board. Could someone please give me advice on how to do this properly?