Dhcp server behind a router

OK i have a home network setup. Currently i have Modem>server>switch>pc. The server is handing out the ips and eveything so that part works but they cant connect to the internet. now should i give the client pcs the dns of the ISP or router. or should i create my own dns server.