Currently, you have your server connected to two different networks, but for some reason, they are declared as the same network.
If the netmask is 255.255.255.0, then all different addresses that share the same "prefix" 192.168.0.x expect to find each other directly, without passing through any gateways.
The most important question now is:
Do you want your server to filter all traffic to the internet from the other computers, or not? This also means, that if your server is turned off, then no other computer will be able to reach internet.
If no, then you need to change your setup. Let all computers in your network, including your server, have different addresses in the 192.168.0.x space and use the router 192.168.0.1 as the gateway.
If yes, then the network between the modem and the server should have one address space, and the network with your local computers another. Say:
Modem 192.168.15.1, Server upper nic 192.168.15.2, Gateway 192.168.15.1, netmask 255.255.255.0
Server lover nic 192.169.5.1, netmask 255.255.255.0, no gateway
Other computers 192.168.5.x, netmask 255.255.255.0, gateway 192.168.5.1
Oh, of course you need to insert suitable DNS everywhere, too. You can safely enter the dns addresses you get from your ISP, or say GoogleDNS 4.4.4.4 and 4.4.8.8 everywhere, if you don't need any internal name resolution (and therefore set up an internal dns on your server).