Two Gateways

I have two network cards..two different IPs but same subnet address, purpose is to have two IPs addresses with two different gateways,But it didn’t work?!! clients on the gateway of the second Network card can’t ping my server!!
anyone have any clue how to solve such a problem.

thnx