One of the Nics are bad you are not using a cross over cable or you have a bad connection between you and the server.
Hubs switches and routers have a built in cross over, so if you have one between that is working you might need to see that it is configured with port forwarding for what ever remote software you are using.
If not Ip tables might be blocking it either coming out of the client or going into the server.
But If there is no active service on the server listening for a port to connect to you wouldn't get a connection anyway.
try doing a netstat - or what ever the command is for your os to see what prots are open and active
http://www.linode.com/forums/archive/o_t/t_1717/open_port_443_in_iptables.html
Best of luck