Winsock error 10061

I have a few domains that our server can not send a message too. The message I receive is Winsock error 10061 the server has refused to connect with you at the IP. We are receiving messages from them just fine, but we cannot reply. Does anyone have a suggestion?