I had a similar problem but it was with the NAT setup on the router. I had all of the ports blocked except for port 25. Even though the router was for the internet connection it blocked the epheneral ports needed to communication on the Lan. Like you it would only work after a reboot.
The quickest way to know if this is the case for you is to open internet explorer after mail stops flowing. If you can't access a public web site you have the same problem. Also, try to remote into another server from server z. If you can't do it, then you definately have the same problem. Epheneral ports incrament each time a connection is made until they run out. In most cases the first port will timeout and reset before the last one is used. I ahd this problem with Cisco 2600 series routers.
The easy fix for this is to add a second IP address to the server that is not NATed. This way the server can use the unNATed address for communications and the NATed IP address for recieving mail.
If this is not the case for you, then let me know if your getting any errors in the event log. You may need to increase the diagnostic monitoring level for server Z and X.