Hostname resolution failed when VPN started

Once my Windows 2003 server starts the VPN service, its hostname resolution doesn’t work. The server cannot be reach by using its computer name on either the core network or the VPN.

I wonder whether it would be the problem of having only one LAN adapter or the Windows Internet/Firewall Connection Sharing (ICS) service has to be shut-down.