VPN-Can use ip add but not comp name

Hi, I have setup VPN server in my environment using 2 Network Card . In my Intranet, we do not have internal DNS, DHCP but we do have wins.
I have already setup at the Intranet network adapter my Win server ip address.
when we do the vpn connection, I can ping all the servers but cannot ping using the server name.
If I want to connect to my file server, I have to mnaually add it in the windows explorer using ip address. Is there a way to make the client recognise the comp by name and not ip address. Does it got to do with the DHCP relay agent properties? because I do not have DHCP server.
By the way, my Domain controller is still in nT4 and not win2000.
appreciate the feedbacks.