Securing the VPN server

I have just setup a VPN server and it works well. My concern now is with security. It is going to be placed behind a firewall. How should I setup the firewall so that my VPN works but at the same time not allow everything to get through.