Remote Desktop through a router

Is it possible to start a Remote Desktop session on the following configuration:

Computer ‘A’ to
Router ‘A’ to
Internet to
Router ‘B’ to
Computer ‘B’

I do not want to connect either computer directly to the internet. I also do not want to put either computer in a DMZ.