Remote desktop problem

I have setup a RD host. The problem is simply that when anyone other than an Administrator logs in remotely, they don’t get a desktop. When they close Quickbooks (QB opens automatically) it immediately logs them off. I can’t find the setting in GPO to allow desktop access for users other that administrator.