Save Permissions

I am setting up a new server, Windows 2003 R2 at a library. One problem they have is that people on the public access computers can save documents and other items to the desktop through Microsoft Office applications. How do I stop that?
Servers are not my strong suit!