Restricted users and temp files

I have restricted the users on a 2003 server to not be able to delete files. The problem is whenever a user opens a document Microsoft Office opens a ~temp file for each opening which is not deleted when the document is closed because the user does not have that permission. I cannot find a fix for this. I thought someone here could put me on the right path. Thanks, jeff