Deleting .tmp files

Is it safe to delete files with the extension .tmp? (I have a whole bunch of these in my C:\Windows folder and would like to delete them if possible since they are cluttering the folder.)