Why some empty folders can’t be deleted ?

I saw some empty folders in my C:\Program Files.
Programs previously located in these folders have been uninstalled, but when I tried to remove these folders, error message occured :
Cannot remove folder xxx: It is being used by another person or program.
Close any programs that might be using the file and try again.

How to clean this thing up ? Thanks.