Using regedit you can go to HKEY_LOCAL_MACHINE\SOFTWARE\Microsoft\Windows\CurrentVersion\Uninstall
To see which application each sub-key represents, open it and there should be at least two values 'DisplayName' and 'UninstallString'. 'DisplayName' is the name used in the Add/Remove programs list.
Find the ones you want and delete the sub-key representing that program.
You could also use Microsoft's TweakUI.
Finally, there are many free- and shareware programs that will do this. Here's one called Add/Remove Cleaner (shareware).
http://distortions.com/software/addrem.htm
Here's one called JoneSoft Uninstall Cleaner:
http://www.ozemail.com.au/~jaesenj/downloads/jsuic.exe