Cannot delete unwanted files

I have a client that had an open FTP, as a result a large number of files and folders have been dumped on the server. While trying to delete the files errors such as “Cannot delete, cannot read from source file or disk” and of course “cannot delete, directory is not empty”.
I have tried an FTP client and renaming the the folders.
Any suggestions?