I have Dell Poweredge 4300 server, NT40 with a PERC II, 4 channel Raid controller . 1 channel is the mirrored system drive, and the other 2 channels are RAID 5, 118 Gig and 350 Gig respectively.
I have a user who creates files as large as 4 gigabytes on the 350 Gig array when he runs a simulation program. There are also any number of files from 1KB up to 4 gigs created in the same folder. The last run he did created 200,000 files in one folder, with a total size of 10 Gigs.
When we try to delete these files to clean up, the CPU goes to 100% and all other users are effectively locked out for about 10 minutes until the process is complete.
What causes this? How can we delete these huge files w/out bringing the system to a halt. We have tried moving them (the huge ones) to another folder, but the problem persisists. Currently we have them scheduled to delete 20 or so at a time to minimize customer impact.
Is this a limitation of NTFS?