Isn't that true of any database?
iPhoto happens to be a database of sometimes huge files, depending on the camera you use. It wasn't all that long ago that maintaining any kind of database with a few thousand files in it took a while to sort/review/display. I haven't noticed any significant speed difference from any other app with a duplicate set of the same files.
Keep Up with TechRepublic