Importance of Cache size on larger HDD?

How important is the Cache on Larger HDD’s
Does it really matter if you get one with a larger cache or is the access speed of more importance.
Perhaps it may be a combination of the two!
Do Larger drives have an access delay problem?
I think they do. At least so on my older PII.