sendmail timeouts

We are currently expericing frequent timeouts (client side) when users try to retrieve mails from our sendmail (linux 6.0) server. During this times, we have noticed that our memory usage shoots uo to 90+% – total memory is 256MB. Any ideas on how we can resolve this? Only sendmail and FTP services are running on our server.