lsass using lots of memory

Our organisation recently applied SP4 to many servers. On many of these machines users have experienced slow performance. Looking at task manager we can see that lsass.exe is using up to 300 Mb of memory. Has anyone else experienced the same and what is the solution ?
Help much appreciated !