Building access is more of an issue
My company uses revolving doors for 'normal' access - this is a problem if one uses a cane, and impossible for walkers/wheelchairs - but needs special authorization and justification to be able to use the 'Handicapped' doors.
Fire drills are unforgiving, as they require using stairs - I'm moderately handicapped (my right foot is badly deformed) and stairs are not only very slow - but it hurts a lot to use them... Where's a slide when we need one ?