I've got a bulletproof response for these situations:

"Why did I know that? Because I've already screwed up that way ..."

This generally goes just before or after the statement that I know my stuff not because I'm Rhodes Scholar bright, but because I've figued out about every way to screw up ... twice.

A little modest, self-effacing discussion can defuse just about any difficult situation.