How do I set up a custom number format that includes a degree symbol?

I’m trying to set up a custom number format that includes a degree symbol. I can append it to a number in an individual cell using Alt-00B0, but have not been able to make that work in the custom number format setup, so I can use it in a group of cells. The format painter won’t even copy it to other cells.