A Better Way: Use WordPerfect
As a professional writer (and a bit OC about my text), I find Word unusable precisely for this reason. When I am not using content management software I compose in WordPerfect -- which is still very much alive -- and export to the client's preferred format.
Why? Because WordPerfect exposes each and every buried code, and lets you change, move, and delete them directly. It's called Reveal Codes, and it's always been there. In this view (which, when invoked, shows as five lines at the bottom of the screen), all the embedded format codes act just like any other character. Just find the problem code and delete it.