When I add/remove buttons from the Excel Standard toolbar and exit Excel, the
next time I reopen Excel the buttons are reset as before.

This is not a problem with the Formatting toolbar.