Cleaning up custom menu items in word

I am having trouble cleaning up menu items in Word. I added two items to the file menu from my AutoExec subroutine, and tried performing a delete on those items in AutoExit. The delete operation works, but my changes to the menu are not saved -- upon next startup of word (without the macros to add new items) the "deleted" menu items are still there.
I was able to override FileExit and perform the deletion, however if the user exits word through any other means (clicking the system menu close, or Alt-f4) that code is not called.
Is there any way to programmatically force Word to save the current commandbar layout?