After turning it off, use Settings > Toolbars > Set as Default Toolbar Set to make the current configuration the default for new windows.
Note that many of the standard hotkeys come from the Menu toolbar. If you turn it off, make sure Always enable this toolbar's keys in listers is turned on for it, as shown below. Otherwise things like Ctrl+V for Paste will not work.
This is a good example of why you might not want to turn off the menu bar. There are things you will want to use in it.
If you type a > into the file display, a command field should open at the bottom of it.
Paste Toolbar SETDEFAULT into that and push return to run the same command.