That will happen if you open the button editor from a lister which is on-top. (Otherwise the button editor will usually open behind the lister which is confusing.)
I'm still having an issue though. With the pins in OPUS Level Top mode (main app window and the customize dialog) the button editor windows are still on top of everything.
When I put the pins to off (horizontal) the dialogs are on TOP.