When one panel is shown in thumbs mode and other in details view,i need to press tab 2 times to switch focus from right panel to left panel.
Turn on Preferences / File Displays / Options / Use Tab key to switch source/destination in dual-display Listers and then a single tab key press should do it.