I guess the issue is, that DO currently does not take the number of folders/files into account, when the folder format system trys to detect the content-type, so a single image in a folder containing 40 more folders, would still give you thumbnails view e.g.
Consider testing the OverrideFormats add-in linked below. It allows you to activate a viewmode or format based on the number of folders/files, path or drivelabel. I can add checking existence for specific files or folders, but maybe you already get along with it how it is. I'd suggest testing against a path and wether there are more files than folders present and let the overrrider switch to your prefered view mode (details in this case if I understood you correctly).
Find it here: Event: OverrideFormats (..or viewmodes on folder change)
Of course I would prefer DO to handle these situations natively as well, but as long as it does not, the overrider does a good job for me.