So you have this directory structure:
Top
And you want a particular format for the Genre and Artist levels and a differnet format for the Album levels.
I don't think there is a convenient way to set that up exactly as described.
1) Method 1 (Perfect result but lots of effort)
Obviously you could save formats for Top and all of the Genre and Artist folders (turning off the option to apply the formats to sub-folders) and then use Content Type formats, or more individually saved formats, for each of the Album folders. That would be a lot of work to set up.
(If you do want to do that, and you're comfortable with text editors and XML, then it would probably be easier to do it using a text editor on the config files. That would let you copy & paste the format into lots of folders without all the clicking you'd have to do using the GUI.)
2) Method 2 (Less effort but not quite what you wanted)
The alternative, which won't give you quite what you want, is to set a format at the Top level which makes things the way you want for the Top, Genre and Artist levels. That format would be set to apply itself to all sub-folders, meaning you sort out all of those directories by just creating a single format. That just leaves the Album folders...
...which is where things break down a bit. Of course, you can save specific formats for each and every album folder and that will work, but that's a lot of effort. In avoiding that, the obvious thing to try, as you did, is to create a Content Type format which sets certain columns in folders which have a lot of music.
That won't quite work, though. As per the Folder Formats FAQ, folder-specific formats are at the top of the list in Preferences -- and above Content Type formats -- which means a folder specific format will be chosen first it it matches a folder. That is still true when the folder-specific format was saved for a parent folder and has the "apply to all sub-folders" option ticked.
The only thing you can do, without saving lots of individual formats, is set the Top format to "inherit columns from other matching formats." This means that when you go to an Album folder it will match the Top format and get all of its columns, but it will then also keep looking down the list of other formats to pick up more columns. The Content Type format will be matched and get to add its music columns as well.
That's perfect, except you've got the unwanted columns from the Top format added to the mix at the Album level. I don't think there is any way around that which doesn't involve saving a lot of individual formats (or not having any special formats at the Top/Genre/Artist levels).
Thoughs
This type of question has come up a few times, almost always involving music folders. The only thing I can think of that could be added to Opus to make it possible is the ability to save folder-specific formats with a regular expression instead of a path, so you could control exactly which folders were matched by them and exclude or include certain directory levels.
That would work very well for me but many people already find both folder formats and regular expressions to be complex so I don't know how useful it would be to everyone else. If you have any ideas about how this could be improved then speak up!