For the .cue and .log files, go to Preferences -> Viewers -> Plugins and configure the Text-File Thumbnails plugin, which has options for whether or not it should force the icons to be shown.
I think the .m4a and .mp3 icons may be forced-on with no way to turn them off at the moment. I'm sure there was a reason for that but I can't remember what it was.