Is it possible to recolor the yellow folder icon of a directory rather than the text name of the directory?
Do you mean using labels? If so, yes, labels have a setting which lets you change the colors of icons (instead of or in addition to changing the text colors).
Related, if you instead want to change all folder icons: