How would I go about searching for just directories named "Temp"?
You can do it using the Find function. I personally prefer to use Find with the Utility panel, below is a screen grab of the utility panel set up to find all folders named Temp in the current folder and all its subfolders.