The same setting that makes folders open in new tabs also affects Zip files. (See screenshot below.)
For RAR files you have to edit the RAR filetype's Open Action. I've just re-written the FAQ on setting up the RAR filetype and added information on how to make them open in new tabs. Check out the new FAQ and shout if you need any help.
