Collections are just like any other folder: If you want to change which columns are shown in them, you have to save or update a folder format for either the specific folder (the collection you want to change) or for the type of folder (Collections in this case).
Any changes you make to a window which you don't save are only temporary.