To be precise, if I make a right click and choose to install the font with menu (which is part of Windows you said), everything is fine. I can see the font appear in the folder and I can delete it normally.
All this really happen when I use DO to install fonts.