Using existing ssh public key files

Is there a way to use my existing public key file (generated by openssh) when connecting to a remote ssh server?

Yes, via Pageant which is part of PuTTY.

See here for some more details: [SFTP login with rsa-key)