Turned out to be a problem with the local firewall on the vCenter, for now i have disabled it completely and authentication works fine.
I checked the Firewall rules and there were already some custom rules for vCenter (created at installation time i guess) that were enabled. So not sure what extra rule is needed for now.