Thanks to VMware support at HP they were able to replicate the error.
To everyones surprise even the HP engineer our fix was to add a single AD user to the VMware permissions (not SSO) and it worked.
We created a new domain security group and added the required users and that also worked.
We are not sure why??