Hi,
Do you have your SSO server in HA mode? I guess with 5 vCenters and a single SSO server you are risking the environment if the SSO are not in a HA or multiside mode. Well, for the upgrade, begin with SSO, then touch each vCenter which involves upgrade of inventory service as well.
Cheers
Sunny