I did end up getting it worked out, it turned out to be an order of operations problem.
I was trying to install SSO, then Inventory Service, then Web Service, then vCenter Server. And on a domain, this order actually worked fine. For some reason, when not on a domain they have to go SSO -> Web Service -> Inventory Service -> vCenter Server (This order works in both scenarios, just to be clear).