Can a Single VCO instance work with Multiple SSO Domains/ 401 (Full authentication is required to access this resource); invoking error handler

I have been going crazy for a couple of days trying to configure a single  VCO to support 3 Vcenters all using their own SSO.   While I can get VCO to connect to the vcenters they wont register to any of the Web clients.   Once i changed the VCO authentication to LDAP i get this error on any of the vcenter web logs

GET request for "https://x.x.x.x:8281/vco/api/users" resulted in 401 (Full authentication is required to access this resource); invoking error handler