vCO and vCenter 5.5.1 w/slow inventory/plugin communication??

Is anyone still having very slow performance when trying to talk to a non-local vCenter via vCO vCenter plugin? We have the latest everything: vCO 5.5.1 w/vCenter plugin 5.5.1 and vSphere/vCenter 5.5.1. When we add a vCetner that is in another state it takes 10-15 minutes to return the inventory objects. This vCenter is actually very small with only about 300 objects. I've seen other posts with similar issues but this was said to have been fixed in 5.5.1. Our network between the two is pretty fast. I'm not sure the MBPS exactly but when I ping from our location (where vCO is) to the remote location the ping ms is 43 ms.

Anyone have any tips or performance increase optins in vCO OS itself?

Thanks