V2V traffic goes from the source machine to converter server to the destination ESX (this is no so for P2V). So it may make a big difference where Converter server runs.
Besides Converter uses NFC protocol which is not tolerant to high latency networks (that is why conversions generally don't run on WAN).
HTH
Plamen