Hi
For Windows P2V you are correct.
In case of Linux P2V, the destination machine connect to the source, the destination machine's virtual network (not the management one) needs to have connectivity to the source machine's virtual network.
In case of V2V (both Windows and Linux), the traffic passes through Converter server, which means Converter's machine needs to connect to management interface of both source and destination ESX.
I haven't actually used environment with VLANs, so better check it than trust me blindly :-)
HTH,
Plamen