Another test I would do it place the two failing hosts on the same host, also migrate the edge device to that host (so all traffic is host local).
If that works then the issue might be something with the vlan routing that is backing the isolation.
Also... what type of network pool is this backed with? VLAN, VCNI, VxLan, NSX?