It seems like the hosts can't pass traffic on the VXLan network. It would be used when sending traffic between the hosts.
Many times this is an issue with the VLAN being used for the VXLan VTEPs. If you create a couple VM's (one on each host) using vcenter (no VCD) and put them in a port group that used that VLAN are the able to talk? If not then issue is the vlan. If they are the issue could be around the traffic being blocked at your switch upstream. (Multicast with IGMP snooping/querier needs to be supported and configured for VXlan to function correctly)