ideally, you should just unprepare the phantom entity. this will only work if the phantom host shows zero vms on it from vCloud Director.
In a worst case situation:
1. clear inventory tables, and property map
2. remove the bad host from managed_server table