Cannot perform remote desktop to virtual machine

Not sure why but following works

-Open the VM manager, detach the virtual network adapters.

-Reattach the network adapters/

After this, RDP starts working.