I have moved from KVM on my server (SLES 11 SP3) to running XEN as the hypervisor and have migrated one of my VMs to running on XEN. If I am sitting at the server, I can use the Virtual Machine Manager to connect to the VM graphical console (i.e., see the VM desktop) with no problems. However, if I am at a remote workstation (SLED 11 SP3) and running Virtual Machine Manager, I can connect to the VM (I see the virtual hardware details screen), but the graphical console comes back with the error "viewer connection to hypervisor host got refused or disconnected". I did not have this issue with KVM... The connection between the server and my workstation in the Virtual Machine Manager is "xen+tcp".

Any ideas?