<div><div>Hi, here is VM startup log:</div><div> </div><div>starting up libvirt version: 7.0.0, package: 3 (Andrea Bolognani <eof@kiyuko.org> Fri, 26 Feb 2021 16:46:34 +0100), qemu version: 5.2.0Debian 1:5.2+dfsg-10, kernel: 5.9.0-2-amd64, hostname: 7b3153da-adae-42e5-b277-faa309ae1fe3</div><div>LC_ALL=C \</div><div>PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin \</div><div>HOME=/var/lib/libvirt/qemu/domain-9-bddf9b39-4015-42a2-8 \</div><div>XDG_DATA_HOME=/var/lib/libvirt/qemu/domain-9-bddf9b39-4015-42a2-8/.local/share \</div><div>XDG_CACHE_HOME=/var/lib/libvirt/qemu/domain-9-bddf9b39-4015-42a2-8/.cache \</div><div>XDG_CONFIG_HOME=/var/lib/libvirt/qemu/domain-9-bddf9b39-4015-42a2-8/.config \</div><div>QEMU_AUDIO_DRV=spice \</div><div>/usr/bin/qemu-system-x86_64 \</div><div>-name guest=bddf9b39-4015-42a2-8de1-358fbfe39dae,debug-threads=on \</div><div>-S \</div><div>-object secret,id=masterKey0,format=raw,file=/var/lib/libvirt/qemu/domain-9-bddf9b39-4015-42a2-8/master-key.aes \</div><div>-machine pc-q35-5.2,accel=kvm,usb=off,dump-guest-core=off \</div><div>-cpu Broadwell-IBRS,vme=on,ss=on,vmx=on,pdcm=on,f16c=on,rdrand=on,hypervisor=on,arat=on,tsc-adjust=on,umip=on,md-clear=on,stibp=on,arch-capabilities=on,ssbd=on,xsaveopt=on,pdpe1gb=on,abm=on,ibpb=on,amd-stibp=on,amd-ssbd=on,skip-l1dfl-vmentry=on,pschange-mc-no=on,hv-vendo</div><div>r-id=ecpveilcloud \</div><div>-m size=5242880k,slots=16,maxmem=65849344k \</div><div>-overcommit mem-lock=off \</div><div>-smp 4,sockets=1,dies=1,cores=4,threads=1 \</div><div>-object memory-backend-ram,id=ram-node0,size=5368709120 \</div><div>-numa node,nodeid=0,cpus=0-3,memdev=ram-node0 \</div><div>-uuid bddf9b39-4015-42a2-8de1-358fbfe39dae \</div><div>-no-user-config \</div><div>-nodefaults \</div><div>-chardev socket,id=charmonitor,fd=41,server,nowait \</div><div>-mon chardev=charmonitor,id=monitor,mode=control \</div><div>-rtc base=utc \</div><div>-no-shutdown \</div><div>-boot strict=on \</div><div>-device pcie-root-port,port=0x8,chassis=1,id=pci.1,bus=pcie.0,multifunction=on,addr=0x1 \</div><div>-device pcie-root-port,port=0x9,chassis=2,id=pci.2,bus=pcie.0,addr=0x1.0x1 \</div><div>-device pcie-root-port,port=0xa,chassis=3,id=pci.3,bus=pcie.0,addr=0x1.0x2 \</div><div>-device pcie-root-port,port=0xb,chassis=4,id=pci.4,bus=pcie.0,addr=0x1.0x3 \</div><div>-device pcie-root-port,port=0xc,chassis=5,id=pci.5,bus=pcie.0,addr=0x1.0x4 \</div><div>-device pcie-root-port,port=0xd,chassis=6,id=pci.6,bus=pcie.0,addr=0x1.0x5 \</div><div>-device pcie-root-port,port=0xe,chassis=7,id=pci.7,bus=pcie.0,addr=0x1.0x6 \</div><div>-device pcie-pci-bridge,id=pci.8,bus=pci.1,addr=0x0 \</div></div><div><div>-device nec-usb-xhci,id=usb,bus=pci.3,addr=0x0 \</div><div>-device virtio-serial-pci,id=virtio-serial0,bus=pci.4,addr=0x0 \</div><div>-blockdev '{"driver":"file","filename":"/storages/zfs/zfs_fc/c3dbf329-92ba-4436-8b46-5f2dee6148ca/vdisk.qcow2","node-name":"libvirt-2-storage","cache":{"direct":true,"no-flush":false},"auto-read-only":true,"discard":"unmap"}' \</div><div>-blockdev '{"node-name":"libvirt-2-format","read-only":false,"cache":{"direct":true,"no-flush":false},"driver":"qcow2","file":"libvirt-2-storage","backing":null}' \</div><div>-device virtio-blk-pci,bus=pci.5,addr=0x0,drive=libvirt-2-format,id=virtio-disk0,bootindex=1,write-cache=on,serial=c3dbf329-92ba-4436-8 \</div><div>-blockdev '{"driver":"file","filename":"/storages/local/default/_ISO/CentOS-8.4.2105-x86_64-boot.iso","node-name":"libvirt-1-storage","auto-read-only":true,"discard":"unmap"}' \</div><div>-blockdev '{"node-name":"libvirt-1-format","read-only":true,"driver":"raw","file":"libvirt-1-storage"}' \</div><div>-device ide-cd,bus=ide.0,drive=libvirt-1-format,id=sata0-0-0,bootindex=2 \</div><div>-netdev tap,fd=46,id=hostnet0,vhost=on,vhostfd=48 \</div><div>-device virtio-net-pci,host_mtu=1446,netdev=hostnet0,id=net0,mac=02:ff:f0:22:02:f3,bus=pci.2,addr=0x0 \</div><div>-chardev spicevmc,id=charchannel0,name=vdagent \</div><div>-device virtserialport,bus=virtio-serial0.0,nr=1,chardev=charchannel0,id=channel0,name=com.redhat.spice.0 \</div><div>-chardev spiceport,id=charchannel1,name=org.spice-space.webdav.0 \</div><div>-device virtserialport,bus=virtio-serial0.0,nr=2,chardev=charchannel1,id=channel1,name=org.spice-space.webdav.0 \</div><div>-chardev spiceport,id=charchannel2,name=org.spice-space.stream.0 \</div><div>-device virtserialport,bus=virtio-serial0.0,nr=3,chardev=charchannel2,id=channel2,name=org.spice-space.stream.0 \</div><div>-chardev socket,id=charchannel3,fd=49,server,nowait \</div><div>-device virtserialport,bus=virtio-serial0.0,nr=4,chardev=charchannel3,id=channel3,name=org.qemu.guest_agent.0 \</div><div>-chardev socket,id=charchannel4,fd=52,server,nowait \</div><div>-device virtserialport,bus=virtio-serial0.0,nr=5,chardev=charchannel4,id=channel4,name=org.mashtab.veil \</div><div>-spice port=50002,addr=0.0.0.0,agent-mouse=on,image-compression=auto_glz,jpeg-wan-compression=auto,zlib-glz-wan-compression=auto,playback-compression=on,streaming-video=filter,seamless-migration=on \</div><div>-vnc 0.0.0.0:44103,share=allow-exclusive,password \</div><div>-device intel-hda,id=sound0,bus=pci.8,addr=0x1 \</div><div>-device hda-micro,id=sound0-codec0,bus=sound0.0,cad=0 \</div><div>-device vfio-pci-nohotplug,id=hostdev0,sysfsdev=/sys/bus/mdev/devices/9fff359d-5610-495f-bcd2-ebf571a0fbba,display=on,bus=pci.6,addr=0x0,ramfb=on \</div><div>-device virtio-balloon-pci,id=balloon0,bus=pci.7,addr=0x0 \</div><div>-sandbox on,obsolete=deny,elevateprivileges=deny,spawn=deny,resourcecontrol=deny \</div><div>-msg timestamp=on</div><div> </div></div><div>23.08.2021, 20:39, "Uri Lublin" <uril@redhat.com>:</div><blockquote><div><div>Hi,</div><div> </div><div>What Victor said but also more below.</div><div> </div> <div><div>On Mon, Aug 23, 2021 at 6:34 PM Victor Toso <<a href="mailto:victortoso@redhat.com" rel="noopener noreferrer">victortoso@redhat.com</a>> wrote:</div><blockquote style="border-left-color:rgb( 204 , 204 , 204 );border-left-style:solid;border-left-width:1px;margin:0px 0px 0px 0.8ex;padding-left:1ex">Hi,<br /><br />On Mon, Aug 23, 2021 at 05:14:00PM +0300, <a href="mailto:ole-krutov@yandex.ru" rel="noopener noreferrer" target="_blank">ole-krutov@yandex.ru</a> wrote:<br />> - nvidia vGPU with proprietary driver is the only video<br />> adapter.<br /><br />This is a know issue. NVIDIA driver does not provide a guest<br />cursor. You can probably verify it with VNC too.</blockquote><blockquote style="border-left-color:rgb( 204 , 204 , 204 );border-left-style:solid;border-left-width:1px;margin:0px 0px 0px 0.8ex;padding-left:1ex"><br />The proper fix is to NVIDIA implement this feature, otherwise all<br />we have is workarounds.<br /><br />You can try running a spice-gtk based client like remote-viewer<br />with SPICE_DEBUG_CURSOR=1 as that might give you something<br />rendered in the client side.</blockquote><div> </div><div><div>Yeah, it's the same for VNC.</div><div>Recently a command line option was added to virt-viewer/remote-viewer for VNC.</div><div><a href="https://gitlab.com/virt-viewer/virt-viewer/-/merge_requests/78" rel="noopener noreferrer">https://gitlab.com/virt-viewer/virt-viewer/-/merge_requests/78</a></div></div><div> </div><blockquote style="border-left-color:rgb( 204 , 204 , 204 );border-left-style:solid;border-left-width:1px;margin:0px 0px 0px 0.8ex;padding-left:1ex"><br />You could also try to set "HWCursor" "off" in the xorg<br />configuration file.<br /><br />> - spice-vdagent v.0.20 and qemu-guest-agent are installed.<br /><br />You should try v0.21 as I recall people were doing work around<br />testing NVDIA and Wayland based systems, although I can't<br />pinpoint something that would fix the logs I see.<br /> </blockquote><div> </div><div>I think the problem is not with spice-vdagent, but that SPICE gets no</div><div>cursor data from NVIDIA.</div><div> </div><div>What qemu-kvm command line option do you use for connecting with the NVIDIA GPU ?</div><div> </div><div>Uri</div></div></div></blockquote>