<html xmlns:o="urn:schemas-microsoft-com:office:office" xmlns:w="urn:schemas-microsoft-com:office:word" xmlns:m="http://schemas.microsoft.com/office/2004/12/omml" xmlns="http://www.w3.org/TR/REC-html40"><head><meta http-equiv=Content-Type content="text/html; charset=utf-8"><meta name=Generator content="Microsoft Word 15 (filtered medium)"><style></style></head><body lang=DE link=blue vlink=purple><div class=WordSection1>Thnx I understand now the dmabuff problem with the v4l2loopback driver, but why is vaapi decode slower than sw decoder with memcopy?<o:p></o:p><o:p> </o:p>gst-launch-1.0 filesrc location=/mnt/DATA/tearing.mp4 ! qtdemux ! vaapih264dec ! queue ! fpsdisplaysink video-sink="xvimagesink" sync=false text-overlay=true<o:p></o:p>is playing with 9fps<o:p></o:p><o:p> </o:p>gst-launch-1.0 filesrc location=/mnt/DATA/tearing.mp4 ! qtdemux ! avdec_h264 ! queue ! fpsdisplaysink video-sink="xvimagesink" sync=false text-overlay=true<o:p></o:p>is playing with 45fps<o:p></o:p><o:p> </o:p><o:p> </o:p>Von: Nicolas Dufresne <nicolas@ndufresne.ca> Gesendet: Montag, 7. November 2022 02:56 An: Christian Hattenberger <christian.hattenberger@gmail.com> Cc: Discussion of the development of and with GStreamer <gstreamer-devel@lists.freedesktop.org> Betreff: Re: Why is connecting vaapi decoder to v4l2sink stuttering?<o:p></o:p><o:p> </o:p><div><div><o:p> </o:p><div><div>Le dim. 6 nov. 2022, 10 h 22, Christian Hattenberger <<a href="mailto:christian.hattenberger@gmail.com">christian.hattenberger@gmail.com</a>> a écrit :<o:p></o:p></div><blockquote style='border:none;border-left:solid #CCCCCC 1.0pt;padding:0cm 0cm 0cm 6.0pt;margin-left:4.8pt;margin-right:0cm'><div><div>If I use vaapipostproc in the chain with vaapisink it seems ok, so I think it does dmabuff, <o:p></o:p>but when I use io-mode=dmabuf-import with v4l2sink I get “Failed to allocated required memory” <o:p></o:p> <o:p></o:p>gst-launch-1.0 filesrc location=/mnt/DATA/tearing.mp4 ! decodebin ! v4l2sink io-mode=dmabuf-import device=/dev/video10 … 0:00:00.376954941 18843 0x7f4d44041460 ERROR v4l2allocator gstv4l2allocator.c:740:gst_v4l2_allocator_start:<v4l2sink0:pool1:sink:allocator> error requesting 2 buffers: Invalid argument<o:p></o:p>0:00:00.377023310 18843 0x7f4d44041460 ERROR v4l2bufferpool gstv4l2bufferpool.c:920:gst_v4l2_buffer_pool_start:<v4l2sink0:pool1:sink> we received 0 buffer from device '/dev/video10', we want at least 2<o:p></o:p>0:00:00.377052711 18843 0x7f4d44041460 ERROR bufferpool gstbufferpool.c:559:gst_buffer_pool_set_active:<v4l2sink0:pool1:sink> start failed<o:p></o:p>…<o:p></o:p> <o:p></o:p>v4l2-ctl -d /dev/video0 --all<o:p></o:p>Driver Info:<o:p></o:p> Driver name : v4l2 loopback<o:p></o:p> Card type : Dummy video device (0x0000)<o:p></o:p></div></div></blockquote></div></div><div>This out-of-tree driver is incomplete, it does not support dmabuf. You are out of luck here, unless you have time to improve it.<o:p></o:p></div><div><o:p> </o:p></div><div><o:p> </o:p></div><div><div><blockquote style='border:none;border-left:solid #CCCCCC 1.0pt;padding:0cm 0cm 0cm 6.0pt;margin-left:4.8pt;margin-right:0cm'><div><div> Bus info : platform:v4l2loopback-000<o:p></o:p> Driver version : 5.15.49<o:p></o:p> Capabilities : 0x85208003<o:p></o:p> Video Capture<o:p></o:p> Video Output<o:p></o:p> Video Memory-to-Memory<o:p></o:p> Read/Write<o:p></o:p> Streaming<o:p></o:p> Extended Pix Format<o:p></o:p> Device Capabilities<o:p></o:p> Device Caps : 0x05208003<o:p></o:p> Video Capture<o:p></o:p> Video Output<o:p></o:p> Video Memory-to-Memory<o:p></o:p> Read/Write<o:p></o:p> Streaming<o:p></o:p> Extended Pix Format<o:p></o:p>Priority: 2<o:p></o:p>Video input : 0 (loopback: ok)<o:p></o:p>Video output: 0 (loopback in)<o:p></o:p>Format Video Output:<o:p></o:p> Width/Height : 1920/1080<o:p></o:p> Pixel Format : 'NV12' (Y/CbCr 4:2:0)<o:p></o:p> Field : None<o:p></o:p> Bytes per Line : 1920<o:p></o:p> Size Image : 3110400<o:p></o:p> Colorspace : Rec. 709<o:p></o:p> Transfer Function : sRGB<o:p></o:p> YCbCr/HSV Encoding: ITU-R 601<o:p></o:p> Quantization : Limited Range<o:p></o:p> Flags :<o:p></o:p>Streaming Parameters Video Capture:<o:p></o:p> Frames per second: 30.000 (30/1)<o:p></o:p> Read buffers : 2<o:p></o:p>Streaming Parameters Video Output:<o:p></o:p> Frames per second: 30.000 (30/1)<o:p></o:p> Write buffers : 2<o:p></o:p> <o:p></o:p>User Controls<o:p></o:p> <o:p></o:p> keep_format 0x0098f900 (bool) : default=0 value=0<o:p></o:p> sustain_framerate 0x0098f901 (bool) : default=0 value=0<o:p></o:p> timeout 0x0098f902 (int) : min=0 max=100000 step=1 default=0 value=0 <o:p></o:p> timeout_image_io 0x0098f903 (bool) : default=0 value=0<o:p></o:p> <o:p></o:p> <o:p></o:p>Von: Nicolas Dufresne <<a href="mailto:nicolas@ndufresne.ca" target="_blank">nicolas@ndufresne.ca</a>> Gesendet: Sonntag, 6. November 2022 14:32 An: Discussion of the development of and with GStreamer <<a href="mailto:gstreamer-devel@lists.freedesktop.org" target="_blank">gstreamer-devel@lists.freedesktop.org</a>> Cc: Christian Hattenberger <<a href="mailto:christian.hattenberger@gmail.com" target="_blank">christian.hattenberger@gmail.com</a>> Betreff: Re: Why is connecting vaapi decoder to v4l2sink stuttering?<o:p></o:p> <o:p></o:p><div><div> <o:p></o:p><div><div>Le sam. 5 nov. 2022, 13 h 16, Christian Hattenberger via gstreamer-devel <<a href="mailto:gstreamer-devel@lists.freedesktop.org" target="_blank">gstreamer-devel@lists.freedesktop.org</a>> a écrit :<o:p></o:p></div><blockquote style='border:none;border-left:solid #CCCCCC 1.0pt;padding:0cm 0cm 0cm 6.0pt;margin-left:4.8pt;margin-top:5.0pt;margin-right:0cm;margin-bottom:5.0pt'><div>When I connect a vaapi decoder to v4l2sink the result is not as expected, same happens if I use autovideosink, I know for this I have to use vaapisink and it is working as expected, but is there a solution for v4l2sink? Can someone explain me the reason, is there a solution?<o:p></o:p> <o:p></o:p>gst-launch-1.0 filesrc location=/tmp/video.mp4 ! decodebin ! vaapipostproc ! video/x-raw,format=YUY2 ! v4l2sink device=/dev/video10 <o:p></o:p></div></blockquote></div></div><div> <o:p></o:p></div><div>Its experimental, and I am not sure if vaapipostproc does produce dmabuf in this case, but you can enable dmabuf-import on v4l2sink with property io-mode=dmabuf-import . By default, the frames are cpu copied from VA allocated memory into V4L2 allocated memory.<o:p></o:p></div><div> <o:p></o:p></div><div>Nicolas<o:p></o:p></div><div> <o:p></o:p></div></div></div></div></blockquote></div></div></div></div></body></html>