v4l2h264dec Raspberry PI

[horai]

Dear all,

I would kindly ask you for a help with my issue. I have RPI3B+, X11,
compiled Gstreamer 1.16, KMS driver,no window manager in X11
I am playing test files this way :
gst-launch-1.0 -e filesrc location=/home/pi/jellyfish-15-mbps-hd-h264.mkv !
matroskademux ! h264parse ! v4l2h264dec capture-io-mode=4 ! kmssink
It works very much ok only in command line, the speed is amazing.

My problem is, since kmssink cannot be used in X11 (as far as I know), I am
enclosing following pipelines (both with hardware accelerated sinks) ,with
comments, which I would like to encapsulate into GTK window in order to have
video rendering in GTK window (GstOverlay or Clutter stage):
1) gst-launch-1.0 -e filesrc location=/home/pi/jellyfish-3-mbps-hd-h264.mkv
! matroskademux ! h264parse ! v4l2h264dec capture-io-mode=4 !
clutterautovideosink
ad 1) This pipeline works but is very slow compared to kmssink (I understand
X11 could cause some overhead but could it really be so serious?)
Anyway, glimagesink is recommended, therefore in X11:
2) export GST_GL_API=opengl
gst-launch-1.0 -e filesrc location=/home/pi/jellyfish-3-mbps-hd-h264.mkv !
matroskademux ! h264parse ! v4l2h264dec capture-io-mode=4 ! glupload !
glimagesink
ad). This pipeline shows one image of the desired video hands printing this
output:
Setting pipeline to PAUSED ...
0:00:03.869568671 817 0x18a6460 WARN basesrc
gstbasesrc.c:3600:gst_base_src_start_complete:<filesrc0> pad not activated
yet
Pipeline is PREROLLING ...
Got context from element 'sink': gst.gl.GLDisplay=context,
gst.gl.GLDisplay=(GstGLDisplay)"\(GstGLDisplayX11\)\ gldisplayx11-0";
0:00:04.099781284 817 0x18816f0 WARN v4l2
gstv4l2object.c:4194:gst_v4l2_object_probe_caps:<v4l2h264dec0:src> Failed to
probe pixel aspect ratio with VIDIOC_CROPCAP: Invalid argument
0:00:04.144984350 817 0x18816f0 WARN v4l2videodec
gstv4l2videodec.c:810:gst_v4l2_video_dec_decide_allocation:<v4l2h264dec0>
Duration invalid, not setting latency
0:00:04.184819802 817 0x6e73cac0 WARN v4l2bufferpool
gstv4l2bufferpool.c:1263:gst_v4l2_buffer_pool_dqbuf:<v4l2h264dec0:pool:src>
Driver should never set v4l2_buffer.field to ANY
0:00:04.270274157 817 0x6e73cac0 WARN dmabuf
gstdmabuf.c:93:gst_dmabuf_mem_unmap:<dmabufallocator2> Using DMABuf without
synchronization.
0:00:04.270424732 817 0x6e73cac0 WARN dmabuf
gstdmabuf.c:93:gst_dmabuf_mem_unmap:<dmabufallocator2> Using DMABuf without
synchronization.
0:00:04.270458014 817 0x6e73cac0 WARN dmabuf
gstdmabuf.c:93:gst_dmabuf_mem_unmap:<dmabufallocator2> Using DMABuf without
synchronization.
0:00:04.297981763 817 0x6e73cac0 WARN dmabuf
gstdmabuf.c:93:gst_dmabuf_mem_unmap:<dmabufallocator2> Using DMABuf without
synchronization.
0:00:04.298045150 817 0x6e73cac0 WARN dmabuf
gstdmabuf.c:93:gst_dmabuf_mem_unmap:<dmabufallocator2> Using DMABuf without
synchronization.
0:00:04.298073119 817 0x6e73cac0 WARN dmabuf
gstdmabuf.c:93:gst_dmabuf_mem_unmap:<dmabufallocator2> Using DMABuf without
synchronization.
0:00:05.932123123 817 0x6e73cac0 WARN dmabuf
gstdmabuf.c:93:gst_dmabuf_mem_unmap:<dmabufallocator2> Using DMABuf without
synchronization.
0:00:05.932190884 817 0x6e73cac0 WARN dmabuf
gstdmabuf.c:93:gst_dmabuf_mem_unmap:<dmabufallocator2> Using DMABuf without
synchronization.
0:00:05.932218853 817 0x6e73cac0 WARN dmabuf
gstdmabuf.c:93:gst_dmabuf_mem_unmap:<dmabufallocator2> Using DMABuf without
synchronization.
Pipeline is PREROLLED ...
Setting pipeline to PLAYING ...

Actually, my final goal is to run following pipeline which is a rendering of
a RTSP stream:
sudo gst-launch-1.0 rtspsrc location="rtsp://10.0.0.2:8555/test" latency=200
! rtph264depay ! h264parse ! v4l2h264dec capture-io-mode=4 ! videoconvert !
clutterautovideosink
Despite the fact I have to run it in superuser mode otherwise I face issues
with size of a buffer, this pipeline (not under cluttersink in X11 nor
kmssink without X11 )does not show any video image, just this text output:
Progress: (request) Sent PLAY request
0:00:01.178897447 1331 0x73e0e430 FIXME rtpjitterbuffer
gstrtpjitterbuffer.c:1551:gst_jitter_buffer_sink_parse_caps:<rtpjitterbuffer0>
Unsupported timestamp reference clock
0:00:01.179056041 1331 0x73e0e430 FIXME rtpjitterbuffer
gstrtpjitterbuffer.c:1559:gst_jitter_buffer_sink_parse_caps:<rtpjitterbuffer0>
Unsupported media clock
0:00:01.183729166 1331 0x703019b0 FIXME basesink
gstbasesink.c:3248:gst_base_sink_default_event:<cluttergstvideosink0>
stream-start event without group-id. Consider implementing group-id handling
in the upstream elements
0:00:01.247296510 1331 0x703019b0 WARN v4l2
gstv4l2object.c:4194:gst_v4l2_object_probe_caps:<v4l2h264dec0:src> Failed to
probe pixel aspect ratio with VIDIOC_CROPCAP: Invalid argument
Caught SIGSEGV
#0 0x76b75120 in poll () at ../sysdeps/unix/syscall-template.S:84
#1 0x76c89358 in ?? () from /lib/arm-linux-gnueabihf/libglib-2.0.so.0
0:00:12.853157860 1331 0x73e0e430 WARN rtpjitterbuffer
rtpjitterbuffer.c:570:calculate_skew: delta - skew: 0:00:11.140496109 too
big, reset skew
0:00:12.868475620 1331 0x73e0e430 WARN rtpjitterbuffer
rtpjitterbuffer.c:570:calculate_skew: delta - skew: 0:00:10.961291352 too
big, reset skew
Spinning. Please run 'gdb gst-launch-1.0 1331' to continue debugging, Ctrl-C
to quit, or Ctrl-\ to dump core.


Do you have any ideas or recommendation or any reasonable sink to use under
X11?

Thank you very much
Best regards,
Ivo



--
Sent from: http://gstreamer-devel.966125.n4.nabble.com/