Pixelation on RTSP stream

[Nicolas Dufresne]

Le mardi 29 mars 2022 à 14:55 +0800, Hogan Tan via gstreamer-devel a écrit :
> When running gst-play-1.0 command I get the following output. The pixelation
> occurs when there are movements.

Movement would mean higher bitrate. It possible the udpsrc buffer-size by
default is too small and cause packet lost. Would be nice to test and increase
that, though I'm not sure there is a way through gst-play.

> However, VLC and FFMPEG are able to play the RTSP stream without trouble.
> Is this an issue with gstreamer pipeline or the RTSP stream?
> I am currently on a Windows machine running gst-play.
> image.png
> 
> Some debug logs when running `gst-play-1.0` with debug log level 3:
> 0:00:05.868642000 12448 000001B1409B3BC0 WARN              video-info video-
> info.c:200:validate_colorimetry: Need to specify a color matrix when using YUV
> format (I420)
> 0:00:05.875494000 12448 000001B1409B3BC0 WARN              video-info video-
> info.c:515:gst_video_info_from_caps: invalid colorimetry, using default
> 0:00:05.882300000 12448 000001B1409B3BC0 WARN              video-info video-
> info.c:200:validate_colorimetry: Need to specify a color matrix when using YUV
> format (I420)
> 0:00:05.888922000 12448 000001B1409B3BC0 WARN              video-info video-
> info.c:515:gst_video_info_from_caps: invalid colorimetry, using default
> 0:00:05.894567000 12448 000001B1409B3BC0 WARN              video-info video-
> info.c:200:validate_colorimetry: Need to specify a color matrix when using YUV
> format (I420)
> 0:00:05.902188000 12448 000001B1409B3BC0 WARN              video-info video-
> info.c:515:gst_video_info_from_caps: invalid colorimetry, using default
> 0:00:05.910150000 12448 000001B1409B32C0 WARN              video-info video-
> info.c:200:validate_colorimetry: Need to specify a color matrix when using YUV
> format (I420)
> 0:00:05.917668000 12448 000001B1409B32C0 WARN              video-info video-
> info.c:515:gst_video_info_from_caps: invalid colorimetry, using default
> 0:00:05.922917000 12448 000001B1409B32C0 WARN              video-info video-
> info.c:200:validate_colorimetry: Need to specify a color matrix when using YUV
> format (I420)
> 0:00:05.930363000 12448 000001B1409B32C0 WARN              video-info video-
> info.c:515:gst_video_info_from_caps: invalid colorimetry, using default
> 0:00:05.937393000 12448 000001B1409B32C0 WARN              video-info video-
> info.c:200:validate_colorimetry: Need to specify a color matrix when using YUV
> format (I420)
> 0:00:05.944409000 12448 000001B1409B32C0 WARN              video-info video-
> info.c:515:gst_video_info_from_caps: invalid colorimetry, using default
> 0:00:05.950392000 12448 000001B1409B32C0 WARN              video-info video-
> info.c:200:validate_colorimetry: Need to specify a color matrix when using YUV
> format (I420)
> 0:00:05.956925000 12448 000001B1409B32C0 WARN              video-info video-
> info.c:515:gst_video_info_from_caps: invalid colorimetry, using default
> 0:00:05.963071000 12448 000001B1409B32C0 WARN              video-info video-
> info.c:200:validate_colorimetry: Need to specify a color matrix when using YUV
> format (I420)
> 0:00:05.969569000 12448 000001B1409B32C0 WARN              video-info video-
> info.c:515:gst_video_info_from_caps: invalid colorimetry, using default
> 0:00:05.974387000 12448 000001B1409B32C0 WARN              video-info video-
> info.c:200:validate_colorimetry: Need to specify a color matrix when using YUV
> format (I420)
> 0:00:05.982608000 12448 000001B1409B32C0 WARN              video-info video-
> info.c:515:gst_video_info_from_caps: invalid colorimetry, using default
> 0:00:05.987964000 12448 000001B1409B32C0 WARN              video-info video-
> info.c:200:validate_colorimetry: Need to specify a color matrix when using YUV
> format (I420)
> 0:00:05.995258000 12448 000001B1409B32C0 WARN              video-info video-
> info.c:515:gst_video_info_from_caps: invalid colorimetry, using default
> 0:00:06.001121000 12448 000001B1409B32C0 WARN              video-info video-
> info.c:200:validate_colorimetry: Need to specify a color matrix when using YUV
> format (I420)
> 0:00:06.007622000 12448 000001B1409B32C0 WARN              video-info video-
> info.c:515:gst_video_info_from_caps: invalid colorimetry, using default
> 0:00:06.013360000 12448 000001B1409B32C0 WARN              video-info video-
> info.c:200:validate_colorimetry: Need to specify a color matrix when using YUV
> format (I420)
> 0:00:06.019841000 12448 000001B1409B32C0 WARN              video-info video-
> info.c:515:gst_video_info_from_caps: invalid colorimetry, using default
> 0:00:06.026270000 12448 000001B1409B32C0 WARN              video-info video-
> info.c:200:validate_colorimetry: Need to specify a color matrix when using YUV
> format (I420)
> 0:00:06.032003000 12448 000001B1409B32C0 WARN              video-info video-
> info.c:515:gst_video_info_from_caps: invalid colorimetry, using default
> 0:00:06.036669000 12448 000001B1409B3BC0 WARN              video-info video-
> info.c:200:validate_colorimetry: Need to specify a color matrix when using YUV
> format (I420)
> 0:00:06.044254000 12448 000001B1409B3BC0 WARN              video-info video-
> info.c:515:gst_video_info_from_caps: invalid colorimetry, using default
> 0:00:06.050019000 12448 000001B1409B3BC0 WARN              video-info video-
> info.c:200:validate_colorimetry: Need to specify a color matrix when using YUV
> format (I420)
> 0:00:06.058035000 12448 000001B1409B3BC0 WARN              video-info video-
> info.c:515:gst_video_info_from_caps: invalid colorimetry, using default
> Redistribute latency...
> 0:00:06.065338000 12448 000001B1409B3BC0 WARN            videodecoder
> gstvideodecoder.c:3674:gst_video_decoder_clip_and_push_buf:<avdec_h264-0>
> Dropping frame due to QoS. start:0:00:00.815728476 deadline:0:00:00.815728476
> earliest_time:0:00:02.851586332
> 0:00:06.076648000 12448 000001B1409B3BC0 WARN            videodecoder
> gstvideodecoder.c:3674:gst_video_decoder_clip_and_push_buf:<avdec_h264-0>
> Dropping frame due to QoS. start:0:00:00.815728476 deadline:0:00:00.815728476
> earliest_time:0:00:02.851586332
> 0:00:06.089410000 12448 000001B1409B3BC0 WARN            videodecoder
> gstvideodecoder.c:3674:gst_video_decoder_clip_and_push_buf:<avdec_h264-0>
> Dropping frame due to QoS. start:0:00:00.815728476 deadline:0:00:00.815728476
> earliest_time:0:00:02.851586332
> 0:00:06.098584000 12448 000001B1409B3BC0 WARN            videodecoder
> gstvideodecoder.c:3674:gst_video_decoder_clip_and_push_buf:<avdec_h264-0>
> Dropping frame due to QoS. start:0:00:00.815728476 deadline:0:00:00.815728476
> earliest_time:0:00:02.851586332
> 0:00:06.108688000 12448 000001B1409B3BC0 WARN            videodecoder
> gstvideodecoder.c:3674:gst_video_decoder_clip_and_push_buf:<avdec_h264-0>
> Dropping frame due to QoS. start:0:00:00.815728476 deadline:0:00:00.815728476
> earliest_time:0:00:02.851586332
> 0:00:06.119389000 12448 000001B1409B3BC0 WARN            videodecoder
> gstvideodecoder.c:3674:gst_video_decoder_clip_and_push_buf:<avdec_h264-0>
> Dropping frame due to QoS. start:0:00:00.815728476 deadline:0:00:00.815728476
> earliest_time:0:00:02.851586332
> 0:00:06.128777000 12448 000001B1409B3BC0 WARN            videodecoder
> gstvideodecoder.c:3674:gst_video_decoder_clip_and_push_buf:<avdec_h264-0>
> Dropping frame due to QoS. start:0:00:00.815728476 deadline:0:00:00.815728476
> earliest_time:0:00:02.851586332
> 0:00:06.139330000 12448 000001B1409B3BC0 WARN            videodecoder
> gstvideodecoder.c:3674:gst_video_decoder_clip_and_push_buf:<avdec_h264-0>
> Dropping frame due to QoS. start:0:00:00.815728476 deadline:0:00:00.815728476
> earliest_time:0:00:02.851586332
> 0:00:06.148774000 12448 000001B1409B3BC0 WARN            videodecoder
> gstvideodecoder.c:3674:gst_video_decoder_clip_and_push_buf:<avdec_h264-0>
> Dropping frame due to QoS. start:0:00:00.815728476 deadline:0:00:00.815728476
> earliest_time:0:00:02.851586332
> 0:00:06.158332000 12448 000001B1409B3BC0 WARN            videodecoder
> gstvideodecoder.c:3674:gst_video_decoder_clip_and_push_buf:<avdec_h264-0>
> Dropping frame due to QoS. start:0:00:00.860587214 deadline:0:00:00.860587214
> earliest_time:0:00:02.851586332
> 0:00:06.171233000 12448 000001B1409B3BC0 WARN            videodecoder
> gstvideodecoder.c:3674:gst_video_decoder_clip_and_push_buf:<avdec_h264-0>
> Dropping frame due to QoS. start:0:00:00.860587214 deadline:0:00:00.860587214
> earliest_time:0:00:02.851586332
> 0:00:06.180657000 12448 000001B1409B3BC0 WARN            videodecoder
> gstvideodecoder.c:3674:gst_video_decoder_clip_and_push_buf:<avdec_h264-0>
> Dropping frame due to QoS. start:0:00:00.861461335 deadline:0:00:00.861461335
> earliest_time:0:00:02.851586332
> 0:00:06.191433000 12448 000001B1409B3BC0 WARN            videodecoder
> gstvideodecoder.c:3674:gst_video_decoder_clip_and_push_buf:<avdec_h264-0>
> Dropping frame due to QoS. start:0:00:00.861461335 deadline:0:00:00.861461335
> earliest_time:0:00:02.851586332
> 0:00:06.200474000 12448 000001B1409B3BC0 WARN            videodecoder
> gstvideodecoder.c:3674:gst_video_decoder_clip_and_push_buf:<avdec_h264-0>
> Dropping frame due to QoS. start:0:00:00.861461335 deadline:0:00:00.861461335
> earliest_time:0:00:02.851586332
> 0:00:06.212016000 12448 000001B1409B3BC0 WARN            videodecoder
> gstvideodecoder.c:3674:gst_video_decoder_clip_and_push_buf:<avdec_h264-0>
> Dropping frame due to QoS. start:0:00:00.861461335 deadline:0:00:00.861461335
> earliest_time:0:00:02.851586332
> 0:00:06.221901000 12448 000001B1409B3BC0 WARN            videodecoder
> gstvideodecoder.c:3674:gst_video_decoder_clip_and_push_buf:<avdec_h264-0>
> Dropping frame due to QoS. start:0:00:00.861461335 deadline:0:00:00.861461335
> earliest_time:0:00:02.851586332
> 0:00:06.230630000 12448 000001B1409B3BC0 WARN            videodecoder
> gstvideodecoder.c:3674:gst_video_decoder_clip_and_push_buf:<avdec_h264-0>
> Dropping frame due to QoS. start:0:00:00.861461335 deadline:0:00:00.861461335
> earliest_time:0:00:02.851586332
> 0:00:06.242498000 12448 000001B1409B3BC0 WARN            videodecoder
> gstvideodecoder.c:3674:gst_video_decoder_clip_and_push_buf:<avdec_h264-0>
> Dropping frame due to QoS. start:0:00:00.861461335 deadline:0:00:00.861461335
> earliest_time:0:00:02.851586332
> 0:00:06.253069000 12448 000001B1409B3BC0 WARN            videodecoder
> gstvideodecoder.c:3674:gst_video_decoder_clip_and_push_buf:<avdec_h264-0>
> Dropping frame due to QoS. start:0:00:00.901335156 deadline:0:00:00.901335156
> earliest_time:0:00:02.851586332
> 0:00:06.262464000 12448 000001B1409B3BC0 WARN            videodecoder
> gstvideodecoder.c:3674:gst_video_decoder_clip_and_push_buf:<avdec_h264-0>
> Dropping frame due to QoS. start:0:00:00.901335156 deadline:0:00:00.901335156
> earliest_time:0:00:02.851586332
> 0:00:06.273579000 12448 000001B1409B3BC0 WARN            videodecoder
> gstvideodecoder.c:3674:gst_video_decoder_clip_and_push_buf:<avdec_h264-0>
> Dropping frame due to QoS. start:0:00:00.901335156 deadline:0:00:00.901335156
> earliest_time:0:00:02.851586332
> 0:00:06.284322000 12448 000001B1409B3BC0 WARN            videodecoder
> gstvideodecoder.c:3674:gst_video_decoder_clip_and_push_buf:<avdec_h264-0>
> Dropping frame due to QoS. start:0:00:00.902224434 deadline:0:00:00.902224434
> earliest_time:0:00:02.851586332
> 0:00:06.292843000 12448 000001B1409B3BC0 WARN            videodecoder
> gstvideodecoder.c:3674:gst_video_decoder_clip_and_push_buf:<avdec_h264-0>
> Dropping frame due to QoS. start:0:00:00.902224434 deadline:0:00:00.902224434
> earliest_time:0:00:02.851586332
> 0:00:06.302301000 12448 000001B1409B3BC0 WARN            videodecoder
> gstvideodecoder.c:3674:gst_video_decoder_clip_and_push_buf:<avdec_h264-0>
> Dropping frame due to QoS. start:0:00:00.902224434 deadline:0:00:00.902224434
> earliest_time:0:00:02.851586332
> 0:00:06.312188000 12448 000001B1409B3BC0 WARN            videodecoder
> gstvideodecoder.c:3674:gst_video_decoder_clip_and_push_buf:<avdec_h264-0>
> Dropping frame due to QoS. start:0:00:00.902224434 deadline:0:00:00.902224434
> earliest_time:0:00:02.851586332
>