Skipped frames when displaying RTP / H.264 stream

[jean-philippe]

Attached a package with H.264 streams captured when going through the RTP
payloader and when not going through it.

There is a text file describing the content which I copy here for
convenience. Lost-Frames.7z
<http://gstreamer-devel.966125.n4.nabble.com/file/t379103/Lost-Frames.7z>  

Files cbr_rtp.h264 and cbr_nortp.h264 were captured on the i.MX8MMini using
the pipelines shown below.
Files cbr_rtp.txt and cbr_nortp.txt were generated using FFmpeg using the
command lines below.
Each contains 150 frames which is 5 full GOPs, enough to show the problem,
which occurs on frame 128.

Location of problem:
cbr-nortp.txt, Line 2705 is NALU #128 and is followed by Filler Data.
cbr-rtp.txt, Line 4169 is NALU #128 and is followed by Filler Data.

gst-launch-1.0 -v videotestsrc num-buffers=150 is-live=true
animation-mode=frames motion=sweep pattern=ball !
video/x-raw,width=640,height=480,pixelformat=YUY2,framerate=30/1 !
vpuenc_h264 gop-size=30 bitrate=5000 ! queue ! rtph264pay ! queue !
rtph264depay ! queue ! h264parse ! video/x-h264,stream-format=byte-stream !
filesink location=/usr/bin/recordings/cbr_rtp.h264

gst-launch-1.0 -v videotestsrc num-buffers=150 is-live=true
animation-mode=frames motion=sweep pattern=ball !
video/x-raw,width=640,height=480,pixelformat=YUY2,framerate=30/1 !
vpuenc_h264 gop-size=30 bitrate=5000 ! queue ! filesink
location=/usr/bin/recordings/cbr_nortp.h264

.\ffmpeg-4.2.2-win32-static\bin\ffmpeg.exe -i cbr_rtp.h264 -c copy -bsf:v
trace_headers -f null - 2> cbr-rtp.txt
.\ffmpeg-4.2.2-win32-static\bin\ffmpeg.exe -i cbr_nortp.h264 -c copy -bsf:v
trace_headers -f null - 2> cbr-nortp.txt




--
Sent from: http://gstreamer-devel.966125.n4.nabble.com/