explain please

[James]

> On 18 Dec 2021, at 12:10 am, vinod kesti <vinodkesti at yahoo.com> wrote:
> 
> Hi James,
> 
> Frame was expected to arrive @ 0:02:11.042561535but it arrived on  0:02:11.050640555. Frame arrived late so sink is dropping the frame.
> Have you enabled QOS. If you dont want QOS then set QOS property to false on every sink of the pipeline

> Can anybody explain:
> 
> 4-0> Dropping frame due to QoS. start:0:02:11.042561535 deadline:0:02:11.042561535 earliest_time:0:02:11.050640555


My issue is audio stuttering. Since I can find no QOS relating I tried rt priority:

dvr at dvrTW:~> sudo chrt -f 5 ./dvrRecord http://192.168.5.116 1 /dev/video2 0 0x03800006 0x03600006 nother.mp4
libva info: VA-API version 1.13.0
libva info: Trying to open /usr/lib64/dri/iHD_drv_video.so
libva info: Found init function __vaDriverInit_1_13
libva info: va_openDriver() returns 0
start:
pipeline: v4l2src device=/dev/video2 ! video/x-h264,width=1920,height=1080,framerate=30/1 ! tee name=vt at. ! queue ! avenc_aac ! aacparse ! hl.audio vt. ! h264parse ! queue ! avdec_h264 ! xvimagesink name=sink1 vt. ! h264parse ! queue ! avdec_h264 ! xvimagesink name=sink2 vt. ! h264parse ! hlssink2 max-files=15 name=hl playlist-root=http://192.168.5.116 playlist-location=/dev/shm/ch1.m3u8 location=/dev/shm/ch1_%05d.ts vt. ! h264parse ! queue max-size-buffers=0 max-size-bytes=0 max-size-time=1000000000 ! mux. pulsesrc device=0 ! queue ! audioconvert ! tee name=at at. ! audioresample ! audio/x-raw, rate=48000 ! queue ! avenc_aac ! queue ! mux. mp4mux name=mux ! filesink location=nother.mp4
launch:
these wins: 58720262 56623110
[error] Unable to set the pipeline to the playing state.

So I check without rt

dvr at dvrTW:~> ./dvrRecord http://192.168.5.116 1 /dev/video2 0 0x03800006 0x03600006 nother.mp4
start:
pipeline: v4l2src device=/dev/video2 ! video/x-h264,width=1920,height=1080,framerate=30/1 ! tee name=vt at. ! queue ! avenc_aac ! aacparse ! hl.audio vt. ! h264parse ! queue ! avdec_h264 ! xvimagesink name=sink1 vt. ! h264parse ! queue ! avdec_h264 ! xvimagesink name=sink2 vt. ! h264parse ! hlssink2 max-files=15 name=hl playlist-root=http://192.168.5.116 playlist-location=/dev/shm/ch1.m3u8 location=/dev/shm/ch1_%05d.ts vt. ! h264parse ! queue max-size-buffers=0 max-size-bytes=0 max-size-time=1000000000 ! mux. pulsesrc device=0 ! queue ! audioconvert ! tee name=at at. ! audioresample ! audio/x-raw, rate=48000 ! queue ! avenc_aac ! queue ! mux. mp4mux name=mux ! filesink location=nother.mp4
launch:
these wins: 58720262 56623110

And it works just fine. 
Why would launching a pipelne with rt prior stop it from running?

James