Ref Interpipe caps negociation.

[Michael Gruner]

Hi,

Yes, interpipes should allow you to renegotiate the caps if you set the “allow-renegotiation=true”. Let me test this on my side and get back to you. Meanwhile, as a workaround, can you try leaving the framerate out of the interpipesrc caps?

Do you have more that one interpipesrc listening to the interpipesink?

Michael


> On Jun 18, 2020, at 18:05, Frederic Turmel <fturmel at netflix.com> wrote:
> 
> Question for interpipe expert. Should interpipe be able to deal with incoming stream change?
> 
> If I really specify the entire caps it works but when I leave the caps more open on the receiving end It never picks up the right match and it just stop.
> 
> Example logs below:
> 
> 0:00:03.460903000  1910 0x5564ee97d450 INFO           interpipesink gstinterpipesink.c:492:gst_inter_pipe_sink_set_caps:<webrtc_video_src> Incoming Caps: video/x-raw, width=(int)1920, height=(int)1080, framerate=(fraction)1/1, format=(string)YUY2
> 0:00:03.460912000  1910 0x5564ee97d450 INFO           interpipesink gstinterpipesink.c:494:gst_inter_pipe_sink_set_caps:<webrtc_video_src> Negotiated Caps: video/x-raw, width=(int)1920, height=(int)1080, format=(string)YUY2, framerate=(fraction)1/1
> 0:00:03.460921000  1910 0x5564ee97d450 INFO           interpipesink gstinterpipesink.c:513:gst_inter_pipe_sink_set_caps:<webrtc_video_src> Listeners caps updated
> 0:00:03.461096000  1910 0x5564ee97d370 DEBUG            advvideosrc gstadvvideosrc.cpp:838:gst_adv_video_src_start:<advvideosrc> start
> 0:00:03.641902000  1910 0x5564ee97d370 DEBUG            advvideosrc gstadvvideosrc.cpp:858:gst_adv_video_src_start:<advvideosrc> Capture is already started. No need to start
> 0:00:03.641918000  1910 0x5564ee97d370 INFO             advvideosrc gstadvvideosrc.cpp:860:gst_adv_video_src_start: Successfully started capture
> 0:00:03.641942000  1910 0x5564ee97d370 INFO             advvideosrc gstadvvideosrc.cpp:889:gst_adv_video_src_start: Updating Caps to: video/x-raw, width=(int)1920, height=(int)1080, framerate=(fraction)60000/1001, format=(string)YUY2
> 0:00:03.642030000  1910 0x5564ee97d370 INFO             advvideosrc gstadvvideosrc.cpp:898:gst_adv_video_src_start: gst_adv_video_src_start Exit!
> 0:00:03.645274000  1910 0x5564ee97d450 INFO           interpipesink gstinterpipesink.c:390:gst_inter_pipe_sink_intersect_listener_caps:<webrtc_video_src> Listener intervideosrc caps: video/x-raw, width=(int)1920, height=(int)1080, format=(string)YUY2, framerate=(fraction)[ 0/1, 2147483647/1 ]
> 0:00:03.645299000  1910 0x5564ee97d450 INFO           interpipesink gstinterpipesink.c:444:gst_inter_pipe_sink_get_caps:<webrtc_video_src> Caps negotiated: EMPTY
> 0:00:03.645306000  1910 0x5564ee97d450 ERROR          interpipesink gstinterpipesink.c:448:gst_inter_pipe_sink_get_caps:<webrtc_video_src> Failed to obtain an intersection between upstream elements and listeners
> 0:00:03.645314000  1910 0x5564ee97d450 INFO           interpipesink gstinterpipesink.c:856:gst_inter_pipe_sink_remove_listener:<webrtc_video_src> Removing listener intervideosrc
> 0:00:03.647752000  1910 0x5564ee97d450 INFO           interpipesink gstinterpipesink.c:420:gst_inter_pipe_sink_get_caps:<webrtc_video_src> No listeners yet, accepting any caps
> 0:00:03.648435000  1910 0x5564ee97d450 INFO           interpipesink gstinterpipesink.c:420:gst_inter_pipe_sink_get_caps:<webrtc_video_src> No listeners yet, accepting any caps
> 0:00:03.649131000  1910 0x5564ee97d450 INFO           interpipesink gstinterpipesink.c:420:gst_inter_pipe_sink_get_caps:<webrtc_video_src> No listeners yet, accepting any caps
> 0:00:03.649153000  1910 0x5564ee97d450 INFO           interpipesink gstinterpipesink.c:420:gst_inter_pipe_sink_get_caps:<webrtc_video_src> No listeners yet, accepting any caps
> 0:00:03.649167000  1910 0x5564ee97d450 INFO           interpipesink gstinterpipesink.c:492:gst_inter_pipe_sink_set_caps:<webrtc_video_src> Incoming Caps: video/x-raw, width=(int)1920, height=(int)1080, framerate=(fraction)60000/1001, format=(string)YUY2
> 0:00:03.649173000  1910 0x5564ee97d450 INFO           interpipesink gstinterpipesink.c:494:gst_inter_pipe_sink_set_caps:<webrtc_video_src> Negotiated Caps: (NULL)
> 
> The receiving side has this pipeline for a webrtc application. toggling allow-renegotiation does not really help. 
> interpipesrc name=intervideosrc stream-sync=1 listen-to=webrtc_video_src allow-renegotiation=1 format=3 ! video/x-raw,width=1920,height=1080,format=YUY2 ! queue leaky=1 ! videorate max-rate=30 average-period=2 ! videoscale ! video/x-raw,width=1280,height=720 ! queue ! videoconvert ! video/x-raw,format=I420 ! queue ! x264enc bitrate=1200 speed-preset=veryfast tune=zerolatency key-int-max=60 ! rtph264pay pt=96 ssrc=2 ! application/x-rtp,media=video,encoding-name=H264,payload=96
> 
> With the issue above it will work if specify I fully the receiving end like below:
> interpipesrc name=intervideosrc stream-sync=1 listen-to=webrtc_video_src allow-renegotiation=1 format=3 ! video/x-raw,width=1920,height=1080,format=YUY2,framerate=60000/1001 !
> 
> Is this the expected behavior? My source framerate can change so interpipe may not work if everything has to be defined in a static way.
> 
> Thanks
> FredT
> 

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <https://lists.freedesktop.org/archives/gstreamer-devel/attachments/20200618/2def820b/attachment-0001.htm>