Combining 2 Video Streams Side by Side, Getting Choppy Results

[Michiel Konstapel]

On 16-02-2021 16:06, Nicolas Dufresne wrote:
> Le mardi 16 février 2021 à 02:50 -0500, Jim Ruxton a écrit :
>>
>> I am trying to combine 2 video streams. One from my laptop camera and 
>> one from an external webcam. I'm using the following pipeline and 
>> getting very choppy results. Neither my CPU or GPU seem to be working 
>> hard. Any ideas how to make this less choppy?
>>
>> *./gst-launch-1.0 v4l2src device=/dev/video**4**! videoscale ! videoconvert ! video/x-raw,format=YUY2, 
>> framerate=30/1, width=***640***, height=***480****! ****alpha********alpha=1***! videobox border-alpha=0 left=-640 ! videomixer name=Mix ! 
>> videoconvert ! autovideosink v4l2src device=/dev/video***2***! videoscale ! videoconvert ! video/x-raw, format=YUY2, 
>> framerate=30/1, width=***640***, height=***480****! ****alpha********alpha=1***! videobox border-alpha=0 right=-640 ! Mix.*
>
> First recommendation, move away from videomixer and use compositor 
> (videomixer is just a backward shm on top of compositor). As you have 
> a live pipeline, you should release the composition pressure by 
> configurating a latency on the compositor element.  The latency is in 
> nano-second, one of two frames of latency should be fine in general, 
> but the default is none, and would only worked with perfectly synched 
> sources which has accurate latency (v4l2src does not have accurate 
> latency, it simply claims 1 frame, alway).
>
> Second recommendation, consider adding a queue before you display 
> sink, this will improve the timeout logic inside the compositor, by 
> giving it a bit more freedome (with thread seperation).


Interesting! Does any of the above apply to *gl*videomixer as well? Are 
there any specific considerations for using that in a live pipeline? 
Should we also give that more latency? I see the glmixerbin superclass 
has a property for that, also defaulting to zero.

Kind regards,
Michiel

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <https://lists.freedesktop.org/archives/gstreamer-devel/attachments/20210302/9dea3833/attachment.htm>