<html xmlns:v="urn:schemas-microsoft-com:vml" xmlns:o="urn:schemas-microsoft-com:office:office" xmlns:w="urn:schemas-microsoft-com:office:word" xmlns:m="http://schemas.microsoft.com/office/2004/12/omml" xmlns="http://www.w3.org/TR/REC-html40"> <head> <meta http-equiv="Content-Type" content="text/html; charset=us-ascii"> <meta name="Generator" content="Microsoft Word 15 (filtered medium)"> <style></style> </head> <body bgcolor="white" lang="EN-US" link="#0563C1" vlink="#954F72"> <div class="WordSection1"> I am not an expert of compositor element – but If I would have to try , I would have converted incoming videos to raw -> composite it to single video (picture in picture) and convert it to required format.<o:p></o:p> <o:p> </o:p> /Shishir<o:p></o:p> <o:p> </o:p> <div> <div style="border:none;border-top:solid #E1E1E1 1.0pt;padding:3.0pt 0in 0in 0in"> From: gstreamer-devel <gstreamer-devel-bounces@lists.freedesktop.org> On Behalf Of Weber, Holger Sent: Thursday, April 12, 2018 12:26 AM To: Discussion of the development of and with GStreamer <gstreamer-devel@lists.freedesktop.org> Subject: AW: Add sink pad to compositor while playing<o:p></o:p> </div> </div> <o:p> </o:p> Hi,<o:p></o:p> <o:p> </o:p> I can’t fix that issue. I have no idea how to solve that. The only thing I found was something depending a “problem” with the pixel-aspect-ratio.<o:p></o:p> <a href="http://gstreamer-bugs.narkive.com/OilCXCh8/bug-754291-new-compositor-fails-with-reason-not-negotiated-when-changing-the-pixel-aspect-ratio">http://gstreamer-bugs.narkive.com/OilCXCh8/bug-754291-new-compositor-fails-with-reason-not-negotiated-when-changing-the-pixel-aspect-ratio</a><o:p></o:p> <o:p> </o:p> One solution seems to be to fix the ratio to 1/1 but I don’t know how to do that. Any ideas?<o:p></o:p> <o:p> </o:p> <div> <div style="border:none;border-top:solid #E1E1E1 1.0pt;padding:3.0pt 0in 0in 0in"> Von: gstreamer-devel <<a href="mailto:gstreamer-devel-bounces@lists.freedesktop.org">gstreamer-devel-bounces@lists.freedesktop.org</a>> Im Auftrag von Weber, Holger Gesendet: Mittwoch, 11. April 2018 14:33 An: Discussion of the development of and with GStreamer <<a href="mailto:gstreamer-devel@lists.freedesktop.org">gstreamer-devel@lists.freedesktop.org</a>> Betreff: AW: Add sink pad to compositor while playing<o:p></o:p> </div> </div> <o:p> </o:p> Hi,<o:p></o:p> <o:p> </o:p> I did some more testing and the strem I added seems to start, but than there is a poroblem with pad negotiation.<o:p></o:p> After adding the new pipeline part and connecting it to the compositor I get the following errors.<o:p></o:p> <o:p> </o:p> 0:00:03.953236964 4232 da11480 ERROR videoaggregator gstvideoaggregator.c:882:gst_video_aggregator_pad_sink_setcaps:<mixer:sink_2> got input caps video/x-raw, format=(string)I420, width=(int)720, height=(int)576, interlace-mode=(string)mixed, pixel-aspect-ratio=(fraction)12/11, chroma-site=(string)mpeg2, colorimetry=(string)bt601, framerate=(fraction)25/1, but current caps are video/x-raw, format=(string)I420, width=(int)785, height=(int)576, framerate=(fraction)25/1, chroma-site=(string)mpeg2<o:p></o:p> 0:00:03.953341177 4232 da11480 ERROR videoaggregator gstvideoaggregator.c:882:gst_video_aggregator_pad_sink_setcaps:<mixer:sink_2> got input caps video/x-raw, format=(string)I420, width=(int)720, height=(int)576, interlace-mode=(string)mixed, pixel-aspect-ratio=(fraction)12/11, chroma-site=(string)mpeg2, colorimetry=(string)bt601, framerate=(fraction)25/1, but current caps are video/x-raw, format=(string)I420, width=(int)785, height=(int)576, framerate=(fraction)25/1, chroma-site=(string)mpeg2<o:p></o:p> 0:00:03.953698368 4232 da11480 ERROR videoaggregator gstvideoaggregator.c:882:gst_video_aggregator_pad_sink_setcaps:<mixer:sink_2> got input caps video/x-raw, format=(string)I420, width=(int)720, height=(int)576, interlace-mode=(string)mixed, pixel-aspect-ratio=(fraction)12/11, chroma-site=(string)mpeg2, colorimetry=(string)bt601, framerate=(fraction)25/1, but current caps are video/x-raw, format=(string)I420, width=(int)785, height=(int)576, framerate=(fraction)25/1, chroma-site=(string)mpeg2<o:p></o:p> 0:00:03.953821082 4232 da11480 ERROR videoaggregator gstvideoaggregator.c:882:gst_video_aggregator_pad_sink_setcaps:<mixer:sink_2> got input caps video/x-raw, format=(string)I420, width=(int)720, height=(int)576, interlace-mode=(string)mixed, pixel-aspect-ratio=(fraction)12/11, chroma-site=(string)mpeg2, colorimetry=(string)bt601, framerate=(fraction)25/1, but current caps are video/x-raw, format=(string)I420, width=(int)785, height=(int)576, framerate=(fraction)25/1, chroma-site=(string)mpeg2<o:p></o:p> 0:00:03.953939643 4232 da11480 ERROR videoaggregator gstvideoaggregator.c:882:gst_video_aggregator_pad_sink_setcaps:<mixer:sink_2> got input caps video/x-raw, format=(string)I420, width=(int)720, height=(int)576, interlace-mode=(string)mixed, pixel-aspect-ratio=(fraction)12/11, chroma-site=(string)mpeg2, colorimetry=(string)bt601, framerate=(fraction)25/1, but current caps are video/x-raw, format=(string)I420, width=(int)785, height=(int)576, framerate=(fraction)25/1, chroma-site=(string)mpeg2<o:p></o:p> 0:00:03.954044610 4232 da11480 ERROR videoaggregator gstvideoaggregator.c:882:gst_video_aggregator_pad_sink_setcaps:<mixer:sink_2> got input caps video/x-raw, format=(string)I420, width=(int)720, height=(int)576, interlace-mode=(string)mixed, pixel-aspect-ratio=(fraction)12/11, chroma-site=(string)mpeg2, colorimetry=(string)bt601, framerate=(fraction)25/1, but current caps are video/x-raw, format=(string)I420, width=(int)785, height=(int)576, framerate=(fraction)25/1, chroma-site=(string)mpeg2<o:p></o:p> Error: Internal data stream error.<o:p></o:p> Returned, stopping playback<o:p></o:p> 0:00:03.954949672 4232 da11480 ERROR videoaggregator gstvideoaggregator.c:882:gst_video_aggregator_pad_sink_setcaps:<mixer:sink_2> got input caps video/x-raw, format=(string)I420, width=(int)720, height=(int)576, interlace-mode=(string)mixed, pixel-aspect-ratio=(fraction)12/11, chroma-site=(string)mpeg2, colorimetry=(string)bt601, framerate=(fraction)25/1, but current caps are video/x-raw, format=(string)I420, width=(int)785, height=(int)576, framerate=(fraction)25/1, chroma-site=(string)mpeg2<o:p></o:p> <o:p> </o:p> The added stream has the same format than the already running streams. I didn’t set any caps or added videoconverter elements – so I’m not sure if that’s the issue.<o:p></o:p> <o:p> </o:p> Kind Regards,<o:p></o:p> <o:p> </o:p> <div> <div style="border:none;border-top:solid #E1E1E1 1.0pt;padding:3.0pt 0in 0in 0in"> Von: gstreamer-devel <<a href="mailto:gstreamer-devel-bounces@lists.freedesktop.org">gstreamer-devel-bounces@lists.freedesktop.org</a>> Im Auftrag von Weber, Holger Gesendet: Mittwoch, 11. April 2018 09:15 An: Discussion of the development of and with GStreamer <<a href="mailto:gstreamer-devel@lists.freedesktop.org">gstreamer-devel@lists.freedesktop.org</a>> Betreff: AW: Add sink pad to compositor while playing<o:p></o:p> </div> </div> <o:p> </o:p> Hi,<o:p></o:p> <o:p> </o:p> with “don’t stop the pipeline” I mean, there is a running pipeline (Video playback) and from another thread I call gst_element_get_request_pad(compositor”,”sink_%u”).<o:p></o:p> After that I add a pad_probe for that pad. The cb gets called an I do the following things:<o:p></o:p> <ul style="margin-top:0in" type="disc"> <li class="MsoListParagraph" style="color:#1F497D;margin-left:0in;mso-list:l0 level1 lfo2"> Create elements for the stream I want to add (filesrc, dmuexers etc.)<o:p></o:p></li><li class="MsoListParagraph" style="color:#1F497D;margin-left:0in;mso-list:l0 level1 lfo2"> Add elements to the pipeline<o:p></o:p></li><li class="MsoListParagraph" style="color:#1F497D;margin-left:0in;mso-list:l0 level1 lfo2"> Link elements<o:p></o:p></li><li class="MsoListParagraph" style="color:#1F497D;margin-left:0in;mso-list:l0 level1 lfo2"> Add callback for a needed “pad-added”<o:p></o:p></li><li class="MsoListParagraph" style="color:#1F497D;margin-left:0in;mso-list:l0 level1 lfo2"> Return GST_PAD_PROBE_REMOVE<o:p></o:p></li></ul> <o:p> </o:p> If I activate the debugging output I can see:<o:p></o:p> aggregator gstaggregator.c:667:gst_aggregator_wait_and_check:<mixer> Waiting for src on thread 0d9e70e<o:p></o:p> <o:p> </o:p> So I guess it’s the problem you described. I need to get the new elements in state play, but I don’t know how to do that.<o:p></o:p> <o:p> </o:p> Kind Regards,<o:p></o:p> <o:p> </o:p> <div> <div style="border:none;border-top:solid #E1E1E1 1.0pt;padding:3.0pt 0in 0in 0in"> Von: gstreamer-devel <<a href="mailto:gstreamer-devel-bounces@lists.freedesktop.org">gstreamer-devel-bounces@lists.freedesktop.org</a>> Im Auftrag von Mathieu Duponchelle Gesendet: Dienstag, 10. April 2018 18:41 An: <a href="mailto:gstreamer-devel@lists.freedesktop.org">gstreamer-devel@lists.freedesktop.org</a> Betreff: Re: Add sink pad to compositor while playing<o:p></o:p> </div> </div> <o:p> </o:p> Hi, What do you mean exactly by "stop the pipeline"? I assume you mean the state doesn't actually change, but compositor simply stops producing buffers? If you are not using the compositor in "live" mode, ie none of the sources you plug in are live, then compositor will wait for all pads to have data before mixing the output buffer, this might be the problem you are observing, either your new source does not push any buffers, or the buffers it does push do not have the expected timestamps and are simply getting dropped, in which case you might want to set an offset on the pad. Using GST_DEBUG=*aggregator*:6 should give you more information regarding this issue.<o:p></o:p> <div> On 04/10/2018 06:23 PM, Weber, Holger wrote:<o:p></o:p> </div> <blockquote style="margin-top:5.0pt;margin-bottom:5.0pt"> Hi,<o:p></o:p> I want to mix multiple video streams into one picture.<o:p></o:p> Therefore I use the compositor element. I can mix two videos and it seems to work fine (written in C).<o:p></o:p> <o:p></o:p> One requirement is, to mix only one to up to four (quad view) videos. Just for a quick test I only added one video source, started the pipeline and later, while the video was running, I called gst_element_get_request_pad(pData->m_pElMixer, "sink_%u"); which leads to stop the pipeline. <o:p></o:p> Can that be done this way or do I need to add all four sink pads with fake sources to the compositor before starting and replacing them later?<o:p></o:p> <o:p></o:p> Kind Regards<o:p></o:p> <o:p> </o:p> <pre>_______________________________________________<o:p></o:p></pre> <pre>gstreamer-devel mailing list<o:p></o:p></pre> <pre><a href="mailto:gstreamer-devel@lists.freedesktop.org">gstreamer-devel@lists.freedesktop.org</a><o:p></o:p></pre> <pre><a href="https://lists.freedesktop.org/mailman/listinfo/gstreamer-devel">https://lists.freedesktop.org/mailman/listinfo/gstreamer-devel</a><o:p></o:p></pre> </blockquote> <o:p> </o:p> </div> </body> </html>