<html xmlns:v="urn:schemas-microsoft-com:vml" xmlns:o="urn:schemas-microsoft-com:office:office" xmlns:w="urn:schemas-microsoft-com:office:word" xmlns:m="http://schemas.microsoft.com/office/2004/12/omml" xmlns="http://www.w3.org/TR/REC-html40"> <head> <meta http-equiv="Content-Type" content="text/html; charset=us-ascii"> <meta name="Generator" content="Microsoft Word 15 (filtered medium)"> <style></style> </head> <body bgcolor="white" lang="DE" link="#0563C1" vlink="#954F72"> <div class="WordSection1"> It turned out, that adding a deinterlace element in front of the mixer solved the issue.<o:p></o:p> I don’t know if that is a bug, because elements that are added before the pipline switches to PLAY are handled without a deinterlace element. Only if I add a stream some time later (while pipeline is running) I need this element.<o:p></o:p> Should I report this as a bug?<o:p></o:p> <o:p> </o:p> There is another thing I don’t know how to handle. If I add a new stream, the whole mixer is waiting till the new stream has the same time than the old ones. I “solved” this by setting an offset to the new created pad with gst_pad_set_offset. As offset I use the running time of the first added element. That seems to work more or less..<o:p></o:p> <o:p> </o:p> Is there an option for the mixer that it just mixes the sources as they arrive and don’t try to keep them in sync?<o:p></o:p> Or is that the right way to do that?<o:p></o:p> <o:p> </o:p> <div> <div style="border:none;border-top:solid #E1E1E1 1.0pt;padding:3.0pt 0cm 0cm 0cm"> Von: gstreamer-devel <gstreamer-devel-bounces@lists.freedesktop.org> Im Auftrag von Weber, Holger Gesendet: Dienstag, 17. April 2018 11:49 An: Discussion of the development of and with GStreamer <gstreamer-devel@lists.freedesktop.org> Betreff: AW: Add sink pad to compositor while playing<o:p></o:p> </div> </div> <o:p> </o:p> Can you give me an hint what you mean with raw? As far as I know I have to change different things:<o:p></o:p> <![if !supportLists]>- <![endif]>Video format<o:p></o:p> <![if !supportLists]>- <![endif]>Pixel-aspect-ratio<o:p></o:p> <![if !supportLists]>- <![endif]>Framerate<o:p></o:p> Is there an element which can do all of that stuff or do I need multiple elements?<o:p></o:p> <o:p> </o:p> Also in the output I can only see that the pixel-aspect-ratio is different. Is it possible to “ignore” this cap?<o:p></o:p> <o:p> </o:p> <div> <div style="border:none;border-top:solid #E1E1E1 1.0pt;padding:3.0pt 0cm 0cm 0cm"> Von: gstreamer-devel <<a href="mailto:gstreamer-devel-bounces@lists.freedesktop.org">gstreamer-devel-bounces@lists.freedesktop.org</a>> Im Auftrag von Shishir Pokharel Gesendet: Dienstag, 17. April 2018 05:23 An: Discussion of the development of and with GStreamer <<a href="mailto:gstreamer-devel@lists.freedesktop.org">gstreamer-devel@lists.freedesktop.org</a>> Betreff: RE: Add sink pad to compositor while playing<o:p></o:p> </div> </div> <o:p> </o:p> I am not an expert of compositor element – but If I would have to try , I would have converted incoming videos to raw -> composite it to single video (picture in picture) and convert it to required format.<o:p></o:p> <o:p> </o:p> /Shishir<o:p></o:p> <o:p> </o:p> <div> <div style="border:none;border-top:solid #E1E1E1 1.0pt;padding:3.0pt 0cm 0cm 0cm"> From: gstreamer-devel <<a href="mailto:gstreamer-devel-bounces@lists.freedesktop.org">gstreamer-devel-bounces@lists.freedesktop.org</a>> On Behalf Of Weber, Holger Sent: Thursday, April 12, 2018 12:26 AM To: Discussion of the development of and with GStreamer <<a href="mailto:gstreamer-devel@lists.freedesktop.org">gstreamer-devel@lists.freedesktop.org</a>> Subject: AW: Add sink pad to compositor while playing<o:p></o:p> </div> </div> <o:p> </o:p> Hi,<o:p></o:p> <o:p> </o:p> I can’t fix that issue. I have no idea how to solve that. The only thing I found was something depending a “problem” with the pixel-aspect-ratio.<o:p></o:p> <a href="http://gstreamer-bugs.narkive.com/OilCXCh8/bug-754291-new-compositor-fails-with-reason-not-negotiated-when-changing-the-pixel-aspect-ratio">http://gstreamer-bugs.narkive.com/OilCXCh8/bug-754291-new-compositor-fails-with-reason-not-negotiated-when-changing-the-pixel-aspect-ratio</a><o:p></o:p> <o:p> </o:p> One solution seems to be to fix the ratio to 1/1 but I don’t know how to do that. Any ideas?<o:p></o:p> <o:p> </o:p> <div> <div style="border:none;border-top:solid #E1E1E1 1.0pt;padding:3.0pt 0cm 0cm 0cm"> Von: gstreamer-devel <<a href="mailto:gstreamer-devel-bounces@lists.freedesktop.org">gstreamer-devel-bounces@lists.freedesktop.org</a>> Im Auftrag von Weber, Holger Gesendet: Mittwoch, 11. April 2018 14:33 An: Discussion of the development of and with GStreamer <<a href="mailto:gstreamer-devel@lists.freedesktop.org">gstreamer-devel@lists.freedesktop.org</a>> Betreff: AW: Add sink pad to compositor while playing<o:p></o:p> </div> </div> <o:p> </o:p> Hi,<o:p></o:p> <o:p> </o:p> I did some more testing and the strem I added seems to start, but than there is a poroblem with pad negotiation.<o:p></o:p> After adding the new pipeline part and connecting it to the compositor I get the following errors.<o:p></o:p> <o:p> </o:p> 0:00:03.953236964 4232 da11480 ERROR videoaggregator gstvideoaggregator.c:882:gst_video_aggregator_pad_sink_setcaps:<mixer:sink_2> got input caps video/x-raw, format=(string)I420, width=(int)720, height=(int)576, interlace-mode=(string)mixed, pixel-aspect-ratio=(fraction)12/11, chroma-site=(string)mpeg2, colorimetry=(string)bt601, framerate=(fraction)25/1, but current caps are video/x-raw, format=(string)I420, width=(int)785, height=(int)576, framerate=(fraction)25/1, chroma-site=(string)mpeg2<o:p></o:p> 0:00:03.953341177 4232 da11480 ERROR videoaggregator gstvideoaggregator.c:882:gst_video_aggregator_pad_sink_setcaps:<mixer:sink_2> got input caps video/x-raw, format=(string)I420, width=(int)720, height=(int)576, interlace-mode=(string)mixed, pixel-aspect-ratio=(fraction)12/11, chroma-site=(string)mpeg2, colorimetry=(string)bt601, framerate=(fraction)25/1, but current caps are video/x-raw, format=(string)I420, width=(int)785, height=(int)576, framerate=(fraction)25/1, chroma-site=(string)mpeg2<o:p></o:p> 0:00:03.953698368 4232 da11480 ERROR videoaggregator gstvideoaggregator.c:882:gst_video_aggregator_pad_sink_setcaps:<mixer:sink_2> got input caps video/x-raw, format=(string)I420, width=(int)720, height=(int)576, interlace-mode=(string)mixed, pixel-aspect-ratio=(fraction)12/11, chroma-site=(string)mpeg2, colorimetry=(string)bt601, framerate=(fraction)25/1, but current caps are video/x-raw, format=(string)I420, width=(int)785, height=(int)576, framerate=(fraction)25/1, chroma-site=(string)mpeg2<o:p></o:p> 0:00:03.953821082 4232 da11480 ERROR videoaggregator gstvideoaggregator.c:882:gst_video_aggregator_pad_sink_setcaps:<mixer:sink_2> got input caps video/x-raw, format=(string)I420, width=(int)720, height=(int)576, interlace-mode=(string)mixed, pixel-aspect-ratio=(fraction)12/11, chroma-site=(string)mpeg2, colorimetry=(string)bt601, framerate=(fraction)25/1, but current caps are video/x-raw, format=(string)I420, width=(int)785, height=(int)576, framerate=(fraction)25/1, chroma-site=(string)mpeg2<o:p></o:p> 0:00:03.953939643 4232 da11480 ERROR videoaggregator gstvideoaggregator.c:882:gst_video_aggregator_pad_sink_setcaps:<mixer:sink_2> got input caps video/x-raw, format=(string)I420, width=(int)720, height=(int)576, interlace-mode=(string)mixed, pixel-aspect-ratio=(fraction)12/11, chroma-site=(string)mpeg2, colorimetry=(string)bt601, framerate=(fraction)25/1, but current caps are video/x-raw, format=(string)I420, width=(int)785, height=(int)576, framerate=(fraction)25/1, chroma-site=(string)mpeg2<o:p></o:p> 0:00:03.954044610 4232 da11480 ERROR videoaggregator gstvideoaggregator.c:882:gst_video_aggregator_pad_sink_setcaps:<mixer:sink_2> got input caps video/x-raw, format=(string)I420, width=(int)720, height=(int)576, interlace-mode=(string)mixed, pixel-aspect-ratio=(fraction)12/11, chroma-site=(string)mpeg2, colorimetry=(string)bt601, framerate=(fraction)25/1, but current caps are video/x-raw, format=(string)I420, width=(int)785, height=(int)576, framerate=(fraction)25/1, chroma-site=(string)mpeg2<o:p></o:p> Error: Internal data stream error.<o:p></o:p> Returned, stopping playback<o:p></o:p> 0:00:03.954949672 4232 da11480 ERROR videoaggregator gstvideoaggregator.c:882:gst_video_aggregator_pad_sink_setcaps:<mixer:sink_2> got input caps video/x-raw, format=(string)I420, width=(int)720, height=(int)576, interlace-mode=(string)mixed, pixel-aspect-ratio=(fraction)12/11, chroma-site=(string)mpeg2, colorimetry=(string)bt601, framerate=(fraction)25/1, but current caps are video/x-raw, format=(string)I420, width=(int)785, height=(int)576, framerate=(fraction)25/1, chroma-site=(string)mpeg2<o:p></o:p> <o:p> </o:p> The added stream has the same format than the already running streams. I didn’t set any caps or added videoconverter elements – so I’m not sure if that’s the issue.<o:p></o:p> <o:p> </o:p> Kind Regards,<o:p></o:p> <o:p> </o:p> <div> <div style="border:none;border-top:solid #E1E1E1 1.0pt;padding:3.0pt 0cm 0cm 0cm"> Von: gstreamer-devel <<a href="mailto:gstreamer-devel-bounces@lists.freedesktop.org">gstreamer-devel-bounces@lists.freedesktop.org</a>> Im Auftrag von Weber, Holger Gesendet: Mittwoch, 11. April 2018 09:15 An: Discussion of the development of and with GStreamer <<a href="mailto:gstreamer-devel@lists.freedesktop.org">gstreamer-devel@lists.freedesktop.org</a>> Betreff: AW: Add sink pad to compositor while playing<o:p></o:p> </div> </div> <o:p> </o:p> Hi,<o:p></o:p> <o:p> </o:p> with “don’t stop the pipeline” I mean, there is a running pipeline (Video playback) and from another thread I call gst_element_get_request_pad(compositor”,”sink_%u”).<o:p></o:p> After that I add a pad_probe for that pad. The cb gets called an I do the following things:<o:p></o:p> <![if !supportLists]>- <![endif]>Create elements for the stream I want to add (filesrc, dmuexers etc.)<o:p></o:p> <![if !supportLists]>- <![endif]>Add elements to the pipeline<o:p></o:p> <![if !supportLists]>- <![endif]>Link elements<o:p></o:p> <![if !supportLists]>- <![endif]>Add callback for a needed “pad-added”<o:p></o:p> <![if !supportLists]>- <![endif]>Return GST_PAD_PROBE_REMOVE<o:p></o:p> <o:p> </o:p> If I activate the debugging output I can see:<o:p></o:p> aggregator gstaggregator.c:667:gst_aggregator_wait_and_check:<mixer> Waiting for src on thread 0d9e70e<o:p></o:p> <o:p> </o:p> So I guess it’s the problem you described. I need to get the new elements in state play, but I don’t know how to do that.<o:p></o:p> <o:p> </o:p> Kind Regards,<o:p></o:p> <o:p> </o:p> <div> <div style="border:none;border-top:solid #E1E1E1 1.0pt;padding:3.0pt 0cm 0cm 0cm"> Von: gstreamer-devel <<a href="mailto:gstreamer-devel-bounces@lists.freedesktop.org">gstreamer-devel-bounces@lists.freedesktop.org</a>> Im Auftrag von Mathieu Duponchelle Gesendet: Dienstag, 10. April 2018 18:41 An: <a href="mailto:gstreamer-devel@lists.freedesktop.org">gstreamer-devel@lists.freedesktop.org</a> Betreff: Re: Add sink pad to compositor while playing<o:p></o:p> </div> </div> <o:p> </o:p> Hi, What do you mean exactly by "stop the pipeline"? I assume you mean the state doesn't actually change, but compositor simply stops producing buffers? If you are not using the compositor in "live" mode, ie none of the sources you plug in are live, then compositor will wait for all pads to have data before mixing the output buffer, this might be the problem you are observing, either your new source does not push any buffers, or the buffers it does push do not have the expected timestamps and are simply getting dropped, in which case you might want to set an offset on the pad. Using GST_DEBUG=*aggregator*:6 should give you more information regarding this issue.<o:p></o:p> <div> On 04/10/2018 06:23 PM, Weber, Holger wrote:<o:p></o:p> </div> <blockquote style="margin-top:5.0pt;margin-bottom:5.0pt"> Hi,<o:p></o:p> I want to mix multiple video streams into one picture.<o:p></o:p> Therefore I use the compositor element. I can mix two videos and it seems to work fine (written in C).<o:p></o:p> <o:p></o:p> One requirement is, to mix only one to up to four (quad view) videos. Just for a quick test I only added one video source, started the pipeline and later, while the video was running, I called gst_element_get_request_pad(pData->m_pElMixer, "sink_%u"); which leads to stop the pipeline. <o:p></o:p> Can that be done this way or do I need to add all four sink pads with fake sources to the compositor before starting and replacing them later?<o:p></o:p> <o:p></o:p> Kind Regards<o:p></o:p> <o:p> </o:p> <pre>_______________________________________________<o:p></o:p></pre> <pre>gstreamer-devel mailing list<o:p></o:p></pre> <pre><a href="mailto:gstreamer-devel@lists.freedesktop.org">gstreamer-devel@lists.freedesktop.org</a><o:p></o:p></pre> <pre><a href="https://lists.freedesktop.org/mailman/listinfo/gstreamer-devel">https://lists.freedesktop.org/mailman/listinfo/gstreamer-devel</a><o:p></o:p></pre> </blockquote> <o:p> </o:p> </div> </body> </html>