<html> <head> <meta content="text/html; charset=ISO-8859-1" http-equiv="Content-Type"> </head> <body bgcolor="#FFFFFF" text="#000000"> Thanks a ton for the answer Matthew - although your answers opens up a few more questions, if you don't mind? <div class="moz-cite-prefix">On 08-08-2014 20:12, Matthew Waters wrote: </div> <blockquote cite="mid:53E4B08F.6030404@gmail.com" type="cite"> <pre wrap="">On 08/08/14 20:27, Lasse Laursen wrote: </pre> <blockquote type="cite"> <pre wrap="">Looking closer at available plug-ins, there's also something called GstGLUpload - which says that it uploads to GL Textures... Is this supposed to be used as a sink? Can it? </pre> </blockquote> <pre wrap=""> GstGLImageSink is the only sink currently provided by the opengl plugins. In 1.4, GstGLUpload is now a helper object (not an element) available within libgstgl for elements/applications to use. All opengl elements implicitly upload/download as required by the pipeline using it and its counterpart, GstGLDownload. </pre> </blockquote> Ah - so if I understand you correctly - it's completely possible (and even ok) to use an opengl element (such as the GstGLShader element) in a pipeline, and then have the final result arrive at an appsink, and not the gstglimagesink? You say all elements implicitly upload/download as required, so am I to understand that I could define a pipeline as follows "uridecodebin uri=<some file> ! GlShader ! appsink name=sink caps=<some caps>", and pass it to 'gst_parse_launch', and it'd figure out to insert the upload/download elements around the shader as required? <blockquote cite="mid:53E4B08F.6030404@gmail.com" type="cite"> <pre wrap=""> </pre> <blockquote type="cite"> <pre wrap="">I've also just learned that if I wanted to use the GstGLShader object, I am forced to make use of the GstGLImageSink? Would GstGLUpload also be acceptable here? </pre> </blockquote> <pre wrap=""> GstGLShader (the element), like all opengl elements will upload/download data as required by the surrounding elements. So you could have any other non-GL element after it and it should still work. </pre> <blockquote type="cite"> <pre wrap="">Regards, Lasse On 08-08-2014 19:09, Lasse Laursen wrote: </pre> <blockquote type="cite"> <pre wrap="">Hey y'all, I know this is kind of a beaten horse, but given the recent release of the 1.4 version of gStreamer I thought I'd pull out a stick and give it a few more whacks. Today I finally got around to working out how to properly use an appsink to copy gstreamers video output directly into an OpenGL texture. This works pretty well for now - but I'm constantly trying to work out, if there's a way of bypassing having to copy the data manually and just have gstreamer throw it into an OpenGL texture for me. </pre> </blockquote> </blockquote> <pre wrap=""> GstGLUpload is designed for this use case :)</pre> </blockquote> In your first reply, you mention that GlImageSink is currently the *only* sink provided by the opengl plugins, does this mean that I'm not allowed to have a pipeline end in a GstGLUpload, if all I want is the data to end in a texture I am managing? Looking at the documentation, for GstGLUpload, I'm in doubt if this is even possible? That is to say - that I specify the texture ID? You ask at the end why I want to set the texture ID - yes - essentially I'm using the Cinder framework, and I'd like to integrate GStreamers output in a simple GUI I'm building. To have it play well with Cinder, I'd need to use cinders own Texture object, which - as far as I can tell either requires me to give a fixed texture ID to gstreamer where I'd like the data to end up, or retrieve a texture ID from GStreamer and build the cinder texture object using it. ---- Just to reiterate - My current implementation scenario is, I use gstreamer to build a pipeline which currently includes 0 GL elements. It ends with an Appsink, from which I directly copy data into a Texture for every received sample. Seems to work ok for now. 2 Potential scenarios: 1 - A pipeline with 0 GL elements - except potentially the last one. Is GstGLUpload the way to go to have the data end up in a texture for me to use? Any example code? 2 - A pipeline with 1 or more GL elements, most likely the GstGLShader object. Is it possible to access the handled data that's stored in a texture on the GPU? Or is it much easier to let it get handed back to the CPU, just to upload it again? <blockquote cite="mid:53E4B08F.6030404@gmail.com" type="cite"> <pre wrap=""> </pre> <blockquote type="cite"> <blockquote type="cite"> <pre wrap="">The glimagesink looked promising, despite it's current 'bad' status and... 0.10 reference manual? I take it, this is the most up-to-date doc currently: <a class="moz-txt-link-freetext" href="http://gstreamer.freedesktop.org/data/doc/gstreamer/head/gst-plugins-gl-plugins/html/">http://gstreamer.freedesktop.org/data/doc/gstreamer/head/gst-plugins-gl-plugins/html/</a> (although it probably should eventually be merged into the 'bad' folder given it's status?) </pre> </blockquote> </blockquote> <pre wrap=""> There are docs in the -bad repository however they don't seem to have been updated on/uploaded to the server. </pre> <blockquote type="cite"> <blockquote type="cite"> <pre wrap="">Anyway - I had a closer look at the following example: <a class="moz-txt-link-freetext" href="http://cgit.freedesktop.org/gstreamer/gst-plugins-bad/tree/tests/examples/gl/generic/cube/main.cpp">http://cgit.freedesktop.org/gstreamer/gst-plugins-bad/tree/tests/examples/gl/generic/cube/main.cpp</a> It seems as though the client callback receives a texture reference... Is there anyway of specifying a texture to which one would like the glimagesink to write, instead of receiving a reference to one in every callback? If not - is it possible to somehow intercept the texture ID earlier - and are there any guarantees that it doesn't change at some point down the line? </pre> </blockquote> </blockquote> <pre wrap=""> The exact behaviour will depend on the specific elements involved. The two possibilities are 1. glimagesink uploads the incoming video frame -> texture id will change every draw call (performance gain is possible here although only to the second case) 2. glimagesink displays upstream's GL texture and is using a bufferpool -> texture id will loop between a certain amount of texture id's depending on the lifetime of the buffers. This is so that it is possible to upload the previous texture while the next texture is being displayed/used. The other catch is that the basesink class by default holds on to the last buffer rendered until the next buffer arrives. Any existence of the texture id outside of the callback is not really guaranteed. Is there any particular reason you would like to set the texture id for upload? </pre> <blockquote type="cite"> <blockquote type="cite"> <pre wrap="">Regards, Lasse -- Lasse Farnung Laursen Post.doc at the University of Tokyo <a class="moz-txt-link-abbreviated" href="http://www.lasselaursen.com">www.lasselaursen.com</a> <a class="moz-txt-link-rfc2396E" href="http://www.lasselaursen.com"><http://www.lasselaursen.com></a> FB: lasse.laursen <a class="moz-txt-link-rfc2396E" href="https://www.facebook.com/lasse.laursen"><https://www.facebook.com/lasse.laursen></a> Twitter: @PMP_J <a class="moz-txt-link-rfc2396E" href="https://twitter.com/PMP_J"><https://twitter.com/PMP_J></a> _______________________________________________ gstreamer-devel mailing list <a class="moz-txt-link-abbreviated" href="mailto:gstreamer-devel@lists.freedesktop.org">gstreamer-devel@lists.freedesktop.org</a> <a class="moz-txt-link-freetext" href="http://lists.freedesktop.org/mailman/listinfo/gstreamer-devel">http://lists.freedesktop.org/mailman/listinfo/gstreamer-devel</a> </pre> </blockquote> <pre wrap=""> </pre> </blockquote> <pre wrap=""> </pre> <fieldset class="mimeAttachmentHeader"></fieldset> <pre wrap="">_______________________________________________ gstreamer-devel mailing list <a class="moz-txt-link-abbreviated" href="mailto:gstreamer-devel@lists.freedesktop.org">gstreamer-devel@lists.freedesktop.org</a> <a class="moz-txt-link-freetext" href="http://lists.freedesktop.org/mailman/listinfo/gstreamer-devel">http://lists.freedesktop.org/mailman/listinfo/gstreamer-devel</a> </pre> </blockquote> <div class="moz-signature">-- Lasse Farnung Laursen Post.doc at the University of Tokyo <a href="http://www.lasselaursen.com">www.lasselaursen.com</a> FB: <a href="https://www.facebook.com/lasse.laursen">lasse.laursen </a> Twitter: <a href="https://twitter.com/PMP_J">@PMP_J</a></div> </body> </html>