<html xmlns:v="urn:schemas-microsoft-com:vml" xmlns:o="urn:schemas-microsoft-com:office:office" xmlns:w="urn:schemas-microsoft-com:office:word" xmlns:m="http://schemas.microsoft.com/office/2004/12/omml" xmlns="http://www.w3.org/TR/REC-html40"> <head> <meta http-equiv="Content-Type" content="text/html; charset=utf-8"> <meta name="Generator" content="Microsoft Word 14 (filtered medium)"> <style></style> </head> <body lang="EN-US" link="blue" vlink="purple"> <div class="WordSection1"> Thanks Luis, I was able to confirm correct frame stepping with xvideosink but only for a specific behavior when the pipe is never set to playing. I used a test video sequence that has frame number overlay on each frame so I could confirm the stepping result. <o:p></o:p> <o:p> </o:p> Stepping worked correctly with this scenario:<o:p></o:p> <![if !supportLists]>1. <![endif]>Start pipe in paused state<o:p></o:p> <![if !supportLists]>2. <![endif]>Send the step event<o:p></o:p> Result: For each step event, frames were played 1 by 1. Frame were incremented correctly on the video display.<o:p></o:p> <o:p> </o:p> Where it gets messy (this is the case that I was dealing with so far):<o:p></o:p> <![if !supportLists]>1. <![endif]>Start pipe in paused state<o:p></o:p> <![if !supportLists]>2. <![endif]>Change pipe state to playing for a small amount of frames to be played.<o:p></o:p> <![if !supportLists]>3. <![endif]>Paused the pipe again<o:p></o:p> Result: Now when stepping, for each step event with step value of 1 buffer, the display will skip 10 or more frames after the pipe has been set to playing and then paused. It looks like it is flushing the entire pipe/queue buffer??.<o:p></o:p> <o:p> </o:p> Here’s the code that show the behavior in the second scenario and the input file used: <a href="http://www.fredt.org/colorbars.mpg">http://www.fredt.org/colorbars.mpg</a><o:p></o:p> Is this a bug or the expected behavior? Is there a better way to do this?<o:p></o:p> <o:p> </o:p> from gi.repository import Gst, GObject, GLib<o:p></o:p> from time import sleep<o:p></o:p> <o:p> </o:p> Gst.init(None)<o:p></o:p> <o:p> </o:p> def on_pad_added(element, pad):<o:p></o:p> print "new pad!"<o:p></o:p> pad.link(convert.get_static_pad("sink")) <o:p></o:p> <o:p></o:p> pipe = Gst.Pipeline.new('pipe')<o:p></o:p> src = Gst.ElementFactory.make('filesrc')<o:p></o:p> decode = Gst.ElementFactory.make('decodebin')<o:p></o:p> convert = Gst.ElementFactory.make('videoconvert')<o:p></o:p> sink = Gst.ElementFactory.make('ximagesink')<o:p></o:p> <o:p> </o:p> src.set_property('location', ‘/home/test/colorbars.mpg')<o:p></o:p> <o:p> </o:p> pipe.add(src)<o:p></o:p> pipe.add(decode)<o:p></o:p> pipe.add(convert)<o:p></o:p> pipe.add(sink)<o:p></o:p> <o:p> </o:p> src.link(decode)<o:p></o:p> decode.link(convert)<o:p></o:p> convert.link(sink)<o:p></o:p> <o:p> </o:p> decode.connect('pad-added', on_pad_added)<o:p></o:p> <o:p> </o:p> #pipe.set_state(Gst.State.PLAYING)<o:p></o:p> pipe.set_state(Gst.State.PAUSED)<o:p></o:p> <o:p></o:p> loop = 1<o:p></o:p> while loop:<o:p></o:p> sleep(2)<o:p></o:p> for x in range(0, 5):<o:p></o:p> sink.send_event(Gst.Event.new_step(Gst.Format.BUFFERS, 1, 1, True, False))<o:p></o:p> print 'step'<o:p></o:p> sleep(1)<o:p></o:p> print "pause"<o:p></o:p> sleep(2)<o:p></o:p> print "playing"<o:p></o:p> pipe.set_state(Gst.State.PLAYING)<o:p></o:p> sleep(.5)<o:p></o:p> pipe.set_state(Gst.State.PAUSED)<o:p></o:p> sleep(.5)<o:p></o:p> for x in range(0, 5):<o:p></o:p> sink.send_event(Gst.Event.new_step(Gst.Format.BUFFERS, 1, 1, True, False))<o:p></o:p> print 'step'<o:p></o:p> sleep(1)<o:p></o:p> loop = loop + 1<o:p></o:p> print 'loop: ' + str(loop)<o:p></o:p> if loop > 5:<o:p></o:p> exit()<o:p></o:p> <o:p> </o:p> <o:p> </o:p> From: gstreamer-devel [mailto:gstreamer-devel-bounces@lists.freedesktop.org] On Behalf Of Luis de Bethencourt Sent: Saturday, May 30, 2015 4:58 AM To: Discussion of the development of and with GStreamer Subject: Re: FrameStepping gstreamer1.x python and general<o:p></o:p> <o:p> </o:p> <div> On 30 May 2015 at 05:19, Turmel, Frederic <<a href="mailto:Frederic.Turmel@arris.com" target="_blank">Frederic.Turmel@arris.com</a>> wrote:<o:p></o:p> <div> <div> <blockquote style="border:none;border-left:solid #CCCCCC 1.0pt;padding:0in 0in 0in 6.0pt;margin-left:4.8pt;margin-right:0in"> More on this, I was reading the design for the step event. (<a href="http://cgit.freedesktop.org/gstreamer/gstreamer/tree/docs/design/part-framestep.txt" target="_blank">http://cgit.freedesktop.org/gstreamer/gstreamer/tree/docs/design/part-framestep.txt</a>) If I understand the step event correctly, a step event will skip the amount of frame specified in the event but those buffers/frames will be drop/flush. Then upon putting the pipeline to playing, it will start at the new position. If I'm correct, this may not be what I'm looking for. What I'm trying to achieve is pause the pipeline and play frame by frame with a trigger, my app control when the next frame is sent to the sink. I did a simple test using filesink as the sink with uncompressed video. Nothing is written when I trigger the frame stepping event. I tried with and without the flush flag with same result. Any ideas/suggestions? Thanks -----Original Message----- From: gstreamer-devel [mailto:<a href="mailto:gstreamer-devel-bounces@lists.freedesktop.org">gstreamer-devel-bounces@lists.freedesktop.org</a>] On Behalf Of Tim Müller Sent: Friday, May 29, 2015 2:21 AM To: Discussion of the development of and with GStreamer Subject: Re: FrameStepping gstreamer1.x python and general<o:p></o:p> <div> <div> On Fri, 2015-05-29 at 10:58 +0200, Thibault Saunier wrote: > As for frame stepping support, I do not think it is properly > implemented everywhere, best is to try it out and see/fix it/open a > bug if needed. Frame stepping is handled entirely by the sink base class and shouldn't require support from upstream elements (unless you want to step back, then it requires reverse playback support), so hopefully it to mostly just works whatever the source/demuxer/decoder (minus bugs of course, as Thibault said). Cheers -Tim -- Tim Müller, Centricular Ltd - <a href="http://www.centricular.com" target="_blank"> http://www.centricular.com</a><o:p></o:p> </div> </div> </blockquote> <div> <o:p> </o:p> </div> <div> Here you have an example: ------------------------------------------------------------------------------------------------- #!/usr/bin/env python from gi.repository import Gst, GObject, GLib Gst.init(None) pipe = Gst.Pipeline.new('pipe') src = Gst.ElementFactory.make('videotestsrc') sink = Gst.ElementFactory.make("autovideosink") pipe.add(src) pipe.add(sink) src.link(sink) # pipe.set_state(Gst.State.PLAYING) pipe.set_state(Gst.State.PAUSED) def step(): print 'step' sink.send_event(Gst.Event.new_step(Gst.Format.BUFFERS, 1, 1, True, False)) GLib.timeout_add(1000, step) GLib.timeout_add(1000, step) ml = GObject.MainLoop() ml.run() -------------------------------------------------------------------------------------------------<o:p></o:p> </div> <div> Run it and you can see that each frame will be displayed in the sink while staying in PAUSED state.<o:p></o:p> </div> <div> Not sure if/how filesink handles step events. Use the above code to play with frame stepping.<o:p></o:p> </div> <div> Thanks,<o:p></o:p> </div> <div> Luis<o:p></o:p> </div> </div> </div> </div> </div> </body> </html>