<div dir="ltr"><div><div><div><div><div>Hello, </div>I am quite new to Gstreamer and it seems like an amazing tool to me. </div><div>I would like to create a pipeline that does the following: </div>- get a video stream from a live source (i.e., webcam) </div>- encode the live stream as is into a file </div>- at the same time, show the live stream in a user interface, however the user is able to seek to abitrary positions in the entire stream.</div><div>I know that I need a tee element for the two simultaneous tasks, but currently I am having trouble realizing the time-shift buffering part between the source and the videosink. I thought I could add a queue element before the sink to act as a (ring-)buffer to enable seeking. </div><div> </div><div>This is my experimental pipeline so far (live videotestsrc instead of a webcam): </div><div> gst-launch-1.0 videotestsrc do-timestamp=true is-live=true name=src ! video/x-raw, format=RGB, width=640, height=480, framerate=20/1 ! videoconvert ! timeoverlay ! queue max-size-buffers=0 max-size-bytes=0 max-size-time=0 name=q ! autovideosink </div>While this pipeline is running, I can send seek_simple signals to the queue, which results in the frame of the requested timestamp being shown (verified by the timeoverlay). But then the output pauses and will not resume playing (pipeline state remains PLAYING). Weirdly, when I query the current-level-* properties of the queue, it seems to be empty. In that case I don't understand where the seeked frame comes from. Does the pipeline itself also buffer data? At one point during my experiments, I saw the queue actually filling up quickly (I don't recall the parameters I was using then), using some GB or memory after only a few seconds. I found the <a href="https://gstreamer.freedesktop.org/documentation/application-development/advanced/buffering.html#timeshift-buffering">time-shift buffering</a> scenario in the documentation which I think describes best what I am trying to do, but it's only a short paragraph and there is no dedicated "file-ringbuffer" element, so I tried my luck with the queue. Is it possible to achieve my goal using Gstreamer? If so, which elements should I look at? And is there a way to get the total duration of a live pipeline? All query_duration calls return -1. Lastly, is there a way to buffer minutes worth of live video (e.g. 720p) in memory?<div><div> </div><div>I'm curious to hear your thoughts! Many thanks in advance,</div><div>Fritjof</div><div> </div><div>-- </div><div> </div><div>This is my experiment code in Python: </div><div><pre style="color:rgb(0,0,0);background:rgb(255,255,255) none repeat scroll 0% 0%">GObject.threads_init() Gst.init(None) pipeline_string = "videotestsrc do-timestamp=true is-live=true horizontal-speed=1 name=src " \ "! video/x-raw, format=RGB, width=640, height=480, framerate=20/1 " \ "! videoconvert " \ "! timeoverlay shaded-background=true " \ "! queue max-size-buffers=0 max-size-bytes=0 max-size-time=0 name=q " \ "! autovideosink" pipeline = Gst.parse_launch(pipeline_string) source = pipeline.get_by_name("src") queue = pipeline.get_by_name("q") print(pipeline.set_state(Gst.State.PLAYING)) time.sleep(5) print("Current source position:", source.query_position(Gst.Format.TIME)) print("Current queue position:", queue.query_position(Gst.Format.TIME)) print("Current pipeline position:", pipeline.query_position(Gst.Format.TIME)) seek = pipeline.query_position(Gst.Format.TIME)[1] - 3 * Gst.SECOND print("seek to -3 sec:", seek) if queue.seek_simple(Gst.Format.TIME, Gst.SeekFlags.FLUSH | Gst.SeekFlags.KEY_UNIT, seek): print("Seek OK") print("Current source position:", source.query_position(Gst.Format.TIME)) print("Current queue position:", queue.query_position(Gst.Format.TIME)) print("Current pipeline position:", pipeline.query_position(Gst.Format.TIME)) print("Queue buffer level:", queue.get_property("current-level-buffers"), "- bytes:", humanize.naturalsize(queue.get_property("current-level-bytes"), binary=True), "- time:", queue.get_property("current-level-time") / Gst.SECOND) time.sleep(2) seek = source.query_position(Gst.Format.TIME)[1] print("Current source position:", source.query_position(Gst.Format.TIME)) print("jump to front", seek) queue.seek_simple(Gst.Format.TIME, Gst.SeekFlags.FLUSH | Gst.SeekFlags.KEY_UNIT, seek)</pre></div><div> </div>These are the print outputs:</div><div> </div><div>Current source position: (True, cur=5026269432) Current queue position: (True, cur=5026269432) Current pipeline position: (True, cur=4950176384) seek to -3 sec: 1950209076 Seek OK Current source position: (True, cur=1950209076) Current queue position: (True, cur=1950209076) Current pipeline position: (False, cur=0) Queue buffer level: 0 - bytes: 0 Bytes - time: 0.0 Current source position: (True, cur=2126269432) jump to front 2126269432 </div><div><div> </div></div></div>