nleurisource multiple streams

[amindfv at mailbox.org]

One additional thing to note (that again doesn't fix the problem) is that if you add "async-handling=true" to the autovideosink, the audio plays alone. The inverse is not true, however: adding "async-handling=true" to the autoaudiosync doesn't cause video or audio to play, despite async-handling being a valid property for autoaudiosync.

Tom

On Tue, Oct 18, 2022 at 07:47:56PM -0700, amindfv at mailbox.org wrote:
> I unfortunately can't provide a fix for this, but I can provide confirmation that I see the same results (this time on Linux). I've tried a variety of obvious fixes but made no further progress. For me replacing "nleurisource" with "uridecodebin" also causes normal playback.
> 
> Tom
> 
> On Tue, Oct 18, 2022 at 11:04:32AM -0300, Rodrigo Santos via gstreamer-devel wrote:
> > Hey folks,
> > 
> > 
> > 
> > We're working on a video editor software and we've been exploring nle plugins. We've tried GES but we ran into some issues and now we're trying to understand better how the nle plugins actually work under the hood. 
> > 
> > 
> > 
> > I'm trying to use nleurisource for media playback. The following pipelines work:
> > 
> > 
> > 
> > AUDIO ONLY: gst-launch-1.0 nleurisource uri=file:///C:/Users/rodsantos/Downloads/video.mp4 caps="audio/x-raw(ANY)" ! audioresample ! audioconvert ! autoaudiosink
> > 
> > 
> > 
> > VIDEO ONLY: gst-launch-1.0 nleurisource uri=file:///C:/Users/rodsantos/Downloads/video.mp4 caps="video/x-raw(ANY)" ! videoconvert ! autovideosink
> > 
> > 
> > 
> > However, the following pipeline gets stuck in the PREROLLING stage:
> > 
> > 
> > 
> > gst-launch-1.0 nleurisource uri=file:///C:/Users/rodsantos/Downloads/video.mp4 caps="audio/x-raw(ANY); video/x-raw(ANY)" inpoint=5000000000 name=s ! queue ! audioresample ! audioconvert ! autoaudiosink s. ! queue ! videoconvert ! autovideosink
> > 
> > 
> > 
> > Output:
> > 
> > 
> > 
> > Use Windows high-resolution clock, precision: 1 ms 
> > 
> > Setting pipeline to PAUSED ...
> > 
> > Pipeline is PREROLLING ...
> > 
> > Got context from element 'autovideosink0': gst.d3d11.device.handle=context, device=(GstD3D11Device)"\(GstD3D11Device\)\ d3d11device2", adapter=(uint)0, adapter-luid=(gint64)95670, device-id=(uint)39745, vendor-id=(uint)32902, hardware=(boolean)true, description=(string)"Intel\(R\)\ UHD\ Graphics";
> > 
> > Redistribute latency...
> > 
> > Redistribute latency...
> > 
> > Redistribute latency...
> > 
> > Redistribute latency...
> > 
> > 0:00:00.0 / 0:00:00.0
> > 
> > 
> > 
> > Am I doing something wrong for using nleurisource to play both video and audio streams? 
> > 
> > 
> > 
> > PS: If I just replace nleurisource by uridecodebin, the pipeline works as expected.
> > 
> > 
> > 
> > Rodrigo Santos