Problem with NDISRC, WHIPSINK, and audio

[Tarun Tej K]

Hi,

What is the idea behind fixing the sink pad number i.e., sink_0 to video
and sink_1 to audio ? The pads would be linked dynamically anyway.

Can you try the below modified pipeline. I have also added a queue in audio
branch after demux.

*gst-launch-1.0 ndisrc ndi-name="NDIPE8 (SIGGEN)" !  ndisrcdemux name=demux
demux.video ! queue ! videoconvert ! x264enc !
video/x-h264,format=byte-stream,profile=baseline ! rtph264pay !
'application/x-rtp,media=video,encoding-name=H264,payload=97,clock-rate=90000'
!  whip. demux.audio ! queue ! audioconvert ! opusenc ! rtpopuspay !
'application/x-rtp,media=audio,encoding-name=OPUS,payload=96,clock-rate=48000,encoding-params=(string)2'
 !  whipsink name=whip   auth-token="…redacted….."
 whip-endpoint="https://director.millicast.com/api/whip/myStreamName
<https://director.millicast.com/api/whip/myStreamName>”*


On Sat, 15 Jul, 2023, 03:30 GST Developer via gstreamer-devel, <
gstreamer-devel at lists.freedesktop.org> wrote:

> Hi Folks.
>
> I am attempting use gstreamer to send content from an NDI Source to a WHIP
> end point at Dolby.io.
>
> If I just send VIDEO, its working fine:
>
> *gst-launch-1.0 ndisrc ndi-name="NDIPE8 (SIGGEN)" !  ndisrcdemux
> name=demux demux.video ! queue ! videoconvert ! x264enc !
> video/x-h264,format=byte-stream,profile=baseline ! rtph264pay !
> 'application/x-rtp,media=video,encoding-name=H264,payload=97,clock-rate=90000'
> !   whip.sink_0 whipsink name=whip   auth-token=“…redacted….."
>  whip-endpoint="https://director.millicast.com/api/whip/myStreamName
> <https://director.millicast.com/api/whip/myStreamName>”*
>
> *This works FINE !! we get the signal to the WHIP server and the end to
> end latency is about 2 seconds.*
>
> Now I want to add AUDIO to that pipeline, and I am trying:
>
> *gst-launch-1.0 ndisrc ndi-name="NDIPE8 (SIGGEN)" !  ndisrcdemux
> name=demux demux.video ! queue ! videoconvert ! x264enc !
> video/x-h264,format=byte-stream,profile=baseline ! rtph264pay !
> 'application/x-rtp,media=video,encoding-name=H264,payload=97,clock-rate=90000'
> !  whip.sink_0 demux.audio ! audioconvert ! opusenc ! rtpopuspay !
> 'application/x-rtp,media=audio,encoding-name=OPUS,payload=96,clock-rate=48000,encoding-params=(string)2'
>  ! whip.sink_1  whipsink name=whip   auth-token="…redacted….."
>  whip-endpoint="https://director.millicast.com/api/whip/myStreamName
> <https://director.millicast.com/api/whip/myStreamName>”*
>
> Now, it starts up with:
>
> Setting pipeline to PAUSED ...
> Pipeline is live and does not need PREROLL ...
> Pipeline is PREROLLED ...
> Setting pipeline to PLAYING ...
> New clock: GstSystemClock
> Redistribute latency...
> Redistribute latency...
> Redistribute latency…
>
> *But it stalls right there, and never gets to counting time, and we dont
> see anything arrive at the WHIP server.*
>
> *Might anyone know what I am doing wrong ?*
>
> Many thanks !!!
>
>
>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <https://lists.freedesktop.org/archives/gstreamer-devel/attachments/20230715/59d411ef/attachment-0001.htm>