Unsynced Audio and Video signals in RTSP Stream

[vinod kesti]

Try sending SR report. The NTP timestamp in the SR report will help in audio and video synchronization.Check rtpbin examples which have SR and RR reort


Sent from Yahoo Mail. Get the app 

    On Monday, 22 April, 2024 at 03:20:51 pm GMT-5, cfd new via gstreamer-devel <gstreamer-devel at lists.freedesktop.org> wrote:  
 
  I guess you send out audio and video separately. If yes, you may try to send out audio first and then video.
   Joe

    On Thursday, April 18, 2024, 08:13:43 a.m. EDT, Felix Sternkopf via gstreamer-devel <gstreamer-devel at lists.freedesktop.org> wrote:  
 
  <!--#yiv4638044512 filtered {}#yiv4638044512 filtered {}#yiv4638044512 filtered {}#yiv4638044512 p.yiv4638044512MsoNormal, #yiv4638044512 li.yiv4638044512MsoNormal, #yiv4638044512 div.yiv4638044512MsoNormal {margin:0cm;margin-bottom:.0001pt;font-size:11.0pt;font-family:"Calibri", sans-serif;}#yiv4638044512 a:link, #yiv4638044512 span.yiv4638044512MsoHyperlink {color:#0563C1;text-decoration:underline;}#yiv4638044512 a:visited, #yiv4638044512 span.yiv4638044512MsoHyperlinkFollowed {color:#954F72;text-decoration:underline;}#yiv4638044512 span.yiv4638044512E-MailFormatvorlage17 {font-family:"Arial", sans-serif;color:windowtext;}#yiv4638044512 .yiv4638044512MsoChpDefault {font-family:"Calibri", sans-serif;}#yiv4638044512 filtered {}#yiv4638044512 div.yiv4638044512WordSection1 {}-->
Dear GST Community,
 
i have implemented a rtsp server with the gst-rtsp-server module. The server receives an audio signal via an interaudiosrc and a video signal via an intervideosrc:
 
           intervideosrc channel=videosrc à videoconvertà vaapih264enc bitrate=5000 zerolatency=trueà rtph264pay pt=96 name=pay0
 
            interaudiosrc channel=audiosrcà opusenc bitrate=64à queueà rtpopuspay pt=97 name=pay1
 
  
 
When I try to view the stream via an rtsp client, for example VLC Player the stream works, but the audio signal is about 1 second behind the video signal. I already tried different audio encoders and different queue parameters like buffer size and leaky queues, but nothing solved the problem.
 
When I start the same pipeline as above but mux both signals and write them into a filesink they are synchronized.
 
  
 
I know that the server module internally uses the multiudpsink element. Is there any possibility to edit multiudpsink parameters from outside?
 
Does anybody have any ideas about this problem? I already read every google result I could find about it.
 
  
 
Best Regards,
 
Felix Sternkopf
     
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <https://lists.freedesktop.org/archives/gstreamer-devel/attachments/20240423/f8e5237b/attachment.htm>