<html xmlns:v="urn:schemas-microsoft-com:vml" xmlns:o="urn:schemas-microsoft-com:office:office" xmlns:w="urn:schemas-microsoft-com:office:word" xmlns:m="http://schemas.microsoft.com/office/2004/12/omml" xmlns="http://www.w3.org/TR/REC-html40"> <head> <meta http-equiv="Content-Type" content="text/html; charset=iso-2022-jp"> <meta name="Generator" content="Microsoft Word 15 (filtered medium)"> <style></style> </head> <body lang="JA" link="#0563C1" vlink="#954F72" style="text-justify-trim:punctuation"> <div class="WordSection1"> Hi,<o:p></o:p> I would like to know how to synchronize H264 movie and G711 audio on the WebRTC server with pipeline by rtpbin.<o:p></o:p> I have tried this parameter several times and didn't work, please let me know what is wrong in this parameter.<o:p></o:p> Let me know if this doesn't makes sense for you, I will explain more.<o:p></o:p> Can you advise me ?<o:p></o:p> <o:p> </o:p> <Background><o:p></o:p> I use gstreamer and janus on the same server.<o:p></o:p> A movie data and audio data are sent to gstreamer with rtp.<o:p></o:p> After then I use <No.1 pipeline> to synchronize movie and audio with rtpbin and pass them to janus.<o:p></o:p> rtpbin will synchronize the movie and audio by each timestamp of data in my understanding.<o:p></o:p> But I found that they were NOT sync.<o:p></o:p> It meant that the movie and audio were out of sync.<o:p></o:p> <o:p></o:p> I am trying to find out where the problem is and I am thinking of using <No.2 pipeline> between rtp and rtpbin to cause the situation of out of sync. <o:p></o:p> And if out of sync situation happens, then that means there is a problem with pipeline. <o:p></o:p> However, I am also not sure about this <No.2 pipeline> to make it work, so I would like to make sure if my understanding is correct.<o:p></o:p> <o:p> </o:p> <o:p> </o:p> <No.1 Pipeline><o:p></o:p> gst-launch-1.0 rtpbin name=rtpbin rtpbin name=rtpbin2 <o:p></o:p> udpsrc port=60000 caps="application/x-rtp,media=(string)video,clock-rate=(int)90000,encoding-name=(string)MP2T-ES" ! <o:p></o:p> rtpbin.send_rtp_sink_0 <o:p></o:p> rtpbin.send_rtp_src_0 ! rtpmp2tdepay ! queue max-size-time=0 ! tsdemux ! <o:p></o:p> video/x-h264,framerate=30/1,width=1280,height=960,tune=zerolatency ! <o:p></o:p> h264parse ! rtph264pay ! rtpbin2.send_rtp_sink_0 <o:p></o:p> udpsrc port=60001 ! rtpbin.recv_rtcp_sink_0 <o:p></o:p> rtpbin.send_rtcp_src_0 ! udpsink host=192.168.31.1 port=60011 sync=false async=false <o:p></o:p> rtpbin2.send_rtp_src_0 ! udpsink host=127.0.0.1 port=5005 <o:p></o:p> rtpbin2.send_rtcp_src_0 ! udpsink host=127.0.0.1 port=5105 sync=false async=false <o:p></o:p> udpsrc port=51005 ! rtpbin2.recv_rtcp_sink_0 <o:p></o:p> <o:p> </o:p> udpsrc port=61002 caps="application/x-rtp, media=(string)audio, clock-rate=(int)8000, encoding-name=(string)PCMU" ! <o:p></o:p> rtpbin.send_rtp_sink_1 <o:p></o:p> rtpbin.send_rtp_src_1 ! queue ! rtppcmudepay ! rtppcmupay ! rtpbin2.send_rtp_sink_1 <o:p></o:p> <o:p> </o:p> udpsrc port=60003 ! rtpbin.recv_rtcp_sink_1 <o:p></o:p> rtpbin.send_rtcp_src_1 ! udpsink host=192.168.31.1 port=60013 sync=false async=false<o:p></o:p> <o:p> </o:p> rtpbin2.send_rtp_src_1 ! udpsink host=127.0.0.1 port=5003 <o:p></o:p> rtpbin2.send_rtcp_src_1 ! udpsink host=127.0.0.1 port=5103 sync=false async=false <o:p></o:p> udpsrc port=51003 ! rtpbin2.recv_rtcp_sink_1 <o:p></o:p> <o:p> </o:p> <o:p> </o:p> <No.2 Pipeline><o:p></o:p> gst-launch-1.0 udpsrc port=61002 ! queue max-size-time=0 min-threshold-time=1500000000 ! udpsink host=192.168.31.138 port=60002<o:p></o:p> <o:p> </o:p> <o:p> </o:p> Best regards.<o:p></o:p> <o:p> </o:p> </div> </body> </html>