Best Way to Synchronize Realtime Audio streams with Video Streams?

[Abrar Shahriar]

Hi,

I will synchronize microphone data from a sender via UDP src sink with video data coming from a camera, but not sure what the best way is.

Right now, I take timestamps (PTP) at mic and video src plugin src pads and add it to RTP header metadata.

My receiver app receives data via udpsrc, has a pipeline for video and one for audio. It can read the timestamps at sink pad of RTP depay elements.

What can I do to make sure audio is within 30ms of video, for say proper lipsync and such.

Also will want to adjust audio video offset at runtime to compensate for display latency, etc.

Thanks,
Abrar

シャハリアル

ーーーーーーーーー

アブラル・ザヒン・シャハリアル  (Abrar Zahin Shahriar)

ハイパーダイン株式会社
〒108−0014　東京都港区芝5丁目9−12　3階
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <https://lists.freedesktop.org/archives/gstreamer-devel/attachments/20220612/c8340481/attachment.htm>