Audio/video synchronization with pre-buffered video

Anton Protopopov aspsk2 at gmail.com
Wed Feb 15 17:03:02 UTC 2017


Hello everyone,

I have a pipeline with live H264 video source and live AAC audio
source muxed together using mpegtsmux. One problem with this pipeline
is that the video encoder hardware can buffer some number of frames,
so when I am creating and setting a pipeline to PLAYING state, there
could be already, say, 1-2 seconds of video buffered. Audio is not
buffered in hardware. So when the pipeline is set to the PLAYING
state, video source produces a set of frames with almost the same time
stamps and several first seconds of video are corrupted (they contain
old video frames with some audio frames). Is there a way to
synchronize such sources without dropping video frames?

Thanks,
Anton


More information about the gstreamer-devel mailing list