Stereo Camera Synchronization

Dwight Kulkarni dwight at realtime-7.com
Thu Apr 20 14:53:32 UTC 2023


Hi all,

I have two cameras with independent pipelines, the camera ends in an
appsink where the jpeg frames are consumed.

The problem is that I need to extract the jpeg frames from both cameras at
exactly the same time. There can't be slight time differences between the
two images. This is for stereo image analysis.

Right now, I terminate the pipeline in an appsink and then consume the Jpeg
frames that get outputted.

If each camera runs on a separate pipeline I will get two different
callbacks that contain the JPEG image and there is no guarantee that both
images are in synch unless there is something from gstreamer that can synch
them.

Alternately, we can change the camera driver so that the raw video coming
out of the ISP is being stitched into a frame that's twice as large and
then maybe crop the image in gstreamer when recording the video to select
only one camera but the Jpeg frame being returned will contain both frames
already synched.

Before pursuing these ideas, I was hoping for any comments on what is the
best practice.

-- 
Sincerely,

Dwight Kulkarni
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <https://lists.freedesktop.org/archives/gstreamer-devel/attachments/20230420/21e59f41/attachment.htm>


More information about the gstreamer-devel mailing list