Stereo Camera Synchronization

[Michiel Konstapel]

Not based on any relevant, practical experience, other than knowing from 
audio that synchronization is hard, I would definitely go for the "two 
frames side by side" approach and split them up afterwards. I think 
that's the easiest way to get the best possible synchronization. Cutting 
the image up into two separate frames should be pretty straightforward 
with a tee and some videocrops.

HTH,
Michiel

On 20-04-2023 16:53, Dwight Kulkarni via gstreamer-devel wrote:
> Hi all,
>
> I have two cameras with independent pipelines, the camera ends in an 
> appsink where the jpeg frames are consumed.
>
> The problem is that I need to extract the jpeg frames from both 
> cameras at exactly the same time. There can't be slight time 
> differences between the two images. This is for stereo image analysis.
>
> Right now, I terminate the pipeline in an appsink and then consume the 
> Jpeg frames that get outputted.
>
> If each camera runs on a separate pipeline I will get two different 
> callbacks that contain the JPEG image and there is no guarantee that 
> both images are in synch unless there is something from gstreamer that 
> can synch them.
>
> Alternately, we can change the camera driver so that the raw video 
> coming out of the ISP is being stitched into a frame that's twice as 
> large and then maybe crop the image in gstreamer when recording the 
> video to select only one camera but the Jpeg frame being returned will 
> contain both frames already synched.
>
> Before pursuing these ideas, I was hoping for any comments on what is 
> the best practice.
>
> -- 
> Sincerely,
>
> Dwight Kulkarni
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <https://lists.freedesktop.org/archives/gstreamer-devel/attachments/20230420/ae99e504/attachment.htm>