Synchronized virtual cameras

[Jonas Danielsson]

Hi hello hackers!

We are trying to great some developer tools to help us with our current project!
In our system we receive live (RTP) feeds from two (or more) cameras
and stitch them together and perform some fancy operations on the
result.

It would really help us two be able to do this on pre-defined inputs!

To be more clear we would like to create a pipeline that mimics two
cameras sending a live feed of the same thing, from different angles.
To be even more clear, a pipeline that sends two different video files
over RTP/RTCP, as if they occurred live. And the rest of our system
being non the wiser.

Is there a clear way of doing this? We have done some attempts,
syncing to NTP clock, but sooner or later we seem to always have some
kind of drift between the two virtual cameras.

Is this a really hard problem or is it in fact an easy problem but we
are missing something?
Does anyone have any pointers for us for how we could implement this
"Virtual Camera System".

Thanks for your time and for your work on GStreamer!

Regards
Jonas