Video and data synchronization

[gotsring]

Just my 2 cents:
I had experimented with something where frame-specific metadata was stored
within the video file as H.264 SEI data. While parsing the H.264 video, the
SEI data was extracted and attached to the frame buffer as custom GstMeta
object. This way, each frame had its own metadata which could be used or
ignored as needed, and pipeline interaction was mostly unchanged. In my
case, the custom data was read by the appsink. Perhaps consider doing
something like this, and just inserting your data using a custom filter
element?



--
Sent from: http://gstreamer-devel.966125.n4.nabble.com/