Encapsulating text in RTP stream

[Jeff Shanab]

This sounds like the Onvif metadata streaming
It is a standard substream as far as rtsp and rtp. instead of audio, it
just has frames of xml.
Event security cameras that are not connecting via onvif use this
normalized XML.

 https://www.onvif.org/specs/srv/analytics/ONVIF-Analytics-Service-Spec.pdf
section 5.2 defines the coordinate system and basic layout and the
Onvif Streaming Spec describes how it fits into rtsp.

https://www.onvif.org/specs/stream/ONVIF-Streaming-Spec.pdf

Disclaimer, I am not an Onvif proponent, fan or official, far from it, but
this part they seem to have gotten right and people are using it to
interoperate.

On Wed, Jul 6, 2022 at 8:38 AM Manuel Wagesreither via gstreamer-devel <
gstreamer-devel at lists.freedesktop.org> wrote:

> Hi all,
>
> For scientific purposes I'd like to send a video stream together with
> textual data over an RTP stream. The textual data amend the visual stream
> and contain information such as X, Y coordinates of points of interest.
> Thus, they need to be in sync with the video.
>
> I searched the internet for quite a bit and this is the most promising I
> found: https://gist.github.com/justinjoy/e0f563194bbff432d2ab46954f98c6a6
>
> Sadly, as I do not have prior GStreamer experience, I don't even find the
> line of code where the text actually gets fed into the stream. It's not
> clear to me where the text gets taken from.
>
> Here's some StackOverflow question [1] which claims that RTP suggests
> RFC4103 [2] and RFC4396 [3] to encapsulate text in RTP but also that
> GStreamer has no support for it yet.
>
> [1]
> https://stackoverflow.com/questions/60553497/gstreamer-rtp-transmission-of-video-text
> [2] https://datatracker.ietf.org/doc/html/rfc4103
> [3] https://www.rfc-editor.org/rfc/rfc4396
>
> I feel a bit list and would appreciate any advice.
>
> Thanks in advance,
> Manuel
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <https://lists.freedesktop.org/archives/gstreamer-devel/attachments/20220706/2d541c63/attachment.htm>