Encapsulating text in RTP stream

[Manuel Wagesreither]

Hi all,

For scientific purposes I'd like to send a video stream together with textual data over an RTP stream. The textual data amend the visual stream and contain information such as X, Y coordinates of points of interest. Thus, they need to be in sync with the video.

I searched the internet for quite a bit and this is the most promising I found: https://gist.github.com/justinjoy/e0f563194bbff432d2ab46954f98c6a6

Sadly, as I do not have prior GStreamer experience, I don't even find the line of code where the text actually gets fed into the stream. It's not clear to me where the text gets taken from.

Here's some StackOverflow question [1] which claims that RTP suggests RFC4103 [2] and RFC4396 [3] to encapsulate text in RTP but also that GStreamer has no support for it yet.

[1] https://stackoverflow.com/questions/60553497/gstreamer-rtp-transmission-of-video-text
[2] https://datatracker.ietf.org/doc/html/rfc4103
[3] https://www.rfc-editor.org/rfc/rfc4396

I feel a bit list and would appreciate any advice.

Thanks in advance,
Manuel