Encapsulating text in RTP stream

[Reuven Wachtfogel]

If you are using something like H.264 for video, you could consider putting
your text into a user defined SEI NAL that is part of the Video stream.

On Wed, Jul 6, 2022 at 8:38 AM Manuel Wagesreither via gstreamer-devel <
gstreamer-devel at lists.freedesktop.org> wrote:

> Hi all,
>
> For scientific purposes I'd like to send a video stream together with
> textual data over an RTP stream. The textual data amend the visual stream
> and contain information such as X, Y coordinates of points of interest.
> Thus, they need to be in sync with the video.
>
> I searched the internet for quite a bit and this is the most promising I
> found: https://gist.github.com/justinjoy/e0f563194bbff432d2ab46954f98c6a6
>
> Sadly, as I do not have prior GStreamer experience, I don't even find the
> line of code where the text actually gets fed into the stream. It's not
> clear to me where the text gets taken from.
>
> Here's some StackOverflow question [1] which claims that RTP suggests
> RFC4103 [2] and RFC4396 [3] to encapsulate text in RTP but also that
> GStreamer has no support for it yet.
>
> [1]
> https://stackoverflow.com/questions/60553497/gstreamer-rtp-transmission-of-video-text
> [2] https://datatracker.ietf.org/doc/html/rfc4103
> [3] https://www.rfc-editor.org/rfc/rfc4396
>
> I feel a bit list and would appreciate any advice.
>
> Thanks in advance,
> Manuel
>
>
On Wed, Jul 6, 2022 at 3:38 PM Manuel Wagesreither via gstreamer-devel <
gstreamer-devel at lists.freedesktop.org> wrote:

> Hi all,
>
> For scientific purposes I'd like to send a video stream together with
> textual data over an RTP stream. The textual data amend the visual stream
> and contain information such as X, Y coordinates of points of interest.
> Thus, they need to be in sync with the video.
>
> I searched the internet for quite a bit and this is the most promising I
> found: https://gist.github.com/justinjoy/e0f563194bbff432d2ab46954f98c6a6
>
> Sadly, as I do not have prior GStreamer experience, I don't even find the
> line of code where the text actually gets fed into the stream. It's not
> clear to me where the text gets taken from.
>
> Here's some StackOverflow question [1] which claims that RTP suggests
> RFC4103 [2] and RFC4396 [3] to encapsulate text in RTP but also that
> GStreamer has no support for it yet.
>
> [1]
> https://stackoverflow.com/questions/60553497/gstreamer-rtp-transmission-of-video-text
> [2] https://datatracker.ietf.org/doc/html/rfc4103
> [3] https://www.rfc-editor.org/rfc/rfc4396
>
> I feel a bit list and would appreciate any advice.
>
> Thanks in advance,
> Manuel
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <https://lists.freedesktop.org/archives/gstreamer-devel/attachments/20220711/bb50eb07/attachment.htm>