Encapsulating text in RTP stream

Manuel Wagesreither ManWag at FastMail.FM
Tue Jul 12 07:51:06 UTC 2022


Hi Jeff,

thanks for your input, much appreciated. We will look into it.

Regards, Manuel

Am Mi, 6. Jul 2022, um 14:52, schrieb Jeff Shanab:
> This sounds like the Onvif metadata streaming 
> It is a standard substream as far as rtsp and rtp. instead of audio, it just has frames of xml. 
> Event security cameras that are not connecting via onvif use this normalized XML. 
> 
>  https://www.onvif.org/specs/srv/analytics/ONVIF-Analytics-Service-Spec.pdf
> section 5.2 defines the coordinate system and basic layout and the
> Onvif Streaming Spec describes how it fits into rtsp.
> 
> https://www.onvif.org/specs/stream/ONVIF-Streaming-Spec.pdf
> 
> Disclaimer, I am not an Onvif proponent, fan or official, far from it, but this part they seem to have gotten right and people are using it to interoperate.
> 
> On Wed, Jul 6, 2022 at 8:38 AM Manuel Wagesreither via gstreamer-devel <gstreamer-devel at lists.freedesktop.org> wrote:
>> Hi all,
>> 
>> For scientific purposes I'd like to send a video stream together with textual data over an RTP stream. The textual data amend the visual stream and contain information such as X, Y coordinates of points of interest. Thus, they need to be in sync with the video.
>> 
>> I searched the internet for quite a bit and this is the most promising I found: https://gist.github.com/justinjoy/e0f563194bbff432d2ab46954f98c6a6
>> 
>> Sadly, as I do not have prior GStreamer experience, I don't even find the line of code where the text actually gets fed into the stream. It's not clear to me where the text gets taken from.
>> 
>> Here's some StackOverflow question [1] which claims that RTP suggests RFC4103 [2] and RFC4396 [3] to encapsulate text in RTP but also that GStreamer has no support for it yet.
>> 
>> [1] https://stackoverflow.com/questions/60553497/gstreamer-rtp-transmission-of-video-text
>> [2] https://datatracker.ietf.org/doc/html/rfc4103
>> [3] https://www.rfc-editor.org/rfc/rfc4396
>> 
>> I feel a bit list and would appreciate any advice.
>> 
>> Thanks in advance,
>> Manuel
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <https://lists.freedesktop.org/archives/gstreamer-devel/attachments/20220712/ca0df96c/attachment.htm>


More information about the gstreamer-devel mailing list