Overlay without major performance hit?

[Adrien Schwartzentruber]

One of the limitation with the cairooverlay element is that it require RGB
format, so it will always downgrade your pipeline speed (if convert is
needed, that is usually the case). This fact, is due to the under cairo
image format limitation.

I think that the solution depends of what king of content you want to add
to the stream. How complex ? Static ?

I never tried, but I think that you can compose images with opengl element.
If I was you, I will try to look in this direction.


On Sat, Mar 15, 2014 at 8:12 AM, Michael Tyson <michael at tyson.id.au> wrote:

> Hello,
>
> I'm trying to use cairooverlay to add some content to live video frames
> displayed on a Raspberry Pi.
>
> I've not been able to get video frames to appear onscreen while drawing
> from udpsrc, so I did some testing using get-inspect and a file-based test
> video:
>
> gst-launch-1.0 filesrc
> location=big_buck_bunny_720p_H264_AAC_25fps_3400K.MP4 ! qtdemux ! h264parse
> ! omxh264dec ! autovideoconvert ! cairooverlay ! autovideoconvert !
> eglglessink
>
> I discovered that including cairooverlay in the video pipeline introduces
> a massive performance hit at 720p: The video playback goes from the video's
> native framerate to about 1 or 2 frames per second. I guess cairooverlay
> doesn't work with the zero-copy stuff happening between omxh264dec and
> eglglessink.
>
> Curious about using appsrc and videomixer instead, I tried another
> pipeline, using videotestsrc (in place of appsrc) and a videomixer:
>
> gst-launch-1.0 filesrc
> location=big_buck_bunny_720p_H264_AAC_25fps_3400K.MP4 ! qtdemux ! h264parse
> ! omxh264dec ! autovideoconvert ! videomixer name=mix !  eglglessink
> sync=false videotestsrc ! mix.
>
> The same thing happened: Frame rate dropped below usable values.
>
> I'm wondering: Is there any way, using the Gstreamer framework, that one
> can achieve acceptable frame rates while applying an overlay?
>
> Cheers,
> Michael
>
> _______________________________________________
> gstreamer-devel mailing list
> gstreamer-devel at lists.freedesktop.org
> http://lists.freedesktop.org/mailman/listinfo/gstreamer-devel
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.freedesktop.org/archives/gstreamer-devel/attachments/20140315/b4e013eb/attachment.html>