Problem with etnaviv and gstreamer 1.0

[Luís Mendes]

Replies in between.

Regards,
Luís Mendes

On Tue, Dec 5, 2017 at 2:33 PM, Lukasz Majewski <lukma at denx.de> wrote:
> Hi Luís,
>
> Thanks for your reply.
>
>> Hi Lukasz,
>>
>> I'm not part of the mesa/etnaviv development team, but I've tried
>> somethings with gstreamer, maybe I can provide some useful
>> information...
>>
>> Can you try xvimagesink instead of glimagesink?
>
> It would be hard since I do support Weston/Wayland - not X11.

Ok.

>
>>
>> Etnaviv provides the driver for the 3D GPU, but I believe the video is
>> normally output out through the 2D unit, the GC320 in i.MX6 via
>> xf86-armada drm driver.
>>
>> I think the best approach for decoding and outputting video is to
>> implement the VAAPI and/or VDPAU support in mesa, right on etnaviv
>
> I've read that etnaviv has some issues with YUV->RGB conversion and
> with some shaders (as they are required by Gstreamer) [1], [2].
>
>> making the CODA VPU unit available to all the applications that are
>> already VAAPI and VDPAU aware, like vlc, kodi and others. That way
>> standard desktop applications can be used without much changes or one
>> can develop for both platforms with less effort. I am currently
>> starting such project to bridge the gap with a prototype driver that
>> could be integrated in etanviv and mesa. Mesa already implements
>> VAAPI and VDPAU, I believe one just needs to implement an internal
>> mesa API named VL.
>
> Please correct me if I'm wrong - is the above proposal is for only
> playing movies?

The above proposal is mainly for playing videos, that is,
decoding/encoding video sources, could be a stream from a camera,
through a kind of "standard" API that is also used for desktop
applications, but also provides an image output path to the screen.
Kodi seems to use this to output the video but also to overlay text
and icons.

>
> Now, I do have a problem to get very basic test working
> (black rectangle is shown):
> gst-launch-1.0  -v gltestsrc pattern=smpte ! glimagesink

The above is working on my setup under Xorg. Under weston also works,
but image is distorted. What kernel/mesa version are you using?

>
>>
>> Meanwhile, maybe you can try the following which also makes use of
>> the CODA VPU unit with gstreamer:
>>
>> wget
>> http://linode.boundarydevices.com/videos/trailer_1080p_h264_mp3.avi
>>
>> gst-launch-1.0 filesrc
>> location=/home/ubuntu/trailer_1080p_h264_mp3.avi ! \ avidemux !
>> h264parse ! v4l2video1dec capture-io-mode=dmabuf ! \ xvimagesink
>> device=1 sync=0
>
> Ok (despite the xvimagesink part).
>
>>
>> The above works both on my i.MX6Q and on my i.MX6QP under X, I haven't
>> tried with wayland, but should work just the same.
>>
>> I based this test on the following post by Fabio Estevam:
>> https://imxdev.gitlab.io/tutorial/Decoding_video_with_a_mainline_kernel_on_i.MX6/
>
> I've followed this tutorial - I'm not able to get the movie displayed:

That's odd, again it should work. It works on  my i.MX6Q and i.MX6QP
as long as I haven't any graphical display running. Have you installed
the CODA VPU firmware in /lib/firmware/vpu?

>
> The following line gives some output to file.
>
> export XDG_RUNTIME_DIR=/run/user/0;gst-launch-1.0 filesrc
> location=trailer_1080p_h264_mp3.avi ! avidemux ! h264parse !
> v4l2video1dec capture-io-mode=dmabuf ! filesink location=/tmp/out
> sync=false
>
> And with the below one:
>
> gst-launch-1.0 filesrc location=trailer_1080p_h264_mp3.avi !
>  avidemux ! h264parse ! v4l2video1dec capture-io-mode=dmabuf !
>  video/x-raw,format=YUY2 ! glimagesink

I get no such error. Although the video is not playable in this mode,
it keeps repeating the first bunch of frames in a loop until the video
duration elapses in a distorted reddish colored window.
You are probably using an old mesa version. Despite what you say
regarding the color space unexpected conversion, if I'm not mistaken
R8G8_UNORM support was only implemented relatively recently, so you
are likely using an old mesa version. I would recommend you to test
with mesa-17.3.0 or the release candidate 6 that is already available,
Etnaviv improved a lot lately and now supports openGL 2.1, maybe you
should try mesa-17.3.0.

>
> Error is:
> ---------
> etna_rs_gen_clear_surface:77: etna_rs_gen_clear_surface: Unhandled
> clear fmt PIPE_FORMAT_R8G8_UNORM
>
> I'm just wondering -> x-raw,format=YUY2 explicitly asks for YUY2 format
> (which shall be supported by etnaviv).... why then in the middle there
> is PIPE_FORMAT_R8G8_UNORM ?
>
>
> And with this one:
> gst-launch-1.0 filesrc location=trailer_1080p_h264_mp3.avi ! avidemux !
> h264parse ! v4l2video1dec capture-io-mode=dmabuf ! videoconvert !
> fbdevsink sync=false
>
> No errors are present, but also I do not see any output.

I also see no image under Wayland (using Ubuntu 17.10 desktop, or
Weston on i.MX6QP), but it works (slowly) when I don't have any
graphical environment running.