[Mesa-dev] VAAPI encoder and OpenGL

[Daniel Gomez]

Hi guys,

We have found a limitation on the usage of the GPU and the encoder
when you run it simultaneously in a gstreamer pipeline and we would like to
report it and try to find a solution.

Besides encoding the video frame, the following gstreamer pipeline shows the
usage of the GPU in two ways:
1. OpenGL color conversion.
2. Render to the display using OpenGL.

DISPLAY=:0 \
GST_DEBUG="*:3,GST_TRACER:7" GST_TRACERS="queuelevel"  \
gst-launch-1.0 videotestsrc ! video/x-raw,format=RGBA ! \
glupload ! glcolorconvert !  gldownload  ! \
queue max-size-bytes=279936000 max-size-time=3000000000 leaky=2 ! \
vaapih264enc ! \
fakesink \
videotestsrc ! video/x-raw ! glimagesink sync=false

By running the above pipeline you can see how the encoder queue fills up to the
maximum and never consumes the incoming data.

Hardware information:

AMD Embedded R-Series RX-421BD Radeon R7

lspci -v -s 00:01.0
00:01.0 VGA compatible controller: Advanced Micro Devices, Inc.
[AMD/ATI] Wani [Radeon R5/R6/R7 Graphics] (rev 84) (prog-if 00 [VGA
controller])
Subsystem: Advanced Micro Devices, Inc. [AMD/ATI] Wani [Radeon
R5/R6/R7 Graphics]
Flags: bus master, fast devsel, latency 0, IRQ 53
Memory at e0000000 (64-bit, prefetchable) [size=256M]
Memory at f2000000 (64-bit, prefetchable) [size=8M]
I/O ports at 5000 [size=256]
Memory at f2c00000 (32-bit, non-prefetchable) [size=256K]
Expansion ROM at 000c0000 [disabled] [size=128K]
Capabilities: [48] Vendor Specific Information: Len=08 <?>
Capabilities: [50] Power Management version 3
Capabilities: [58] Express Root Complex Integrated Endpoint, MSI 00
Capabilities: [a0] MSI: Enable+ Count=1/1 Maskable- 64bit+
Capabilities: [100] Vendor Specific Information: ID=0001 Rev=1 Len=010 <?>
Capabilities: [270] Secondary PCI Express <?>
Capabilities: [2b0] Address Translation Service (ATS)
Capabilities: [2c0] Page Request Interface (PRI)
Capabilities: [2d0] Process Address Space ID (PASID)
Kernel driver in use: amdgpu
Kernel modules: amdgpu

DISPLAY=:0 glxinfo -B
name of display: :0
display: :0  screen: 0
direct rendering: Yes
Extended renderer info (GLX_MESA_query_renderer):
    Vendor: X.Org (0x1002)
    Device: AMD Radeon R7 Graphics (CARRIZO, DRM 3.36.0,
5.5.0-qtec-standard, LLVM 8.0.0) (0x9874)
    Version: 19.0.1
    Accelerated: yes
    Video memory: 1024MB
    Unified memory: no
    Preferred profile: core (0x1)
    Max core profile version: 4.5
    Max compat profile version: 4.5
    Max GLES1 profile version: 1.1
    Max GLES[23] profile version: 3.2
OpenGL vendor string: X.Org
OpenGL renderer string: AMD Radeon R7 Graphics (CARRIZO, DRM 3.36.0,
5.5.0-qtec-standard, LLVM 8.0.0)
OpenGL core profile version string: 4.5 (Core Profile) Mesa 19.0.1
OpenGL core profile shading language version string: 4.50
OpenGL core profile context flags: (none)
OpenGL core profile profile mask: core profile

OpenGL version string: 4.5 (Compatibility Profile) Mesa 19.0.1
OpenGL shading language version string: 4.50
OpenGL context flags: (none)
OpenGL profile mask: compatibility profile

OpenGL ES profile version string: OpenGL ES 3.2 Mesa 19.0.1
OpenGL ES profile shading language version string: OpenGL ES GLSL ES 3.20

Any idea/suggestion why is this happening?

Thanks!
Daniel