[PATCH v2 0/9] media: renesas: vsp1: Add colorspace support

Fri May 2 16:16:57 UTC 2025

Hi Tommaso,

On Fri, May 02, 2025 at 10:21:21AM +0200, Tommaso Merciai wrote:
> On Wed, Apr 30, 2025 at 02:28:55AM +0300, Laurent Pinchart wrote:
> > Hello,
> > 
> > This patch series extends the VSP1 driver with colorspace support. It
> > turns out that the VSP RPF and WPF entities can convert between RGB and
> > YUV, a feature that we have failed to test so far. The hardware support
> > BT.601 and BT.709, in both limited and full range. Proper configuration
> > of colorspace is crucial for accurate image rendering.
> > 
> > Patch 1/9 starts by implementing pixel format enumeration in the driver,
> > a feature that was surprisingly missing. Patch 2/9 then continues with
> > another fix, restricting the creation of the HSI and HST entities to VSP
> > instances that include them. Following with another fix, patch 4/9
> > addresses format setting on the RPF and WPF source pad to disable HSV
> > <-> { RGB, YUV } conversion, a feature *not* supported by the hardware.
> > 
> > After those initial fixes, patch 5/9 starts implementing colorspace
> > support by reporting the related information to userspace. The driver
> > currently hardcodes limited range BT.601 when programming the hardware,
> > so that is the value that the patch reports to userspace for YUV
> > formats. Patch 6/9 makes the YCbCr encoding and quantization
> > configurable, finalizing colorspace support in the VSP driver.
> > 
> > The next three patches are new in this version. They proceed with
> > exposing colorspace configurability in the API exposed to the DU DRM
> > driver in patch 8/9 (with 7/9 performing a small refactoring first).
> > Patch 9/9 then updates the DU driver accordingly, to create plane
> > colorspace properties and wire them up to the VSP.
> > 
> > The series has been tested with the vsp-tests suite and the kms-tests
> > suite. Patches that add CSC support to the vsp-tests suite have been
> > posted in [1], and can be found in the vsp-tests git tree in [2].
> 
> I've tested this series with out of Tree patches with RZ/G3E.
> Basically I've added the equivalent of:
> 
>  - drm: rcar-du: Create plane color properties
> 
> On drivers/gpu/drm/renesas/rz-du/rzg2l_du_vsp.c
> 
> Tested using modetest:
> 
> modetest -M rzg2l-du -s 48 at 46:800x600-60.32 at YU16 -d -P 39 at 46:512x300+200+200 at YU16
> 
> modetest -M rzg2l-du -w 32:COLOR_ENCODING:0
> modetest -M rzg2l-du -w 32:COLOR_ENCODING:1
> 
> modetest -M rzg2l-du -w 32:COLOR_RANGE:0
> modetest -M rzg2l-du -w 32:COLOR_RANGE:1
> 
> Where 32 is the id of the primary plane.
> 
> Tested-by: Tommaso Merciai <tommaso.merciai.xr at bp.renesas.com>

Thank you for confirming this works on RZ. Unfortunately your Tested-by
tag came after I submitted the pull request, and the patches got merged
without it. It however gives me confidence that the code is working as
intended.

> > Updates to media-ctl and yavta to support setting colorspace on video
> > capture devices and on subdev source pads have been merged in the
> > respective projects, make sure to use the latest master branch if you
> > want to run the tests.
> > 
> > The series has also been tested with the latest v4l2-compliance. The bad
> > news is that the test flags 56 errors when run on a Renesas Salvator-X
> > 2nd version board based on r8a77965:
> > 
> > Grand Total for vsp1 device /dev/media1: 757, Succeeded: 701, Failed: 56, Warnings: 0
> > 
> > The good news is that none of those are regressions, quite the contrary:
> > without this series applied, the total number of failures is 95, and the
> > diff shows no new error. I will therefore address those issues
> > separately.
> > 
> > I would like to get patch 1/9 to 8/9 merged in v6.16, to then merge 9/9
> > in v6.17.
> > 
> > [1] https://lore.kernel.org/linux-renesas-soc/20250409004758.11014-1-laurent.pinchart@ideasonboard.com
> > [2] https://git.ideasonboard.com/renesas/vsp-tests.git/log/?h=csc
> > 
> > Laurent Pinchart (9):
> >   media: renesas: vsp1: Implement pixel format enumeration
> >   media: renesas: vsp1: Make HSI and HST modules optional
> >   media: renesas: vsp1: Fix HSV format enumeration
> >   media: renesas: vsp1: Fix media bus code setup on RWPF source pad
> >   media: renesas: vsp1: Report colour space information to userspace
> >   media: renesas: vsp1: Allow setting encoding and quantization
> >   media: renesas: vsp1: Name nested structure in vsp1_drm
> >   media: renesas: vsp1: Expose color space through the DRM API
> >   drm: rcar-du: Create plane color properties
> > 
> >  drivers/gpu/drm/renesas/rcar-du/rcar_du_vsp.c |  15 ++
> >  drivers/media/platform/renesas/vsp1/vsp1.h    |   1 +
> >  .../media/platform/renesas/vsp1/vsp1_brx.c    |   9 +-
> >  .../media/platform/renesas/vsp1/vsp1_drm.c    |  22 +-
> >  .../media/platform/renesas/vsp1/vsp1_drm.h    |   8 +-
> >  .../media/platform/renesas/vsp1/vsp1_drv.c    |  59 +++---
> >  .../media/platform/renesas/vsp1/vsp1_entity.c |  22 +-
> >  .../media/platform/renesas/vsp1/vsp1_entity.h |   2 +
> >  .../media/platform/renesas/vsp1/vsp1_hsit.c   |  11 +-
> >  .../media/platform/renesas/vsp1/vsp1_pipe.c   | 188 ++++++++++++++++--
> >  .../media/platform/renesas/vsp1/vsp1_pipe.h   |   5 +
> >  .../media/platform/renesas/vsp1/vsp1_rpf.c    |  29 ++-
> >  .../media/platform/renesas/vsp1/vsp1_rwpf.c   |  51 ++++-
> >  .../media/platform/renesas/vsp1/vsp1_sru.c    |   9 +-
> >  .../media/platform/renesas/vsp1/vsp1_uds.c    |   9 +-
> >  .../media/platform/renesas/vsp1/vsp1_video.c  |  50 ++++-
> >  .../media/platform/renesas/vsp1/vsp1_wpf.c    |  29 ++-
> >  include/media/vsp1.h                          |   4 +
> >  18 files changed, 442 insertions(+), 81 deletions(-)
> > 
> > 
> > base-commit: 398a1b33f1479af35ca915c5efc9b00d6204f8fa
> > prerequisite-patch-id: e3d9847d1da4398f1bf0b57f5ef4a612392c7255

-- 
Regards,

Laurent Pinchart