[Intel-gfx] [PATCH V12 0/6] mdev based hardware virtio offloading support

Jason Wang jasowang at redhat.com
Mon Nov 18 10:42:34 UTC 2019


On 2019/11/18 δΈ‹εˆ2:16, Jason Wang wrote:
> Hi all:
>
> There are hardwares that can do virtio datapath offloading while
> having its own control path. This path tries to implement a mdev based
> unified API to support using kernel virtio driver to drive those
> devices. This is done by introducing a new mdev transport for virtio
> (virtio_mdev) and register itself as a new kind of mdev driver. Then
> it provides a unified way for kernel virtio driver to talk with mdev
> device implementation.
>
> Though the series only contains kernel driver support, the goal is to
> make the transport generic enough to support userspace drivers. This
> means vhost-mdev[1] could be built on top as well by resuing the
> transport.
>
> A sample driver is also implemented which simulate a virito-net
> loopback ethernet device on top of vringh + workqueue. This could be
> used as a reference implementation for real hardware driver.
>
> Also a real IFC VF driver was also posted here[2] which is a good
> reference for vendors who is interested in their own virtio datapath
> offloading product.
>
> Consider mdev framework only support VFIO device and driver right now,
> this series also extend it to support other types. This is done
> through decoupling VFIO specific bits out of mdev core and make mdev
> an independent module that allows to be used by multiple types of
> buses.
>
> Pktgen test was done with virito-net + mvnet loop back device.
>
> Please review.
>
> [1] https://lkml.org/lkml/2019/11/5/424
> [2] https://lkml.org/lkml/2019/11/5/227
>
> Changes from V11:
> - decouple VFIO specific bits out of mdev core
> - make mdev an indepdent module to allow buses other than VFIO mdev
> - allow structure composition of mdev through specifiy the size of
>    mdev structure
> - introduce mdev_vfio structure and store the VFIO specific callbacks
>    there
> - don't use "mdev" bus for virtio, use a new "mdev_virtio" bus, and
>    store the virtio specific callbacks in mdev_virtio structure.
> - do the class_id, matching on top of "mdev_virtio" bus


It looks to me this series get some conflicts with gvt-linux.git. Will 
fix them and post v13.

Thanks


>
> Changes from V10:
> - rename mvnet to mvnet_loopback
> - fix typo in the help text for sample Kconfig
>
> Changes from V9:
> - Tweak the help text for virito-mdev kconfig
>
> Changes from V8:
> - try silent checkpatch, some are still there becuase they were inherited
>    from virtio_config_ops which needs to be resolved in an independent series
> - tweak on the comment and doc
> - remove VIRTIO_MDEV_F_VERSION_1 completely
> - rename CONFIG_VIRTIO_MDEV_DEVICE to CONFIG_VIRTIO_MDEV
>
> Changes from V7:
> - drop {set|get}_mdev_features for virtio
> - typo and comment style fixes
>
> Changes from V6:
> - rename ops files and compile guard
>
> Changes from V5:
> - use dev_warn() instead of WARN(1) when class id is not set
> - validate id_table before trying to do matching between device and
>    driver
> - add wildcard for modpost script
> - use unique name for id_table
> - move get_mdev_features() to be the first member of virtio_device_ops
>    and more comments for it
> - typo fixes for the comments above virtio_mdev_ops
>
> Changes from V4:
> - keep mdev_set_class() for the device that doesn't use device ops
> - use union for device ops pointer in mdev_device
> - introduce class specific helper for getting is device ops
> - use WARN_ON instead of BUG_ON in mdev_set_virtio_ops
> - explain details of get_mdev_features() and get_vendor_id()
> - distinguish the optional virito device ops from mandatory ones and
>    make get_generation() optional
> - rename vfio_mdev.h to vfio_mdev_ops.h, rename virito_mdev.h to
>    virtio_mdev_ops.h
> - don't abuse version fileds in virtio_mdev structure, use features
>    instead
> - fix warning during device remove
> - style & docs tweaks and typo fixes
>
> Changes from V3:
> - document that class id (device ops) must be specified in create()
> - add WARN() when trying to set class_id when it has already set
> - add WARN() when class_id is not specified in create() and correctly
>    return an error in this case
> - correct the prototype of mdev_set_class() in the doc
> - add documention of mdev_set_class()
> - remove the unnecessary "class_id_fail" label when class id is not
>    specified in create()
> - convert id_table in vfio_mdev to const
> - move mdev_set_class and its friends after mdev_uuid()
> - suqash the patch of bus uevent into patch of introducing class id
> - tweak the words in the docs per Cornelia suggestion
> - tie class_id and device ops through class specific initialization
>    routine like mdev_set_vfio_ops()
> - typos fixes in the docs of virtio-mdev callbacks
> - document the usage of virtqueues in struct virtio_mdev_device
> - remove the useless vqs array in struct virtio_mdev_device
> - rename MDEV_ID_XXX to MDEV_CLASS_ID_XXX
>
> Changes from V2:
> - fail when class_id is not specified
> - drop the vringh patch
> - match the doc to the code
> - tweak the commit log
> - move device_ops from parent to mdev device
> - remove the unused MDEV_ID_VHOST
>
> Changes from V1:
> - move virtio_mdev.c to drivers/virtio
> - store class_id in mdev_device instead of mdev_parent
> - store device_ops in mdev_device instead of mdev_parent
> - reorder the patch, vringh fix comes first
> - really silent compiling warnings
> - really switch to use u16 for class_id
> - uevent and modpost support for mdev class_id
> - vraious tweaks per comments from Parav
>
> Changes from RFC-V2:
> - silent compile warnings on some specific configuration
> - use u16 instead u8 for class id
> - reseve MDEV_ID_VHOST for future vhost-mdev work
> - introduce "virtio" type for mvnet and make "vhost" type for future
>    work
> - add entries in MAINTAINER
> - tweak and typos fixes in commit log
>
> Changes from RFC-V1:
> - rename device id to class id
> - add docs for class id and device specific ops (device_ops)
> - split device_ops into seperate headers
> - drop the mdev_set_dma_ops()
> - use device_ops to implement the transport API, then it's not a part
>    of UAPI any more
> - use GFP_ATOMIC in mvnet sample device and other tweaks
> - set_vring_base/get_vring_base support for mvnet device
>
>
> Jason Wang (6):
>    mdev: make mdev bus agnostic
>    mdev: split out VFIO bus specific parent ops
>    mdev: move to drivers/
>    mdev: introduce mediated virtio bus
>    virtio: introduce a mdev based transport
>    docs: sample driver to demonstrate how to implement virtio-mdev
>      framework
>
>   .../driver-api/vfio-mediated-device.rst       |  94 ++-
>   MAINTAINERS                                   |  11 +-
>   drivers/Kconfig                               |   2 +
>   drivers/Makefile                              |   1 +
>   drivers/gpu/drm/i915/gvt/kvmgt.c              |  26 +-
>   drivers/mdev/Kconfig                          |  29 +
>   drivers/mdev/Makefile                         |   7 +
>   drivers/{vfio => }/mdev/mdev_core.c           | 107 ++-
>   drivers/{vfio => }/mdev/mdev_driver.c         |  29 +-
>   drivers/{vfio => }/mdev/mdev_private.h        |  18 +-
>   drivers/{vfio => }/mdev/mdev_sysfs.c          |   0
>   drivers/mdev/vfio.c                           |  76 ++
>   drivers/mdev/virtio.c                         | 126 ++++
>   drivers/s390/cio/vfio_ccw_ops.c               |  23 +-
>   drivers/s390/crypto/vfio_ap_ops.c             |  34 +-
>   drivers/s390/crypto/vfio_ap_private.h         |   2 +-
>   drivers/vfio/mdev/Kconfig                     |  11 -
>   drivers/vfio/mdev/Makefile                    |   4 -
>   drivers/vfio/mdev/vfio_mdev.c                 |  45 +-
>   drivers/vfio/vfio_iommu_type1.c               |   6 +-
>   drivers/virtio/Kconfig                        |  13 +
>   drivers/virtio/Makefile                       |   1 +
>   drivers/virtio/virtio_mdev.c                  | 409 +++++++++++
>   include/linux/mdev.h                          |  49 +-
>   include/linux/mdev_vfio.h                     |  68 ++
>   include/linux/mdev_virtio.h                   | 168 +++++
>   include/linux/mod_devicetable.h               |   8 +
>   samples/Kconfig                               |  10 +
>   samples/vfio-mdev/Makefile                    |   1 +
>   samples/vfio-mdev/mbochs.c                    |  26 +-
>   samples/vfio-mdev/mdpy.c                      |  27 +-
>   samples/vfio-mdev/mtty.c                      |  24 +-
>   samples/vfio-mdev/mvnet_loopback.c            | 690 ++++++++++++++++++
>   scripts/mod/devicetable-offsets.c             |   3 +
>   scripts/mod/file2alias.c                      |  12 +
>   35 files changed, 1924 insertions(+), 236 deletions(-)
>   create mode 100644 drivers/mdev/Kconfig
>   create mode 100644 drivers/mdev/Makefile
>   rename drivers/{vfio => }/mdev/mdev_core.c (76%)
>   rename drivers/{vfio => }/mdev/mdev_driver.c (83%)
>   rename drivers/{vfio => }/mdev/mdev_private.h (81%)
>   rename drivers/{vfio => }/mdev/mdev_sysfs.c (100%)
>   create mode 100644 drivers/mdev/vfio.c
>   create mode 100644 drivers/mdev/virtio.c
>   create mode 100644 drivers/virtio/virtio_mdev.c
>   create mode 100644 include/linux/mdev_vfio.h
>   create mode 100644 include/linux/mdev_virtio.h
>   create mode 100644 samples/vfio-mdev/mvnet_loopback.c
>



More information about the Intel-gfx mailing list