[PATCH 2/3] drm/amd/amdgpu: Define and implement a function that collects number of waves that are in flight.
Russell, Kent
Kent.Russell at amd.com
Mon Sep 28 10:48:04 UTC 2020
[AMD Public Use]
Some minor typos
> -----Original Message-----
> From: amd-gfx <amd-gfx-bounces at lists.freedesktop.org> On Behalf Of Ramesh Errabolu
> Sent: Friday, September 25, 2020 6:03 PM
> To: amd-gfx at lists.freedesktop.org
> Cc: Errabolu, Ramesh <Ramesh.Errabolu at amd.com>
> Subject: [PATCH 2/3] drm/amd/amdgpu: Define and implement a function that collects
> number of waves that are in flight.
>
> [Why]
> Allow user to know how many compute units (CU) are in use at any given
> moment.
>
> [How]
> Read registers of SQ that give number of waves that are in flight
> of various queues. Use this information to determine number of CU's
> in use.
>
> Signed-off-by: Ramesh Errabolu <Ramesh.Errabolu at amd.com>
> ---
> .../gpu/drm/amd/amdgpu/amdgpu_amdkfd_gfx_v9.c | 176 +++++++++++++++++-
> .../gpu/drm/amd/include/kgd_kfd_interface.h | 12 ++
> 2 files changed, 187 insertions(+), 1 deletion(-)
>
> diff --git a/drivers/gpu/drm/amd/amdgpu/amdgpu_amdkfd_gfx_v9.c
> b/drivers/gpu/drm/amd/amdgpu/amdgpu_amdkfd_gfx_v9.c
> index e6aede725197..87d4c8855805 100644
> --- a/drivers/gpu/drm/amd/amdgpu/amdgpu_amdkfd_gfx_v9.c
> +++ b/drivers/gpu/drm/amd/amdgpu/amdgpu_amdkfd_gfx_v9.c
> @@ -38,7 +38,7 @@
> #include "soc15d.h"
> #include "mmhub_v1_0.h"
> #include "gfxhub_v1_0.h"
> -
> +#include "gfx_v9_0.h"
>
> enum hqd_dequeue_request_type {
> NO_ACTION = 0,
> @@ -706,6 +706,179 @@ void kgd_gfx_v9_set_vm_context_page_table_base(struct
> kgd_dev *kgd,
> gfxhub_v1_0_setup_vm_pt_regs(adev, vmid, page_table_base);
> }
>
> +static void lock_spi_csq_mutexes(struct amdgpu_device *adev)
> +{
> + mutex_lock(&adev->srbm_mutex);
> + mutex_lock(&adev->grbm_idx_mutex);
> +
> +}
> +
> +static void unlock_spi_csq_mutexes(struct amdgpu_device *adev)
> +{
> + mutex_unlock(&adev->grbm_idx_mutex);
> + mutex_unlock(&adev->srbm_mutex);
> +}
> +
> +/**
> + * @get_wave_count: Read device registers to get number of waves in flight for
> + * a particulare queue. The method also returns the VMID associated with the
particular
> + * queue.
> + *
> + * @adev: Handle of device whose registers are to be read
> + * @queue_idx: Index of queue in the queue-map bit-field
> + * @wave_cnt: Output parameter updated with number of waves in flight
> + * @vmid: Output parameter updated with VMID of queue whose wave count
> + * is being collected
> + */
> +static void get_wave_count(struct amdgpu_device *adev, int queue_idx,
> + int *wave_cnt, int *vmid)
> +{
> + int pipe_idx;
> + int queue_slot;
> + unsigned int reg_val;
> +
> + /*
> + * Program GRBM with appropriate MEID, PIPEID, QUEUEID and VMID
> + * parameters to read out waves in flight. Get VMID if there are
> + * non-zero waves in flight.
> + */
> + *vmid = 0xFF;
> + *wave_cnt = 0;
> + pipe_idx = queue_idx / adev->gfx.mec.num_queue_per_pipe;
> + queue_slot = queue_idx % adev->gfx.mec.num_queue_per_pipe;
> + soc15_grbm_select(adev, 1, pipe_idx, queue_slot, 0);
> + reg_val = RREG32(SOC15_REG_OFFSET(GC, 0, mmSPI_CSQ_WF_ACTIVE_COUNT_0) +
> + queue_slot);
> + *wave_cnt = reg_val & SPI_CSQ_WF_ACTIVE_COUNT_0__COUNT_MASK;
> + if (*wave_cnt != 0)
> + *vmid = (RREG32_SOC15(GC, 0, mmCP_HQD_VMID) &
> + CP_HQD_VMID__VMID_MASK) >> CP_HQD_VMID__VMID__SHIFT;
> +}
> +
> +/**
> + * @kgd_gfx_v9_get_cu_occupancy: Reads relevant registers associated with each
> + * shader engine and aggregates the number of waves that are in fight for the
in flight
> + * process whose pasid is provided as a parameter. The process could have ZERO
> + * or more queues running and submitting waves to compute units.
> + *
> + * @kgd: Handle of device from which to get number of waves in flight
> + * @pasid: Identifies the process for which this query call is invoked
> + * @wave_cnt: Output parameter updated with number of waves in flight that
> + * belong to process with given pasid
> + * @max_waves_per_cu: Output parameter updated with maximum number of waves
> + * possible per Compute Unit
> + *
> + * @note: It's possible that the device has too many queues (oversubscription)
> + * in which case a VMID could be remapped to a different PASID. This could lead
> + * to in accurate wave count. Following is a high-level sequence:
to an inaccurate
> + * Time T1: vmid = getVmid(); vmid is associated with Pasid P1
> + * Time T2: passId = getPasId(vmid); vmid is associated with Pasid P2
> + * In the sequence above wave count obtained from time T1 will be incorrectly
> + * lost or added to total wave count.
> + *
> + * The registers that provide the waves in flight are:
> + *
> + * SPI_CSQ_WF_ACTIVE_STATUS - bit-map of queues per pipe. The bit is ON if a
> + * queue is slotted, OFF if there is no queue. A process could have ZERO or
> + * more queues slotted and submitting waves to be run on compute units. Even
> + * when there is a queue it is possible there could be zero wave fronts, this
> + * can happen when queue is waiting on top-of-pipe events - e.g. waitRegMem
> + * command
> + *
> + * For each bit that is ON from above:
> + *
> + * Read (SPI_CSQ_WF_ACTIVE_COUNT_0 + queue_idx) register. It provides the
> + * number of waves that are in flight for the queue at specified index. The
> + * index ranges from 0 to 7.
> + *
> + * If non-zero waves are in fligth, read CP_HQD_VMID register to obtain VMID
flight
> + * of the wave(s).
> + *
> + * Determine if VMID from above step maps to pasid provided as parameter. If
> + * it matches agrregate the wave count. That the VMID will not match pasid is
> + * a normal condition i.e. a device is expected to support multiple queues
> + * from multiple proceses.
> + *
> + * Reading registers referenced above involves programming GRBM appropriately
> + */
> +static void kgd_gfx_v9_get_cu_occupancy(struct kgd_dev *kgd, int pasid,
> + int *pasid_wave_cnt, int *max_waves_per_cu)
> +{
> + int qidx;
> + int vmid;
> + int se_idx;
> + int sh_idx;
> + int se_cnt;
> + int sh_cnt;
> + int wave_cnt;
> + int queue_map;
> + int pasid_tmp;
> + int max_queue_cnt;
> + int vmid_wave_cnt = 0;
> + struct amdgpu_device *adev;
> + DECLARE_BITMAP(cp_queue_bitmap, KGD_MAX_QUEUES);
> +
> + adev = get_amdgpu_device(kgd);
> + lock_spi_csq_mutexes(adev);
> + soc15_grbm_select(adev, 1, 0, 0, 0);
> +
> + /*
> + * Iterate through the shader engines and arrays of the device
> + * to get number of waves in flight
> + */
> + bitmap_complement(cp_queue_bitmap, adev->gfx.mec.queue_bitmap,
> + KGD_MAX_QUEUES);
> + max_queue_cnt = adev->gfx.mec.num_pipe_per_mec *
> + adev->gfx.mec.num_queue_per_pipe;
> + sh_cnt = adev->gfx.config.max_sh_per_se;
> + se_cnt = adev->gfx.config.max_shader_engines;
> + for (se_idx = 0; se_idx < se_cnt; se_idx++) {
> + for (sh_idx = 0; sh_idx < sh_cnt; sh_idx++) {
> +
> + gfx_v9_0_select_se_sh(adev, se_idx, sh_idx, 0xffffffff);
> + queue_map = RREG32(SOC15_REG_OFFSET(GC, 0,
> + mmSPI_CSQ_WF_ACTIVE_STATUS));
> +
> + /*
> + * Assumption: queue map encodes following schema: four
> + * pipes per each micro-engine, with each pipe mapping
> + * eight queues. This schema is true for GFX9 devices
> + * and must be verified for newer device families
> + */
> + for (qidx = 0; qidx < max_queue_cnt; qidx++) {
> +
> + /* Skip qeueus that are not associated with
> + * compute functions
> + */
> + if (!test_bit(qidx, cp_queue_bitmap))
> + continue;
> +
> + if (!(queue_map & (1 << qidx)))
> + continue;
> +
> + /* Get number of waves in flight and aggregate them */
> + get_wave_count(adev, qidx, &wave_cnt, &vmid);
> + if (wave_cnt != 0) {
> + pasid_tmp =
> + RREG32(SOC15_REG_OFFSET(OSSSYS, 0,
> + mmIH_VMID_0_LUT) + vmid);
> + if (pasid_tmp == pasid)
> + vmid_wave_cnt += wave_cnt;
> + }
> + }
> + }
> + }
> +
> + gfx_v9_0_select_se_sh(adev, 0xffffffff, 0xffffffff, 0xffffffff);
> + soc15_grbm_select(adev, 0, 0, 0, 0);
> + unlock_spi_csq_mutexes(adev);
> +
> + /* Update the output parameters and return */
> + *pasid_wave_cnt = vmid_wave_cnt;
> + *max_waves_per_cu = adev->gfx.cu_info.simd_per_cu *
> + adev->gfx.cu_info.max_waves_per_simd;
> +}
> +
> const struct kfd2kgd_calls gfx_v9_kfd2kgd = {
> .program_sh_mem_settings = kgd_gfx_v9_program_sh_mem_settings,
> .set_pasid_vmid_mapping = kgd_gfx_v9_set_pasid_vmid_mapping,
> @@ -726,4 +899,5 @@ const struct kfd2kgd_calls gfx_v9_kfd2kgd = {
> .get_atc_vmid_pasid_mapping_info =
> kgd_gfx_v9_get_atc_vmid_pasid_mapping_info,
> .set_vm_context_page_table_base =
> kgd_gfx_v9_set_vm_context_page_table_base,
> + .get_cu_occupancy = kgd_gfx_v9_get_cu_occupancy,
> };
> diff --git a/drivers/gpu/drm/amd/include/kgd_kfd_interface.h
> b/drivers/gpu/drm/amd/include/kgd_kfd_interface.h
> index fc592f60e6a0..e37b4b9f626d 100644
> --- a/drivers/gpu/drm/amd/include/kgd_kfd_interface.h
> +++ b/drivers/gpu/drm/amd/include/kgd_kfd_interface.h
> @@ -212,6 +212,15 @@ struct tile_config {
> * IH ring entry. This function allows the KFD ISR to get the VMID
> * from the fault status register as early as possible.
> *
> + * @get_cu_occupancy: Function pointer that returns to caller the number
> + * of wave fronts that are in flight for all of the queues of a process
> + * as identified by its pasid. It is important to note that the value
> + * returned by this function is a snapshot of current moment and cannot
> + * guarantee any minimum for the number of waves in-flight. This function
> + * is defined for devices that belong to GFX9 and later GFX families. Care
> + * must be taken in calling this function as it is not defined for devices
> + * that belong to GFX8 and below GFX families.
> + *
> * This structure contains function pointers to services that the kgd driver
> * provides to amdkfd driver.
> *
> @@ -286,6 +295,9 @@ struct kfd2kgd_calls {
> void (*set_vm_context_page_table_base)(struct kgd_dev *kgd,
> uint32_t vmid, uint64_t page_table_base);
> uint32_t (*read_vmid_from_vmfault_reg)(struct kgd_dev *kgd);
> +
> + void (*get_cu_occupancy)(struct kgd_dev *kgd, int pasid, int *wave_cnt,
> + int *max_waves_per_cu);
> };
>
> #endif /* KGD_KFD_INTERFACE_H_INCLUDED */
> --
> 2.27.0
>
> _______________________________________________
> amd-gfx mailing list
> amd-gfx at lists.freedesktop.org
> https://nam11.safelinks.protection.outlook.com/?url=https%3A%2F%2Flists.freedesktop.or
> g%2Fmailman%2Flistinfo%2Famd-
> gfx&data=02%7C01%7Ckent.russell%40amd.com%7C36b3f4cda50a47ed3b5608d8619e
> d37a%7C3dd8961fe4884e608e11a82d994e183d%7C0%7C0%7C637366682081748390&
> sdata=ZXD4eVB8TWow6sHB6Mf2OUV%2BSsb4EP%2BB5VMokKEp7W0%3D&reserved=
> 0
More information about the amd-gfx
mailing list