<html> <head> <meta http-equiv="Content-Type" content="text/html; charset=utf-8"> </head> <body style="word-wrap: break-word; -webkit-nbsp-mode: space; line-break: after-white-space;" class=""> <br class=""> <div><br class=""> <blockquote type="cite" class=""> <div class="">On Apr 20, 2022, at 12:01 AM, Andrey Grodzovsky <<a href="mailto:andrey.grodzovsky@amd.com" class="">andrey.grodzovsky@amd.com</a>> wrote:</div> <br class="Apple-interchange-newline"> <div class=""> <div class=""> <p class=""><br class=""> </p> <div class="moz-cite-prefix">On 2022-04-19 03:41, Shuotao Xu wrote:<br class=""> </div> <blockquote type="cite" cite="mid:0FD33B90-BD27-4F32-9735-CA525735B5FA@microsoft.com" class=""> <br class=""> <div class=""><br class=""> <blockquote type="cite" class=""> <div class="">On Apr 18, 2022, at 11:23 PM, Andrey Grodzovsky <<a href="mailto:andrey.grodzovsky@amd.com" class="moz-txt-link-freetext" moz-do-not-send="true">andrey.grodzovsky@amd.com</a>> wrote:</div> <br class="Apple-interchange-newline"> <div class=""> <div class=""> <p class=""><br class=""> </p> <div class="moz-cite-prefix">On 2022-04-18 09:22, Shuotao Xu wrote:<br class=""> </div> <blockquote type="cite" cite="mid:7825EEC6-BAF8-4B71-B01C-FE246D360779@microsoft.com" class=""> <br class=""> <div class=""><br class=""> <blockquote type="cite" class=""> <div class="">On Apr 16, 2022, at 12:43 AM, Andrey Grodzovsky <<a href="mailto:andrey.grodzovsky@amd.com" class="moz-txt-link-freetext" moz-do-not-send="true">andrey.grodzovsky@amd.com</a>> wrote:</div> <br class="Apple-interchange-newline"> <div class=""> <div class=""> <p class=""><br class=""> </p> <div class="moz-cite-prefix">On 2022-04-15 06:12, Shuotao Xu wrote:<br class=""> </div> <blockquote type="cite" cite="mid:76C16B06-0539-48EE-AB11-80089490CE3A@microsoft.com" class=""> Hi Andrey, <div class=""><br class=""> </div> <div class="">First I really appreciate the discussion! It helped me understand the driver code greatly. Thank you so much:)</div> <div class="">Please see my inline comments. <br class=""> <div class=""><br class=""> <blockquote type="cite" class=""> <div class="">On Apr 14, 2022, at 11:13 PM, Andrey Grodzovsky <<a href="mailto:andrey.grodzovsky@amd.com" class="moz-txt-link-freetext" moz-do-not-send="true">andrey.grodzovsky@amd.com</a>> wrote:</div> <br class="Apple-interchange-newline"> <div class=""> <div class=""> <p class=""><br class=""> </p> <div class="moz-cite-prefix">On 2022-04-14 10:00, Shuotao Xu wrote:<br class=""> </div> <blockquote type="cite" cite="mid:B7970589-ACF6-41F3-8622-1C0F705F3EE0@microsoft.com" class=""> <br class=""> <div class=""><br class=""> <blockquote type="cite" class=""> <div class="">On Apr 14, 2022, at 1:31 AM, Andrey Grodzovsky <<a href="mailto:andrey.grodzovsky@amd.com" class="moz-txt-link-freetext" moz-do-not-send="true">andrey.grodzovsky@amd.com</a>> wrote:</div> <br class="Apple-interchange-newline"> <div class=""> <div class=""> <p class=""><br class=""> </p> <div class="moz-cite-prefix">On 2022-04-13 12:03, Shuotao Xu wrote:<br class=""> </div> <blockquote type="cite" cite="mid:5A64FAEA-CCE8-4EB6-8E7B-852D4F384255@microsoft.com" class=""> <br class=""> <div class=""><br class=""> <blockquote type="cite" class=""> <div class="">On Apr 11, 2022, at 11:52 PM, Andrey Grodzovsky <<a href="mailto:andrey.grodzovsky@amd.com" class="moz-txt-link-freetext" moz-do-not-send="true">andrey.grodzovsky@amd.com</a>> wrote:</div> <br class="Apple-interchange-newline"> <div class=""><span style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: 400; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none; float: none; display: inline !important;" class="">[Some people who received this message don't often get email from<span class="Apple-converted-space"> </span></span><a href="mailto:andrey.grodzovsky@amd.com" style="font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: 400; letter-spacing: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-size-adjust: auto; -webkit-text-stroke-width: 0px;" class="moz-txt-link-freetext" moz-do-not-send="true">andrey.grodzovsky@amd.com</a><span style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: 400; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none; float: none; display: inline !important;" class="">. Learn why this is important at<span class="Apple-converted-space"> </span></span><a href="http://aka.ms/LearnAboutSenderIdentification" style="font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: 400; letter-spacing: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-size-adjust: auto; -webkit-text-stroke-width: 0px;" class="moz-txt-link-freetext" moz-do-not-send="true">http://aka.ms/LearnAboutSenderIdentification</a><span style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: 400; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none; float: none; display: inline !important;" class="">.]</span><br style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: 400; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none;" class=""> <br style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: 400; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none;" class=""> <span style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: 400; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none; float: none; display: inline !important;" class="">On 2022-04-08 21:28, Shuotao Xu wrote:</span><br style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: 400; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none;" class=""> <blockquote type="cite" style="font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: 400; letter-spacing: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-size-adjust: auto; -webkit-text-stroke-width: 0px; text-decoration: none;" class=""> <br class=""> <blockquote type="cite" class="">On Apr 8, 2022, at 11:28 PM, Andrey Grodzovsky <<a href="mailto:andrey.grodzovsky@amd.com" class="moz-txt-link-freetext" moz-do-not-send="true">andrey.grodzovsky@amd.com</a>> wrote:<br class=""> <br class=""> [Some people who received this message don't often get email from <a href="mailto:andrey.grodzovsky@amd.com" class="moz-txt-link-freetext" moz-do-not-send="true"> andrey.grodzovsky@amd.com</a>. Learn why this is important at <a href="http://aka.ms/LearnAboutSenderIdentification" class="moz-txt-link-freetext" moz-do-not-send="true"> http://aka.ms/LearnAboutSenderIdentification</a>.]<br class=""> <br class=""> On 2022-04-08 04:45, Shuotao Xu wrote:<br class=""> <blockquote type="cite" class="">Adding PCIe Hotplug Support for AMDKFD: the support of hot-plug of GPU<br class=""> devices can open doors for many advanced applications in data center<br class=""> in the next few years, such as for GPU resource<br class=""> disaggregation. Current AMDKFD does not support hotplug out b/o the<br class=""> following reasons:<br class=""> <br class=""> 1. During PCIe removal, decrement KFD lock which was incremented at<br class=""> the beginning of hw fini; otherwise kfd_open later is going to<br class=""> fail.<br class=""> </blockquote> I assumed you read my comment last time, still you do same approach.<br class=""> More in details bellow<br class=""> </blockquote> Aha, I like your fix:) I was not familiar with drm APIs so just only half understood your comment last time.<br class=""> <br class=""> BTW, I tried hot-plugging out a GPU when rocm application is still running.<br class=""> From dmesg, application is still trying to access the removed kfd device, and are met with some errors.<br class=""> </blockquote> <br style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: 400; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none;" class=""> <br style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: 400; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none;" class=""> <span style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: 400; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none; float: none; display: inline !important;" class="">Application us supposed to keep running, it holds the drm_device</span><br style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: 400; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none;" class=""> <span style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: 400; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none; float: none; display: inline !important;" class="">reference as long as it has an open</span><br style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: 400; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none;" class=""> <span style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: 400; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none; float: none; display: inline !important;" class="">FD to the device and final cleanup will come only after the app will die</span><br style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: 400; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none;" class=""> <span style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: 400; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none; float: none; display: inline !important;" class="">thus releasing the FD and the last</span><br style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: 400; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none;" class=""> <span style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: 400; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none; float: none; display: inline !important;" class="">drm_device reference.</span><br style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: 400; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none;" class=""> <br style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: 400; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none;" class=""> <blockquote type="cite" style="font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: 400; letter-spacing: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-size-adjust: auto; -webkit-text-stroke-width: 0px; text-decoration: none;" class=""> Application would hang and not exiting in this case.<br class=""> </blockquote> <br style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: 400; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none;" class=""> </div> </blockquote> <div class=""><br class=""> </div> Actually I tried kill -7 $pid, and the process exists. The dmesg has some warning though.</div> <div class=""><br class=""> </div> <div class=""> <div class="">[ 711.769977] WARNING: CPU: 23 PID: 344 at .../amdgpu-rocm5.0.2/src/amd/amdgpu/amdgpu_object.c:1336 amdgpu_bo_release_notify+0x150/0x160 [amdgpu]</div> <div class="">[ 711.770528] Modules linked in: amdgpu(OE) amdttm(OE) amd_sched(OE) amdkcl(OE) iommu_v2 nf_conntrack_netlink nfnetlink xfrm_user xfrm_algo xt_addrtype br_netfilter xt_CHECKSUM iptable_mangle xt_MASQUERADE iptable_nat nf_nat xt_conntrack nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 ipt_REJECT nf_reject_ipv4 xt_tcpudp bridge stp llc ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter overlay binfmt_misc intel_rapl_msr i40iw intel_rapl_common skx_edac nfit x86_pkg_temp_thermal intel_powerclamp coretemp kvm_intel rpcrdma kvm sunrpc ipmi_ssif ib_umad ib_ipoib rdma_ucm irqbypass rapl joydev acpi_ipmi input_leds intel_cstate ipmi_si ipmi_devintf mei_me mei intel_pch_thermal ipmi_msghandler ioatdma mac_hid lpc_ich dca acpi_power_meter acpi_pad sch_fq_codel ib_iser rdma_cm iw_cm ib_cm iscsi_tcp libiscsi_tcp libiscsi scsi_transport_iscsi pci_stub ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor</div> <div class="">[ 711.779359] raid6_pq libcrc32c raid1 raid0 multipath linear mlx5_ib ib_uverbs ib_core ast drm_vram_helper i2c_algo_bit drm_ttm_helper ttm drm_kms_helper syscopyarea crct10dif_pclmul crc32_pclmul ghash_clmulni_intel sysfillrect uas hid_generic sysimgblt aesni_intel mlx5_core fb_sys_fops crypto_simd usbhid cryptd drm i40e pci_hyperv_intf usb_storage glue_helper mlxfw hid ahci libahci wmi</div> <div class="">[ 711.779752] CPU: 23 PID: 344 Comm: kworker/23:1 Tainted: G W OE 5.11.0+ #1</div> <div class="">[ 711.779755] Hardware name: Supermicro SYS-4029GP-TRT2/X11DPG-OT-CPU, BIOS 2.1 08/14/2018</div> <div class="">[ 711.779756] Workqueue: kfd_process_wq kfd_process_wq_release [amdgpu]</div> <div class="">[ 711.779955] RIP: 0010:amdgpu_bo_release_notify+0x150/0x160 [amdgpu]</div> <div class="">[ 711.780141] Code: e8 b5 af 34 f4 e9 1f ff ff ff 48 39 c2 74 07 0f 0b e9 69 ff ff ff 4c 89 e7 e8 3c b4 16 00 e9 5c ff ff ff e8 a2 ce fd f3 eb cf <0f> 0b eb cb e8 d7 02 34 f4 0f 1f 80 00 00 00 00 0f 1f 44 00 00 55</div> <div class="">[ 711.780143] RSP: 0018:ffffa8100dd67c30 EFLAGS: 00010282</div> <div class="">[ 711.780145] RAX: 00000000ffffffea RBX: ffff89980e792058 RCX: 0000000000000000</div> <div class="">[ 711.780147] RDX: 0000000000000000 RSI: ffff89a8f9ad8870 RDI: ffff89a8f9ad8870</div> <div class="">[ 711.780148] RBP: ffffa8100dd67c50 R08: 0000000000000000 R09: fffffffffff99b18</div> <div class="">[ 711.780149] R10: ffffa8100dd67bd0 R11: ffffa8100dd67908 R12: ffff89980e792000</div> <div class="">[ 711.780151] R13: ffff89980e792058 R14: ffff89980e7921bc R15: dead000000000100</div> <div class="">[ 711.780152] FS: 0000000000000000(0000) GS:ffff89a8f9ac0000(0000) knlGS:0000000000000000</div> <div class="">[ 711.780154] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033</div> <div class="">[ 711.780156] CR2: 00007ffddac6f71f CR3: 00000030bb80a003 CR4: 00000000007706e0</div> <div class="">[ 711.780157] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000</div> <div class="">[ 711.780159] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400</div> <div class="">[ 711.780160] PKRU: 55555554</div> <div class="">[ 711.780161] Call Trace:</div> <div class="">[ 711.780163] ttm_bo_release+0x2ae/0x320 [amdttm]</div> <div class="">[ 711.780169] amdttm_bo_put+0x30/0x40 [amdttm]</div> <div class="">[ 711.780357] amdgpu_bo_unref+0x1e/0x30 [amdgpu]</div> <div class="">[ 711.780543] amdgpu_gem_object_free+0x8b/0x160 [amdgpu]</div> <div class="">[ 711.781119] drm_gem_object_free+0x1d/0x30 [drm]</div> <div class="">[ 711.781489] amdgpu_amdkfd_gpuvm_free_memory_of_gpu+0x34a/0x380 [amdgpu]</div> <div class="">[ 711.782044] kfd_process_device_free_bos+0xe0/0x130 [amdgpu]</div> <div class="">[ 711.782611] kfd_process_wq_release+0x286/0x380 [amdgpu]</div> <div class="">[ 711.783172] process_one_work+0x236/0x420</div> <div class="">[ 711.783543] worker_thread+0x34/0x400</div> <div class="">[ 711.783911] ? process_one_work+0x420/0x420</div> <div class="">[ 711.784279] kthread+0x126/0x140</div> <div class="">[ 711.784653] ? kthread_park+0x90/0x90</div> <div class="">[ 711.785018] ret_from_fork+0x22/0x30</div> <div class="">[ 711.785387] ---[ end trace d8f50f6594817c84 ]---</div> <div class="">[ 711.798716] [drm] amdgpu: ttm finalized</div> </div> </blockquote> <p class=""><br class=""> </p> <p class="">So it means the process was stuck in some wait_event_killable (maybe here drm_sched_entity_flush) - you can try 'cat/proc/$process_pid/stack' maybe before<br class=""> you kill it to see where it was stuck so we can go from there.<br class=""> </p> <p class=""><br class=""> </p> <blockquote type="cite" cite="mid:5A64FAEA-CCE8-4EB6-8E7B-852D4F384255@microsoft.com" class=""> <div class=""> <div class=""><br class=""> </div> </div> <div class=""> <blockquote type="cite" class=""> <div class=""><br style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: 400; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none;" class=""> <span style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: 400; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none; float: none; display: inline !important;" class="">For graphic apps what i usually see is a crash because of sigsev when</span><br style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: 400; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none;" class=""> <span style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: 400; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none; float: none; display: inline !important;" class="">the app tries to access</span><br style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: 400; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none;" class=""> <span style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: 400; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none; float: none; display: inline !important;" class="">an unmapped MMIO region on the device. I haven't tested for compute</span><br style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: 400; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none;" class=""> <span style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: 400; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none; float: none; display: inline !important;" class="">stack and so there might</span><br style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: 400; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none;" class=""> <span style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: 400; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none; float: none; display: inline !important;" class="">be something I haven't covered. Hang could mean for example waiting on a</span><br style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: 400; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none;" class=""> <span style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: 400; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none; float: none; display: inline !important;" class="">fence which is not being</span><br style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: 400; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none;" class=""> <span style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: 400; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none; float: none; display: inline !important;" class="">signaled - please provide full dmesg from this case.</span><br style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: 400; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none;" class=""> <br style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: 400; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none;" class=""> <blockquote type="cite" style="font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: 400; letter-spacing: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-size-adjust: auto; -webkit-text-stroke-width: 0px; text-decoration: none;" class=""> <br class=""> Do you have any good suggestions on how to fix it down the line? (HIP runtime/libhsakmt or driver)<br class=""> <br class=""> [64036.631333] amdgpu: amdgpu_vm_bo_update failed<br class=""> [64036.631702] amdgpu: validate_invalid_user_pages: update PTE failed<br class=""> [64036.640754] amdgpu: amdgpu_vm_bo_update failed<br class=""> [64036.641120] amdgpu: validate_invalid_user_pages: update PTE failed<br class=""> [64036.650394] amdgpu: amdgpu_vm_bo_update failed<br class=""> [64036.650765] amdgpu: validate_invalid_user_pages: update PTE failed<br class=""> </blockquote> <br style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: 400; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none;" class=""> </div> </blockquote> <div class=""><br class=""> </div> The full dmesg will just the repetition of those two messages,</div> <div class=""> <div class="">[186885.764079] amdgpu 0000:43:00.0: amdgpu: amdgpu: finishing device.</div> <div class="">[186885.766916] [drm] free PSP TMR buffer</div> <div class="">[186893.868173] amdgpu: amdgpu_vm_bo_update failed</div> <div class="">[186893.868235] amdgpu: validate_invalid_user_pages: update PTE failed</div> <div class="">[186893.876154] amdgpu: amdgpu_vm_bo_update failed</div> <div class="">[186893.876190] amdgpu: validate_invalid_user_pages: update PTE failed</div> <div class="">[186893.884150] amdgpu: amdgpu_vm_bo_update failed</div> <div class="">[186893.884185] amdgpu: validate_invalid_user_pages: update PTE failed</div> </div> <div class=""><br class=""> </div> <div class=""> <blockquote type="cite" class=""> <div class=""><br style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: 400; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none;" class=""> <span style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: 400; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none; float: none; display: inline !important;" class="">This just probably means trying to update PTEs after the physical device</span><br style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: 400; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none;" class=""> <span style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: 400; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none; float: none; display: inline !important;" class="">is gone - we usually avoid this by</span><br style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: 400; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none;" class=""> <span style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: 400; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none; float: none; display: inline !important;" class="">first trying to do all HW shutdowns early before PCI remove completion</span><br style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: 400; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none;" class=""> <span style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: 400; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none; float: none; display: inline !important;" class="">but when it's really tricky by</span><br style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: 400; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none;" class=""> <span style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: 400; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none; float: none; display: inline !important;" class="">protecting HW access sections with drm_dev_enter/exit scope.</span><br style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: 400; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none;" class=""> <br style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: 400; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none;" class=""> <span style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: 400; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none; float: none; display: inline !important;" class="">For this particular error it would be the best to flush</span><br style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: 400; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none;" class=""> <span style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: 400; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none; float: none; display: inline !important;" class="">info->restore_userptr_work before the end of</span><br style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: 400; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none;" class=""> <span style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: 400; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none; float: none; display: inline !important;" class="">amdgpu_pci_remove (rejecting new process creation and calling</span><br style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: 400; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none;" class=""> <span style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: 400; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none; float: none; display: inline !important;" class="">cancel_delayed_work_sync(&process_info->restore_userptr_work) for all</span><br style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: 400; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none;" class=""> <span style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: 400; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none; float: none; display: inline !important;" class="">running processes)</span><br style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: 400; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none;" class=""> <span style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: 400; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none; float: none; display: inline !important;" class="">somewhere in amdgpu_pci_remove.</span><br style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: 400; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none;" class=""> <br class=""> </div> </blockquote> I tried something like *kfd_process_ref_release* which I think did what you described, but it did not work.</div> </blockquote> <p class=""><br class=""> </p> <p class="">I don't see how kfd_process_ref_release is the same as I mentioned above, what i meant is calling the code above within kgd2kfd_suspend (where you tried to call kfd_kill_all_user_processes bellow) <br class=""> </p> </div> </div> </blockquote> Yes, you are right. It was not called by it. <br class=""> <blockquote type="cite" class=""> <div class=""> <div class=""> <p class=""><br class=""> </p> <blockquote type="cite" cite="mid:5A64FAEA-CCE8-4EB6-8E7B-852D4F384255@microsoft.com" class=""> <div class=""><br class=""> </div> <div class="">Instead I tried to kill the process from the kernel, but the amdgpu could **only** be hot-plugged in back successfully only if there was no rocm kernel running when it was plugged out. If not, amdgpu_probe will just hang later. (Maybe because amdgpu was plugged out while running state, it leaves a bad HW state which causes probe to hang).</div> </blockquote> <p class=""><br class=""> </p> <p class="">We usually do asic_reset during probe to reset all HW state (checlk if amdgpu_device_init->amdgpu_asic_reset is running when you plug back). <br class=""> </p> </div> </div> </blockquote> OK<br class=""> <blockquote type="cite" class=""> <div class=""> <div class=""> <p class=""> <br class=""> </p> <blockquote type="cite" cite="mid:5A64FAEA-CCE8-4EB6-8E7B-852D4F384255@microsoft.com" class=""> <div class=""><br class=""> </div> <div class="">I don’t know if this is a viable solution worth pursuing, but I attached the diff anyway.</div> <div class=""><br class=""> </div> <div class="">Another solution could be let compute stack user mode detect a topology change via <span class="">generation_count change, and abort gracefully there.</span></div> <div class=""><br class=""> </div> <div class="">diff --git a/drivers/gpu/drm/amd/amdkfd/kfd_device.c b/drivers/gpu/drm/amd/amdkfd/kfd_device.c</div> <div class="">index 4e7d9cb09a69..79b4c9b84cd0 100644</div> <div class="">--- a/drivers/gpu/drm/amd/amdkfd/kfd_device.c</div> <div class="">+++ b/drivers/gpu/drm/amd/amdkfd/kfd_device.c</div> <div class="">@@ -697,12 +697,15 @@ void kgd2kfd_suspend(struct kfd_dev *kfd, bool run_pm, bool force)</div> <div class=""> return;</div> <div class=""><br class=""> </div> <div class=""> /* for runtime suspend, skip locking kfd */</div> <div class="">- if (!run_pm) {</div> <div class="">+ if (!run_pm && !drm_dev_is_unplugged(kfd->ddev)) {</div> <div class=""> /* For first KFD device suspend all the KFD processes */</div> <div class=""> if (atomic_inc_return(&kfd_locked) == 1)</div> <div class=""> kfd_suspend_all_processes(force);</div> <div class=""> }</div> <div class=""><br class=""> </div> <div class="">+ if (drm_dev_is_unplugged(kfd->ddev))</div> <div class="">+ kfd_kill_all_user_processes();</div> <div class="">+</div> <div class=""> kfd->dqm->ops.stop(kfd->dqm);</div> <div class=""> kfd_iommu_suspend(kfd);</div> <div class=""> }</div> <div class="">diff --git a/drivers/gpu/drm/amd/amdkfd/kfd_priv.h b/drivers/gpu/drm/amd/amdkfd/kfd_priv.h</div> <div class="">index 55c9e1922714..84cbcd857856 100644</div> <div class="">--- a/drivers/gpu/drm/amd/amdkfd/kfd_priv.h</div> <div class="">+++ b/drivers/gpu/drm/amd/amdkfd/kfd_priv.h</div> <div class="">@@ -1065,6 +1065,7 @@ void kfd_unref_process(struct kfd_process *p);</div> <div class=""> int kfd_process_evict_queues(struct kfd_process *p, bool force);</div> <div class=""> int kfd_process_restore_queues(struct kfd_process *p);</div> <div class=""> void kfd_suspend_all_processes(bool force);</div> <div class="">+void kfd_kill_all_user_processes(void);</div> <div class=""> /*</div> <div class=""> * kfd_resume_all_processes:</div> <div class=""> * bool sync: If kfd_resume_all_processes() should wait for the</div> <div class="">diff --git a/drivers/gpu/drm/amd/amdkfd/kfd_process.c b/drivers/gpu/drm/amd/amdkfd/kfd_process.c</div> <div class="">index 6cdc855abb6d..fb0c753b682c 100644</div> <div class="">--- a/drivers/gpu/drm/amd/amdkfd/kfd_process.c</div> <div class="">+++ b/drivers/gpu/drm/amd/amdkfd/kfd_process.c</div> <div class="">@@ -2206,6 +2206,24 @@ void kfd_suspend_all_processes(bool force)</div> <div class=""> srcu_read_unlock(&kfd_processes_srcu, idx);</div> <div class=""> }</div> <div class=""><br class=""> </div> <div class="">+</div> <div class="">+void kfd_kill_all_user_processes(void)</div> <div class="">+{</div> <div class="">+ struct kfd_process *p;</div> <div class="">+ struct amdkfd_process_info *p_info;</div> <div class="">+ unsigned int temp;</div> <div class="">+ int idx = srcu_read_lock(&kfd_processes_srcu);</div> <div class="">+</div> <div class="">+ pr_info("Killing all processes\n");</div> <div class="">+ hash_for_each_rcu(kfd_processes_table, temp, p, kfd_processes) {</div> <div class="">+ p_info = p->kgd_process_info;</div> <div class="">+ pr_info("Killing processes, pid = %d", pid_nr(p_info->pid));</div> <div class="">+ kill_pid(p_info->pid, SIGBUS, 1);</div> </blockquote> <p class=""><br class=""> </p> <p class="">From looking into kill_pid I see it only sends a signal but doesn't wait for completion, it would make sense to wait for completion here. In any case I would actually try to put here<span style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: 400; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none; float: none; display: inline !important;" class=""><br class=""> </span></p> </div> </div> </blockquote> I have made a version which does that with some atomic counters. Please read later in the diff.<br class=""> <blockquote type="cite" class=""> <div class=""> <div class=""> <p class=""><span style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: 400; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none; float: none; display: inline !important;" class=""></span><span style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: 400; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none; float: none; display: inline !important;" class=""><font class="" size="4"><br class=""> </font></span></p> <p class=""><span style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: 400; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none; float: none; display: inline !important;" class=""><font class="" size="4">hash_for_each_rcu(</font></span><span style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: 400; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none; float: none; display: inline !important;" class=""><font class="" size="4">p_info) <br class=""> cancel_delayed_work_sync(&</font></span><span style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: 400; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none; float: none; display: inline !important;" class=""><font class="" size="4"><span style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: 400; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none; float: none; display: inline !important;" class=""></span><span style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: 400; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none; float: none; display: inline !important;" class=""><font class="" size="4">p_info</font></span>->restore_userptr_work) <br class=""> </font></span></p> <p class=""><span style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: 400; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none; float: none; display: inline !important;" class=""><font class="" size="4">instead at least that what i meant in the previous mail. </font></span></p> </div> </div> </blockquote> <div class="">I actually tried that earlier, and it did not work. Application still keeps running, and you have to send a kill to the user process.</div> <div class=""><br class=""> </div> <div class="">I have made the following version. It waits for processes to terminate synchronously after sending SIGBUS. After that it does the real work of amdgpu_pci_remove.</div> <div class="">However, it hangs at amdgpu_device_ip_fini_early when it is trying to deinit ip_block 6 <sdma_v4_0> (<a href="https://nam06.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgitlab.freedesktop.org%2Fagd5f%2Flinux%2F-%2Fblob%2Famd-staging-drm-next%2Fdrivers%2Fgpu%2Fdrm%2Famd%2Famdgpu%2Famdgpu_device.c%23L2818&data=05%7C01%7Cshuotaoxu%40microsoft.com%7C1ce273d333a04fde7dcf08da221de5f7%7C72f988bf86f141af91ab2d7cd011db47%7C1%7C0%7C637859809165306474%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=W%2FvVPYbOl3sDNrOriqhJnAvudww%2B2ucBi3jwgwyje%2Bs%3D&reserved=0" originalsrc="https://gitlab.freedesktop.org/agd5f/linux/-/blob/amd-staging-drm-next/drivers/gpu/drm/amd/amdgpu/amdgpu_device.c#L2818" shash="q4rDZcL0oja8xWnC594mlWO050gsCgw85TB3aQj4Ev7/e96NHlAmNXiO2Ivv7XJI/dLN+5wGHP4KcTbDCC83GIhaPoFEQSS3iuiN4vghldxy9gYXMOtUHNV6SAw0VbbFamMJFi6uohHVcAraoqh+lt6e0L3dP94Hf+Ufp3G+ntw=" class="" moz-do-not-send="true">https://gitlab.freedesktop.org/agd5f/linux/-/blob/amd-staging-drm-next/drivers/gpu/drm/amd/amdgpu/amdgpu_device.c#L2818</a>). I assume that there are still some inflight dma, therefore fini of this ip block thus hangs? </div> <div class=""><br class=""> </div> <div class="">The following is an excerpt of the dmesg: please excuse for putting my own pr_info, but I hope you get my point of where it hangs.</div> <div class=""><br class=""> </div> <div class=""> <div class="">[ 392.344735] amdgpu: all processes has been fully released</div> <div class="">[ 392.346557] amdgpu: amdgpu_acpi_fini done</div> <div class="">[ 392.346568] amdgpu 0000:b3:00.0: amdgpu: amdgpu: finishing device.</div> <div class="">[ 392.349238] amdgpu: amdgpu_device_ip_fini_early enter ip_blocks = 9</div> <div class="">[ 392.349248] amdgpu: Free mem_obj = 000000007bf54275, range_start = 14, range_end = 14</div> <div class="">[ 392.350299] amdgpu: Free mem_obj = 00000000a85bc878, range_start = 12, range_end = 12</div> <div class="">[ 392.350304] amdgpu: Free mem_obj = 00000000b8019e32, range_start = 13, range_end = 13</div> <div class="">[ 392.350308] amdgpu: Free mem_obj = 000000002d296168, range_start = 4, range_end = 11</div> <div class="">[ 392.350313] amdgpu: Free mem_obj = 000000001fc4f934, range_start = 0, range_end = 3</div> <div class="">[ 392.350322] amdgpu: amdgpu_amdkfd_suspend(adev, false) done</div> <div class="">[ 392.350672] amdgpu: hw_fini of IP block[8] <jpeg_v2_5> done 0</div> <div class="">[ 392.350679] amdgpu: hw_fini of IP block[7] <vcn_v2_5> done 0</div> </div> </div> </blockquote> <p class=""><br class=""> </p> <p class="">I just remembered that the idea to actively kill and wait for running user processes during unplug was rejected<br class=""> as a bad idea in the first iteration of unplug work I did (don't remember why now, need to look) so this is a no go.<br class=""> </p> </div> </div> </blockquote> <div class="">Maybe an application has kfd open, but was not accessing the dev. So kill it at unplug could kill the process unnecessarily.</div> <div class="">However, the latest version I had with the sleep function got rid of the IP block fini hang.</div> <blockquote type="cite" class=""> <div class=""> <div class=""> <p class="">Our policy is to let zombie processes (zombie in a sense that the underlying device is gone) live as long as they want <br class=""> (as long as you able to terminate them - which you do, so that ok)<br class=""> and the system should finish PCI remove gracefully and be able to hot plug back the device. Hence, i suggest dropping<br class=""> this direction of forcing all user processes to be killed, confirm you have graceful shutdown and remove of device<br class=""> from PCI topology and then concentrate on why when you plug back it hangs. </p> </div> </div> </blockquote> So I basically revert back to the original solution which you suggested.</div> <div class=""><br class=""> </div> <div class=""> <div class="">diff --git a/drivers/gpu/drm/amd/amdkfd/kfd_device.c b/drivers/gpu/drm/amd/amdkfd/kfd_device.c</div> <div class="">index 4e7d9cb09a69..5504a18b5a45 100644</div> <div class="">--- a/drivers/gpu/drm/amd/amdkfd/kfd_device.c</div> <div class="">+++ b/drivers/gpu/drm/amd/amdkfd/kfd_device.c</div> <div class="">@@ -697,7 +697,7 @@ void kgd2kfd_suspend(struct kfd_dev *kfd, bool run_pm, bool force)</div> <div class=""> return;</div> <div class=""><br class=""> </div> <div class=""> /* for runtime suspend, skip locking kfd */</div> <div class="">- if (!run_pm) {</div> <div class="">+ if (!run_pm && !drm_dev_is_unplugged(kfd->ddev)) {</div> <div class=""> /* For first KFD device suspend all the KFD processes */</div> <div class=""> if (atomic_inc_return(&kfd_locked) == 1)</div> <div class=""> kfd_suspend_all_processes(force);</div> </div> <div class=""><br class=""> </div> <div class=""> <blockquote type="cite" class=""> <div class=""> <p class="">First confirm if ASIC reset happens on<br class=""> next init. </p> </div> </blockquote> <div class=""> <div class="">This patch works great at <b class="">planned</b> plugout, where all the rocm processes are killed before plugout. And device can be added back without a problem.</div> <div class="">However <b class="">unplanned</b> plugout when there is rocm processes are running just don’t work.</div> </div> </div> </div> </blockquote> <p class=""><br class=""> </p> <p class="">Still I am not clear if ASIC reset happens on plug back or no, can you trace this please ?</p> <div class=""><br class=""> </div> </div> </div> </blockquote> <div class=""><br class=""> </div> I tried add pr_info into asic_reset functions, but cannot trace any upon plug-back.<br class=""> </div> </blockquote> <p class=""><br class=""> </p> <p class="">This could possibly explain the hang on plug back. Can you see why we don't get there ?<br class=""> </p> <p class=""><br class=""> </p> </div> </div> </blockquote> Is amdgpu supposed to asic_reset each time when it is probed? I right now it seems to probe ok (it did not hang). I will trace back further<br class=""> </div> </blockquote> <p class=""><br class=""> </p> <p class="">Yep</p> <p class=""><br class=""> </p> <blockquote type="cite" cite="mid:0FD33B90-BD27-4F32-9735-CA525735B5FA@microsoft.com" class=""> <div class=""> <blockquote type="cite" class=""> <div class=""> <div class=""> <blockquote type="cite" cite="mid:7825EEC6-BAF8-4B71-B01C-FE246D360779@microsoft.com" class=""> <div class=""> <blockquote type="cite" class=""> <div class=""> <div class=""> <p class=""><br class=""> </p> <blockquote type="cite" cite="mid:76C16B06-0539-48EE-AB11-80089490CE3A@microsoft.com" class=""> <div class=""> <div class=""> <blockquote type="cite" class=""> <div class=""> <p class="">Second please confirm if the timing you kill manually the user process has impact on whether you have a hang<br class=""> on next plug back (if you kill before </p> </div> </blockquote> <b class="">Scenario 0: Kill before plug back</b></div> <div class=""><br class=""> </div> <div class=""> <div class="">1. echo 1 > /sys/bus/pci/…/remove, would finish. </div> <div class="">But the application won’t exit until there is a kill signal.</div> </div> </div> </blockquote> <p class=""><br class=""> </p> <p class="">Why you think it must exit ? <br class=""> </p> </div> </div> </blockquote> Because rocm will need to release the drm descriptor to get amdgpu_amdkfd_device_fini_sw called, which would eventually call kgd2kfd_device_exit called. This would clean up kfd_topology at least. Otherwise I don’t see how it would be added back without messing up kfd topology to say the least. </div> <div class=""><br class=""> </div> <div class="">However, those are all based my own observations. Please explain why it does not need exit if you believe so?</div> </blockquote> <p class=""><br class=""> </p> <p class="">Note that when you add back a new device, pci device and drm device are created, I am not an expert on KFD code but i believe also a new KFD device is created independent of the old one and so the topology should see just 2 device instances (one old zombie and one real new). I know at least this wasn't an issue for the graphic stack in exact same scenario and the libdrm tests i pointed to test exact this scenario. </p> </div> </div> </blockquote> Yes, regardless of the OOPS in ttm_bo_cleanup_refs, I plugged back the gpu, and I think it got probed all right, however the old kfd node is still there.</div> <div class="">I can passed libdrm basic test suite on the plugged back. The bo test hangs out-of-box even without hotplug (see dmesg below).</div> <div class=""><br class=""> </div> <div class=""> <div class=""> kernel:[ 1609.029125] watchdog: BUG: soft lockup - CPU#39 stuck for 89s! [amdgpu_test:36407]</div> <div class="">[ +0.000407] Code: 48 89 47 18 48 89 47 20 48 89 47 28 48 89 47 30 48 89 47 38 48 8d 7f 40 75 d9 90 c3 0f 1f 80 00 00 00 00 b9 00 10 00 00 31 c0 <f3> aa c3 cc cc cc cc cc cc 0f 1f 44 00 00 48 85 ff 0f 84 f2 00 00</div> <div class="">[ +0.000856] RSP: 0018:ffffb996b57b3c40 EFLAGS: 00010246</div> <div class="">[ +0.000434] RAX: 0000000000000000 RBX: ffff9cc7f8706e88 RCX: 0000000000000980</div> <div class="">[ +0.000436] RDX: fffff935b17d9140 RSI: fffff935b17e0000 RDI: ffff9c831f645680</div> <div class="">[ +0.000439] RBP: 0000000000000400 R08: fffff935b17d0000 R09: 0000000000000000</div> <div class="">[ +0.000447] R10: 0000000000000000 R11: 0000000000000000 R12: 000000000000000a</div> <div class="">[ +0.000437] R13: ffff9cc783980a20 R14: 000000000b5dbc00 R15: ffff9cc7f8706078</div> <div class="">[ +0.000438] FS: 00007ff1ef611300(0000) GS:ffff9d453efc0000(0000) knlGS:0000000000000000</div> <div class="">[ +0.000445] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033</div> <div class="">[ +0.000462] CR2: 00007f418bbb9320 CR3: 000000819fa84006 CR4: 0000000000770ee0</div> <div class="">[ +0.000466] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000</div> <div class="">[ +0.000451] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400</div> <div class="">[ +0.000455] PKRU: 55555554</div> <div class="">[ +0.000451] Call Trace:</div> <div class="">[ +0.000448] ttm_pool_free+0x110/0x230 [ttm]</div> <div class="">[ +0.000451] ttm_tt_unpopulate+0x5e/0xb0 [ttm]</div> <div class="">[ +0.000454] ttm_tt_destroy_common+0xe/0x30 [ttm]</div> <div class="">[ +0.000453] amdgpu_ttm_backend_destroy+0x1e/0x70 [amdgpu]</div> <div class="">[ +0.000569] ttm_bo_cleanup_memtype_use+0x37/0x60 [ttm]</div> <div class="">[ +0.000458] ttm_bo_release+0x286/0x500 [ttm]</div> <div class="">[ +0.000450] amdgpu_bo_unref+0x1a/0x30 [amdgpu]</div> <div class="">[ +0.000544] amdgpu_gem_object_free+0xad/0x160 [amdgpu]</div> <div class="">[ +0.000534] drm_gem_object_release_handle+0x6a/0x80 [drm]</div> <div class="">[ +0.000476] drm_gem_handle_delete+0x5b/0xa0 [drm]</div> <div class="">[ +0.000465] ? drm_gem_handle_create+0x40/0x40 [drm]</div> <div class="">[ +0.000469] drm_ioctl_kernel+0xab/0xf0 [drm]</div> <div class="">[ +0.000458] drm_ioctl+0x1ec/0x390 [drm]</div> <div class="">[ +0.000440] ? drm_gem_handle_create+0x40/0x40 [drm]</div> <div class="">[ +0.000438] ? selinux_file_ioctl+0x17d/0x220</div> <div class="">[ +0.000423] ? lock_release+0x1ce/0x270</div> <div class="">[ +0.000416] ? trace_hardirqs_on+0x1b/0xd0</div> <div class="">[ +0.000418] ? _raw_spin_unlock_irqrestore+0x2d/0x40</div> <div class="">[ +0.000419] amdgpu_drm_ioctl+0x49/0x80 [amdgpu]</div> <div class="">[ +0.000499] __x64_sys_ioctl+0x80/0xb0</div> <div class="">[ +0.000414] do_syscall_64+0x3a/0x70</div> <div class="">[ +0.000400] entry_SYSCALL_64_after_hwframe+0x44/0xae</div> <div class="">[ +0.000387] RIP: 0033:0x7ff1ef7263db</div> <div class="">[ +0.000371] Code: 0f 1e fa 48 8b 05 b5 7a 0d 00 64 c7 00 26 00 00 00 48 c7 c0 ff ff ff ff c3 66 0f 1f 44 00 00 f3 0f 1e fa b8 10 00 00 00 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 8b 0d 85 7a 0d 00 f7 d8 64 89 01 48</div> <div class="">[ +0.000763] RSP: 002b:00007ffdf1cd0278 EFLAGS: 00000246 ORIG_RAX: 0000000000000010</div> <div class="">[ +0.000386] RAX: ffffffffffffffda RBX: 00007ffdf1cd02b0 RCX: 00007ff1ef7263db</div> <div class="">[ +0.000383] RDX: 00007ffdf1cd02b0 RSI: 0000000040086409 RDI: 0000000000000007</div> <div class="">[ +0.000396] RBP: 0000000040086409 R08: 00005574eefd5c60 R09: 00005574eefdd360</div> <div class="">[ +0.000391] R10: 00005574eefd4010 R11: 0000000000000246 R12: 00005574eefd66d8</div> <div class="">[ +0.000386] R13: 0000000000000007 R14: 0000000000000000 R15: 00007ff1ef830143</div> <div class=""><br class=""> </div> <div class=""><br class=""> </div> </div> <div class="">I also tried to run tf benchmark to the newly plugged nodes (one of the node is dummy), but failed. </div> <div class="">Can we have some confirmation from kfd team that they have considered a zombie kfd node?</div> <div class=""><br class=""> </div> <div class=""> <blockquote type="cite" class=""> <div class=""> <div class=""> <p class="">Also note that even with running grpahic stack there is always a KFD device and KFD topology present but of course probably not the same as when u run a KFD facing process so there could be some issues there. <br class=""> </p> <p class="">Also note that because of this patch <a class="moz-txt-link-freetext" href="https://nam06.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgit.kernel.org%2Fpub%2Fscm%2Flinux%2Fkernel%2Fgit%2Ftorvalds%2Flinux.git%2Fcommit%2F%3Fid%3D267d51d77fdae8708b94e1a24b8e5d961297edb7&data=05%7C01%7Cshuotaoxu%40microsoft.com%7C1ce273d333a04fde7dcf08da221de5f7%7C72f988bf86f141af91ab2d7cd011db47%7C1%7C0%7C637859809165306474%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=oTS%2Brv6DOjcwSfKCHDgzrffsn3Qxl1hkfnexUqCRVaY%3D&reserved=0" originalsrc="https://git.kernel.org/pub/scm/linux/kernel/git/torvalds/linux.git/commit/?id=267d51d77fdae8708b94e1a24b8e5d961297edb7" shash="XrFPZiC5p3WLZTU/siQG8EZHfXW4UdPZ1WZfgSzdL3vQdcvm3dJuCf8Wnp89yoxcSS0cqzjFtsH2Kk7pB21LPmSC2hHspru7iIzhsuj07f2PryiL4dUTly49l7fYu2fCP2G2gkCKI4L5T4Fe+MeZRfAQOmNbPXtgGrdty0EB28I=" moz-do-not-send="true"> https://git.kernel.org/pub/scm/linux/kernel/git/torvalds/linux.git/commit/?id=267d51d77fdae8708b94e1a24b8e5d961297edb7</a> all MMIO accesses from such zombie/orphan user processes will be remapped to zero page and so will not necessarily experience a segfault when device removal happnes but rather maybe some crash due to NULL data read from MMIO by the process and used in some manner. <br class=""> </p> </div> </div> </blockquote> It depends on where the application is when the device is plugged out.</div> <div class=""><br class=""> </div> <div class="">For example, in one case, the application keeps saying out-of-memory, but won’t exit.</div> <div class="">For one of the cases. The other case is that it would wait for a signal.</div> <div class=""><br class=""> </div> <div class=""> <div class="">2022-04-18 12:42:38.939303: E tensorflow/stream_executor/rocm/<a href="https://nam06.safelinks.protection.outlook.com/?url=http%3A%2F%2Frocm_driver.cc%3A692%2F&data=05%7C01%7Cshuotaoxu%40microsoft.com%7C1ce273d333a04fde7dcf08da221de5f7%7C72f988bf86f141af91ab2d7cd011db47%7C1%7C0%7C637859809165306474%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=Mo0f7DfzRe8GwXBuCQwA2Gcnn6mzs4lGGRPRCPnEbxQ%3D&reserved=0" originalsrc="http://rocm_driver.cc:692/" shash="ZnZ4OY4+bJEfg2dPfamho6hZZDqr/AW7Ihm0+jMrv7qITNeZSDXrkh8WL+GdUidB0A77y5ppjnRqs/Iz0FjgCbmTzODSMRhhAILts1BvuHRpKCmStSh8fnmk+h+3J1OrceAM0mNt3zo83l4Lra6l3pjjtqI0uM5bDkUfPXHtWwo=" class="" moz-do-not-send="true">rocm_driver.cc:692</a>] failed to alloc 2304 bytes on host: HIP_ERROR_OutOfMemory</div> <div class="">2022-04-18 12:42:38.939322: W ./tensorflow/core/common_runtime/gpu/gpu_host_allocator.h:44] could not allocate pinned host memory of size: 2304</div> <div class="">2022-04-18 12:42:38.940772: E tensorflow/stream_executor/rocm/<a href="https://nam06.safelinks.protection.outlook.com/?url=http%3A%2F%2Frocm_driver.cc%3A692%2F&data=05%7C01%7Cshuotaoxu%40microsoft.com%7C1ce273d333a04fde7dcf08da221de5f7%7C72f988bf86f141af91ab2d7cd011db47%7C1%7C0%7C637859809165306474%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=Mo0f7DfzRe8GwXBuCQwA2Gcnn6mzs4lGGRPRCPnEbxQ%3D&reserved=0" originalsrc="http://rocm_driver.cc:692/" shash="ZnZ4OY4+bJEfg2dPfamho6hZZDqr/AW7Ihm0+jMrv7qITNeZSDXrkh8WL+GdUidB0A77y5ppjnRqs/Iz0FjgCbmTzODSMRhhAILts1BvuHRpKCmStSh8fnmk+h+3J1OrceAM0mNt3zo83l4Lra6l3pjjtqI0uM5bDkUfPXHtWwo=" class="" moz-do-not-send="true">rocm_driver.cc:692</a>] failed to alloc 2304 bytes on host: HIP_ERROR_OutOfMemory</div> <div class="">2022-04-18 12:42:38.940791: W ./tensorflow/core/common_runtime/gpu/gpu_host_allocator.h:44] could not allocate pinned host memory of size: 2304</div> <div class="">2022-04-18 12:42:38.942379: E tensorflow/stream_executor/rocm/<a href="https://nam06.safelinks.protection.outlook.com/?url=http%3A%2F%2Frocm_driver.cc%3A692%2F&data=05%7C01%7Cshuotaoxu%40microsoft.com%7C1ce273d333a04fde7dcf08da221de5f7%7C72f988bf86f141af91ab2d7cd011db47%7C1%7C0%7C637859809165306474%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=Mo0f7DfzRe8GwXBuCQwA2Gcnn6mzs4lGGRPRCPnEbxQ%3D&reserved=0" originalsrc="http://rocm_driver.cc:692/" shash="ZnZ4OY4+bJEfg2dPfamho6hZZDqr/AW7Ihm0+jMrv7qITNeZSDXrkh8WL+GdUidB0A77y5ppjnRqs/Iz0FjgCbmTzODSMRhhAILts1BvuHRpKCmStSh8fnmk+h+3J1OrceAM0mNt3zo83l4Lra6l3pjjtqI0uM5bDkUfPXHtWwo=" class="" moz-do-not-send="true">rocm_driver.cc:692</a>] failed to alloc 2304 bytes on host: HIP_ERROR_OutOfMemory</div> <div class="">2022-04-18 12:42:38.942399: W ./tensorflow/core/common_runtime/gpu/gpu_host_allocator.h:44] could not allocate pinned host memory of size: 2304</div> <div class="">2022-04-18 12:42:38.943829: E tensorflow/stream_executor/rocm/<a href="https://nam06.safelinks.protection.outlook.com/?url=http%3A%2F%2Frocm_driver.cc%3A692%2F&data=05%7C01%7Cshuotaoxu%40microsoft.com%7C1ce273d333a04fde7dcf08da221de5f7%7C72f988bf86f141af91ab2d7cd011db47%7C1%7C0%7C637859809165306474%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=Mo0f7DfzRe8GwXBuCQwA2Gcnn6mzs4lGGRPRCPnEbxQ%3D&reserved=0" originalsrc="http://rocm_driver.cc:692/" shash="ZnZ4OY4+bJEfg2dPfamho6hZZDqr/AW7Ihm0+jMrv7qITNeZSDXrkh8WL+GdUidB0A77y5ppjnRqs/Iz0FjgCbmTzODSMRhhAILts1BvuHRpKCmStSh8fnmk+h+3J1OrceAM0mNt3zo83l4Lra6l3pjjtqI0uM5bDkUfPXHtWwo=" class="" moz-do-not-send="true">rocm_driver.cc:692</a>] failed to alloc 2304 bytes on host: HIP_ERROR_OutOfMemory</div> <div class="">2022-04-18 12:42:38.943849: W ./tensorflow/core/common_runtime/gpu/gpu_host_allocator.h:44] could not allocate pinned host memory of size: 2304</div> <div class="">2022-04-18 12:42:38.945272: E tensorflow/stream_executor/rocm/<a href="https://nam06.safelinks.protection.outlook.com/?url=http%3A%2F%2Frocm_driver.cc%3A692%2F&data=05%7C01%7Cshuotaoxu%40microsoft.com%7C1ce273d333a04fde7dcf08da221de5f7%7C72f988bf86f141af91ab2d7cd011db47%7C1%7C0%7C637859809165306474%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=Mo0f7DfzRe8GwXBuCQwA2Gcnn6mzs4lGGRPRCPnEbxQ%3D&reserved=0" originalsrc="http://rocm_driver.cc:692/" shash="ZnZ4OY4+bJEfg2dPfamho6hZZDqr/AW7Ihm0+jMrv7qITNeZSDXrkh8WL+GdUidB0A77y5ppjnRqs/Iz0FjgCbmTzODSMRhhAILts1BvuHRpKCmStSh8fnmk+h+3J1OrceAM0mNt3zo83l4Lra6l3pjjtqI0uM5bDkUfPXHtWwo=" class="" moz-do-not-send="true">rocm_driver.cc:692</a>] failed to alloc 2304 bytes on host: HIP_ERROR_OutOfMemory</div> <div class="">2022-04-18 12:42:38.945292: W ./tensorflow/core/common_runtime/gpu/gpu_host_allocator.h:44] could not allocate pinned host memory of size: 2304</div> </div> <div class=""> <div class=""><br class=""> </div> </div> <div class=""> <blockquote type="cite" class=""> <div class=""> <div class=""> <p class=""><br class=""> </p> <blockquote type="cite" cite="mid:7825EEC6-BAF8-4B71-B01C-FE246D360779@microsoft.com" class=""> <div class=""> <blockquote type="cite" class=""> <div class=""> <div class=""> <blockquote type="cite" cite="mid:76C16B06-0539-48EE-AB11-80089490CE3A@microsoft.com" class=""> <div class=""> <div class=""> <div class=""><br class=""> </div> <div class="">2. kill the the process. The application does several things and seems trigger drm_release in the kernel, which are met with kernel NULL pointer deference related to sysfs_remove. Then the whole fs just freeze.</div> <div class=""><br class=""> </div> <div class=""> <div class="">[ +0.002498] BUG: kernel NULL pointer dereference, address: 0000000000000098</div> <div class="">[ +0.000486] #PF: supervisor read access in kernel mode</div> <div class="">[ +0.000545] #PF: error_code(0x0000) - not-present page</div> <div class="">[ +0.000551] PGD 0 P4D 0</div> <div class="">[ +0.000553] Oops: 0000 [#1] SMP NOPTI</div> <div class="">[ +0.000540] CPU: 75 PID: 4911 Comm: kworker/75:2 Tainted: G W E 5.13.0-kfd #1</div> <div class="">[ +0.000559] Hardware name: INGRASYS TURING /MB , BIOS K71FQ28A 10/05/2021</div> <div class="">[ +0.000567] Workqueue: events delayed_fput</div> <div class="">[ +0.000563] RIP: 0010:kernfs_find_ns+0x1b/0x100</div> <div class="">[ +0.000569] Code: ff ff e8 88 59 9f 00 0f 1f 84 00 00 00 00 00 0f 1f 44 00 00 41 57 8b 05 df f0 7b 01 41 56 41 55 49 89 f5 41 54 55 48 89 fd 53 <44> 0f b7 b7 98 00 00 00 48 89 d3 4c 8b 67 70 66 41 83 e6 20 41 0f</div> <div class="">[ +0.001193] RSP: 0018:ffffb9875db5fc98 EFLAGS: 00010246</div> <div class="">[ +0.000602] RAX: 0000000000000000 RBX: ffffa101f79507d8 RCX: 0000000000000000</div> <div class="">[ +0.000612] RDX: 0000000000000000 RSI: ffffffffc09a9417 RDI: 0000000000000000</div> <div class="">[ +0.000604] RBP: 0000000000000000 R08: 0000000000000001 R09: 0000000000000000</div> <div class="">[ +0.000760] R10: ffffb9875db5fcd0 R11: 0000000000000000 R12: 0000000000000000</div> <div class="">[ +0.000597] R13: ffffffffc09a9417 R14: ffffa08363fb2d18 R15: 0000000000000000</div> <div class="">[ +0.000702] FS: 0000000000000000(0000) GS:ffffa0ffbfcc0000(0000) knlGS:0000000000000000</div> <div class="">[ +0.000666] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033</div> <div class="">[ +0.000658] CR2: 0000000000000098 CR3: 0000005747812005 CR4: 0000000000770ee0</div> <div class="">[ +0.000715] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000</div> <div class="">[ +0.000655] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400</div> <div class="">[ +0.000592] PKRU: 55555554</div> <div class="">[ +0.000580] Call Trace:</div> <div class="">[ +0.000591] kernfs_find_and_get_ns+0x2f/0x50</div> <div class="">[ +0.000584] sysfs_remove_file_from_group+0x20/0x50</div> <div class="">[ +0.000580] amdgpu_ras_sysfs_remove+0x3d/0xd0 [amdgpu]</div> <div class="">[ +0.000737] amdgpu_ras_late_fini+0x1d/0x40 [amdgpu]</div> <div class="">[ +0.000750] amdgpu_sdma_ras_fini+0x96/0xb0 [amdgpu]</div> <div class="">[ +0.000742] ? gfx_v10_0_resume+0x10/0x10 [amdgpu]</div> <div class="">[ +0.000738] sdma_v4_0_sw_fini+0x23/0x90 [amdgpu]</div> <div class="">[ +0.000717] amdgpu_device_fini_sw+0xae/0x260 [amdgpu]</div> <div class="">[ +0.000704] amdgpu_driver_release_kms+0x12/0x30 [amdgpu]</div> <div class="">[ +0.000687] drm_dev_release+0x20/0x40 [drm]</div> <div class="">[ +0.000583] drm_release+0xa8/0xf0 [drm]</div> <div class="">[ +0.000584] __fput+0xa5/0x250</div> <div class="">[ +0.000621] delayed_fput+0x1f/0x30</div> <div class="">[ +0.000726] process_one_work+0x26e/0x580</div> <div class="">[ +0.000581] ? process_one_work+0x580/0x580</div> <div class="">[ +0.000611] worker_thread+0x4d/0x3d0</div> <div class="">[ +0.000611] ? process_one_work+0x580/0x580</div> <div class="">[ +0.000605] kthread+0x117/0x150</div> <div class="">[ +0.000611] ? kthread_park+0x90/0x90</div> <div class="">[ +0.000619] ret_from_fork+0x1f/0x30</div> <div class="">[ +0.000625] Modules linked in: amdgpu(E) xt_conntrack xt_MASQUERADE nfnetlink xt_addrtype iptable_filter iptable_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 br_netfilter x86_pkg_temp_thermal cdc_ether usbnet acpi_pad msr ip_tables x_tables ast drm_vram_helper iommu_v2 drm_ttm_helper gpu_sched ttm drm_kms_helper cfbfillrect syscopyarea cfbimgblt sysfillrect sysimgblt fb_sys_fops cfbcopyarea drm drm_panel_orientati</div> <div class="">on_quirks [last unloaded: amdgpu]</div> </div> </div> </div> </blockquote> <p class=""><br class=""> </p> <p class="">This is a known regression, all SYSFS components must be removed before pci_remove code runs otherwise you get either warnings for single file removals or<br class=""> OOPSEs for sysfs gorup removals like here. Please try to move amdgpu_ras_sysfs_remove from amdgpu_ras_late_fini to the end of amdgpu_ras_pre_fini (which happens before pci remove)</p> <div class=""><br class=""> </div> </div> </div> </blockquote> <div class=""><br class=""> </div> I fixed it in the newer patch, please see it below.</div> </blockquote> <p class=""><br class=""> </p> <p class=""><br class=""> </p> <blockquote type="cite" cite="mid:7825EEC6-BAF8-4B71-B01C-FE246D360779@microsoft.com" class=""> <div class="">I first plugout the device, then kill the rocm user process. Then it has other OOPSES related to ttm_bo_cleanup_refs.</div> <div class=""><br class=""> </div> <div class="">[ +0.000006] BUG: kernel NULL pointer dereference, address: 0000000000000010<br class=""> [ +0.000349] #PF: supervisor read access in kernel mode<br class=""> [ +0.000340] #PF: error_code(0x0000) - not-present page<br class=""> [ +0.000341] PGD 0 P4D 0<br class=""> [ +0.000336] Oops: 0000 [#1] SMP NOPTI<br class=""> [ +0.000345] CPU: 9 PID: 95 Comm: kworker/9:1 Tainted: G W E 5.13.0-kfd #1<br class=""> [ +0.000367] Hardware name: INGRASYS TURING /MB , BIOS K71FQ28A 10/05/2021<br class=""> [ +0.000376] Workqueue: events delayed_fput<br class=""> [ +0.000422] RIP: 0010:ttm_resource_free+0x24/0x40 [ttm]<br class=""> [ +0.000464] Code: 00 00 0f 1f 40 00 0f 1f 44 00 00 53 48 89 f3 48 8b 36 48 85 f6 74 21 48 8b 87 28 02 00 00 48 63 56 10 48 8b bc d0 b8 00 00 00 <48> 8b 47 10 ff 50 08 48 c7 03 00 00 00 00 5b c3 66 66 2e 0f 1f 84<br class=""> [ +0.001009] RSP: 0018:ffffb21c59413c98 EFLAGS: 00010282<br class=""> [ +0.000515] RAX: ffff8b1aa4285f68 RBX: ffff8b1a823b5ea0 RCX: 00000000002a000c<br class=""> [ +0.000536] RDX: 0000000000000000 RSI: ffff8b1acb84db80 RDI: 0000000000000000<br class=""> [ +0.000539] RBP: 0000000000000001 R08: 0000000000000000 R09: ffffffffc03c3e00<br class=""> [ +0.000543] R10: 0000000000000000 R11: 0000000000000000 R12: ffff8b1a823b5ec8<br class=""> [ +0.000542] R13: 0000000000000000 R14: ffff8b1a823b5d90 R15: ffff8b1a823b5ec8<br class=""> [ +0.000544] FS: 0000000000000000(0000) GS:ffff8b187f440000(0000) knlGS:0000000000000000<br class=""> [ +0.000559] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033<br class=""> [ +0.000575] CR2: 0000000000000010 CR3: 00000076e6812004 CR4: 0000000000770ee0<br class=""> [ +0.000575] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000<br class=""> [ +0.000579] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400<br class=""> [ +0.000575] PKRU: 55555554<br class=""> [ +0.000568] Call Trace:<br class=""> [ +0.000567] ttm_bo_cleanup_refs+0xe4/0x290 [ttm]<br class=""> [ +0.000588] ttm_bo_delayed_delete+0x147/0x250 [ttm]<br class=""> [ +0.000589] ttm_device_fini+0xad/0x1b0 [ttm]<br class=""> [ +0.000590] amdgpu_ttm_fini+0x2a7/0x310 [amdgpu]<br class=""> [ +0.000730] gmc_v9_0_sw_fini+0x3a/0x40 [amdgpu]<br class=""> [ +0.000753] amdgpu_device_fini_sw+0xae/0x260 [amdgpu]<br class=""> [ +0.000734] amdgpu_driver_release_kms+0x12/0x30 [amdgpu]<br class=""> [ +0.000737] drm_dev_release+0x20/0x40 [drm]<br class=""> [ +0.000626] drm_release+0xa8/0xf0 [drm]<br class=""> [ +0.000625] __fput+0xa5/0x250<br class=""> [ +0.000606] delayed_fput+0x1f/0x30<br class=""> [ +0.000607] process_one_work+0x26e/0x580<br class=""> [ +0.000608] ? process_one_work+0x580/0x580<br class=""> [ +0.000616] worker_thread+0x4d/0x3d0<br class=""> [ +0.000614] ? process_one_work+0x580/0x580<br class=""> [ +0.000617] kthread+0x117/0x150<br class=""> [ +0.000615] ? kthread_park+0x90/0x90<br class=""> [ +0.000621] ret_from_fork+0x1f/0x30<br class=""> [ +0.000603] Modules linked in: amdgpu(E) xt_conntrack xt_MASQUERADE nfnetlink xt_addrtype iptable_filter iptable_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 br_netfilter x86_pkg_temp_thermal cdc_ether usbnet acpi_pad msr ip_tables x_tables ast drm_vram_helper drm_ttm_helper iommu_v2 ttm gpu_sched drm_kms_helper cfbfillrect syscopyarea cfbimgblt sysfillrect sysimgblt fb_sys_fops cfbcopyarea drm drm_panel_orientation_quirks [last unloaded: amdgpu]<br class=""> [ +0.002840] CR2: 0000000000000010<br class=""> <div class=""> <div class=""><font class=""><span style="caret-color: rgb(0, 0, 0);" class="">[ +0.000755] ---[ end trace 9737737402551e39 ]--</span></font></div> </div> </div> </blockquote> <p class=""><br class=""> </p> <p class="">This looks like another regression - try seeing where is the NULL reference and then we can see how to avoid this. <br class=""> </p> <p class=""><br class=""> </p> </div> </div> </blockquote> Those are the line of code.</div> <div class=""><br class=""> <div class="">(gdb) l *(ttm_bo_cleanup_refs+0xe4)</div> <div class="">0x19c4 is in ttm_bo_cleanup_refs (drivers/gpu/drm/ttm/ttm_bo.c:360).</div> <div class="">355 ttm_bo_move_to_pinned(bo);</div> <div class="">356 list_del_init(&bo->ddestroy);</div> <div class="">357 spin_unlock(&bo->bdev->lru_lock);</div> <div class=""><font class="" color="#ff2600">358 ttm_bo_cleanup_memtype_use(bo);</font></div> <div class="">359</div> <div class="">360 if (unlock_resv)</div> <div class="">361 dma_resv_unlock(amdkcl_ttm_resvp(bo));</div> <div class="">362</div> <div class="">363 ttm_bo_put(bo);</div> <div class="">364</div> <div class="">(gdb) l *(ttm_resource_free+0x24)</div> <div class="">0x57f4 is in ttm_resource_free (drivers/gpu/drm/ttm/ttm_resource.c:65).</div> <div class="">60</div> <div class="">61 if (!*res)</div> <div class="">62 return;</div> <div class="">63</div> <div class="">64 man = ttm_manager_type(bo->bdev, (*res)->mem_type);</div> <div class=""><font class="" color="#ff2600">65 man->func->free(man, *res);</font></div> <div class="">66 *res = NULL;</div> <div class="">67 }</div> <div class="">68 EXPORT_SYMBOL(ttm_resource_free);</div> <div class="">69</div> <blockquote type="cite" class=""> <div class=""> <div class=""> <blockquote type="cite" cite="mid:7825EEC6-BAF8-4B71-B01C-FE246D360779@microsoft.com" class=""> <div class=""><br class=""> <blockquote type="cite" class=""> <div class=""> <div class=""> <blockquote type="cite" cite="mid:76C16B06-0539-48EE-AB11-80089490CE3A@microsoft.com" class=""> <div class=""> <div class=""> <div class=""> <div class=""><br class=""> </div> <div class="">3. echo 1 > /sys/bus/pci/rescan. This would just hang. I assume the sysfs is broken.</div> <div class=""><br class=""> </div> <div class="">Based on 1 & 2, it seems that 1 won’t let the amdgpu exit gracefully, because 2 will do some cleanup maybe should have happened before 1.</div> <div class=""> <blockquote type="cite" class=""> <div class=""> <p class="">or you kill after plug back does it makes a difference). <br class=""> </p> </div> </blockquote> </div> <div class=""><b class="">Scenario 2: Kill after plug back</b></div> <div class=""><br class=""> </div> <div class="">If I perform rescan before kill, then the driver seemed probed fine. But kill will have the same issue which messed up the sysfs the same way as in Scenario 2.</div> <div class=""><br class=""> </div> <div class=""><br class=""> </div> <div class=""><b class="">Final Comments:</b></div> <div class=""><br class=""> </div> <span class="">0. cancel_delayed_work_sync(&p_info->restore_userptr_work) would make the repletion of </span>amdgpu_vm_bo_update failure go away, but it does not solve the issues in those scenarios.</div> </div> </div> </blockquote> <p class=""><br class=""> </p> <p class="">Still - it's better to do it this way even for those failures to go awaya</p> <div class=""><br class=""> </div> </div> </div> </blockquote> Cancel_delayed_work is insufficient, you will need to make sure the work won’t be processed after plugout. Please see my patch<br class=""> </div> </blockquote> <p class=""><br class=""> </p> <p class="">Saw, see my comment.</p> <p class=""><br class=""> </p> <blockquote type="cite" cite="mid:7825EEC6-BAF8-4B71-B01C-FE246D360779@microsoft.com" class=""> <div class=""> <blockquote type="cite" class=""> <div class=""> <div class=""> <p class=""><br class=""> </p> <blockquote type="cite" cite="mid:76C16B06-0539-48EE-AB11-80089490CE3A@microsoft.com" class=""> <div class=""> <div class=""> <div class=""><span class=""><br class=""> </span> <div class="">1. For planned hotplug, this patch should work as long as you follow some protocol, i.e. kill before plugout. Is this patch an acceptable one since it provides some added feature than before?</div> </div> </div> </div> </blockquote> <p class=""><br class=""> </p> <p class="">Let's try to fix more as I advised above. <br class=""> </p> <p class=""><br class=""> </p> <blockquote type="cite" cite="mid:76C16B06-0539-48EE-AB11-80089490CE3A@microsoft.com" class=""> <div class=""> <div class=""> <div class=""> <div class=""><br class=""> </div> <div class="">2. For unplanned hotplug when there is rocm app running, the patch that kill all processes and wait for 5 sec would work consistently. But it seems that it is an unacceptable solution for official release. I can hold it for our own internal usage. It seems that kill after removal would cause problems, and I don’t know if there is a quick fix by me because of my limited understanding of the amdgpu driver. Maybe AMD could have a quick fix; Or it is really a difficult one. This feature may or may not be a blocking issue in our GPU disaggregation research down the way. Please let us know for either cases, and we would like to learn and help as much as we could!</div> </div> </div> </div> </blockquote> <p class=""><br class=""> </p> <p class="">I am currently not sure why it helps. I will need to setup my own ROCm setup and retest hot plug to check this in more depth but currently i have higher priorities. Please try to confirm ASIC reset always takes place on plug back<br class=""> and fix the sysfs OOPs as I advised above to clear up at least some of the issues. Also please describe to me exactly what you steps to reproduce this scenario so later I might be able to do it myself.</p> <div class=""><br class=""> </div> </div> </div> </blockquote> <div class="">I can still try to help to fix the bug in my spare time. My setup is as follows</div> <div class=""><br class=""> </div> <div class=""> <ol class=""> <li class="">I have a server with 4 AMD MI100 GPUs. I think 1 GPU would also work.</li><li class="">I used the <a href="https://nam06.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2FRadeonOpenCompute%2FROCK-Kernel-Driver%2Ftree%2Froc-5.0.x&data=05%7C01%7Cshuotaoxu%40microsoft.com%7C1ce273d333a04fde7dcf08da221de5f7%7C72f988bf86f141af91ab2d7cd011db47%7C1%7C0%7C637859809165306474%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=BigmopnuPSHNpwYjKPOKvsdyFPHVcZRLPgzR3PuvXbU%3D&reserved=0" originalsrc="https://github.com/RadeonOpenCompute/ROCK-Kernel-Driver/tree/roc-5.0.x" shash="YO4hp/PYWzZH8Y+im5+veoyqeFAXx13qbtQZMtvKqSfIaKJ2i0OkdwPSen9Lwp2e2F6fxTlm1dpBwEqWb5+QXVC74sfHvgCPiLUeQ+EAr3KE9XbqHOepESml+dOMmm8/7oO2RD0AR+ELZlUMSsD181EKzx6J2grDB8LqvrT3lRQ=" class="" moz-do-not-send="true">https://github.com/RadeonOpenCompute/ROCK-Kernel-Driver/tree/roc-5.0.x</a> as the starting point, and apply Mukul’s patch and my patch.</li><li class="">Then I run a tensorflow benchmark from a docker.</li><ul class=""> <li class="">docker run -it --device=/dev/kfd --device=/dev/dri --group-add video rocm/tensorflow:rocm4.5.2-tf1.15-dev</li><li class="">And run the following benchmark in the docker: python benchmarks/scripts/tf_cnn_benchmarks/tf_cnn_benchmarks.py --num_gpus=4 --batch_size=32 --model=resnet50 --variable_update=parameter_server</li><ul class=""> <li class="">Might to need to adjust num_gpus parameter based on your setup</li></ul> </ul> <li class="">Remove a GPU at random time.</li><li class="">Do whatever is needed to before plugback and reverify the benchmark can still run.</li></ol> </div> <blockquote type="cite" class=""> <div class=""> <div class=""> <p class="">Also, we have hotplug test suite in libdrm (graphic stack), so maybe u can install libdrm and run that test suite to see if it exposes more issues.<br class=""> </p> </div> </div> </blockquote> OK I could try it some time.</div> <div class=""><br class=""> </div> </blockquote> </div> </div> </blockquote> <div class=""><br class=""> </div> <div class="">I tried suite 13, the hotplugout test, but it says it got killed? There are a some oops from dmesg during ttm_pool_free_page.</div> <div class=""><br class=""> </div> <div class="">Userspace log:</div> <div class=""><br class=""> </div> <div class="">$ sudo ./tests/amdgpu/amdgpu_test -f -s 13</div> <div class=""><br class=""> </div> <div class=""><br class=""> </div> <div class="">The ASIC NOT support UVD, suite disabled</div> <div class=""><br class=""> </div> <div class=""><br class=""> </div> <div class="">The ASIC NOT support VCE, suite disabled</div> <div class=""><br class=""> </div> <div class=""><br class=""> </div> <div class="">The ASIC NOT support UVD ENC, suite disabled.</div> <div class=""><br class=""> </div> <div class=""><br class=""> </div> <div class="">Don't support TMZ (trust memory zone), security suite disabled</div> <div class=""><br class=""> </div> <div class=""><br class=""> </div> <div class=""> CUnit - A unit testing framework for C - Version 2.1-3</div> <div class=""> <a href="https://nam06.safelinks.protection.outlook.com/?url=http%3A%2F%2Fcunit.sourceforge.net%2F&data=05%7C01%7Cshuotaoxu%40microsoft.com%7C1ce273d333a04fde7dcf08da221de5f7%7C72f988bf86f141af91ab2d7cd011db47%7C1%7C0%7C637859809165356475%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=PqV7be8A1lX%2Bn%2BmOihvTC6ZKdx4eUhm8Krz2VmU5ec8%3D&reserved=0" originalsrc="http://cunit.sourceforge.net/" shash="aM+WXIrTB+byuk+3xam+5vBfccAjfS0Zwpabq8WUHxP+26Lo7q5L5XNkPccTHQXEnfjtZ65I+DXiTMB+waqnwK4ynmqiRzv6eiLgmzZ9qfIvAxbAxnRL4zb19MGk11TKfDe8vsXGRw7TaMaSgWF9XMuYr1mt6huhHPsybSZrY3k=" class="" moz-do-not-send="true">http://cunit.sourceforge.net/</a></div> <div class=""><br class=""> </div> <div class=""><br class=""> </div> <div class="">Suite: Hotunplug Tests</div> <div class=""> Test: Unplug card and rescan the bus to plug it back …Killed</div> <div class=""><br class=""> </div> <div class="">Dmesg log:</div> <div class=""> <div class="">[ +0.000479] BUG: unable to handle page fault for address: ffffc01343fc81b4</div> <div class="">[ +0.000054] #PF: supervisor write access in kernel mode</div> <div class="">[ +0.000033] #PF: error_code(0x0002) - not-present page</div> <div class="">[ +0.000032] PGD 807ffc1067 P4D 807ffc1067 PUD 807ffc0067 PMD 0</div> <div class="">[ +0.000038] Oops: 0002 [#1] SMP NOPTI</div> <div class="">[ +0.000025] CPU: 92 PID: 7534 Comm: amdgpu_test Tainted: G W E 5.13.0-kfd #1</div> <div class="">[ +0.000048] Hardware name: INGRASYS TURING /MB , BIOS K71FQ28A 10/05/2021</div> <div class="">[ +0.000045] RIP: 0010:__free_pages+0xc/0x80</div> <div class="">[ +0.000031] Code: 01 00 74 0f 0f b6 77 51 85 f6 74 07 31 d2 e9 3b dc ff ff e9 66 ff ff ff 66 0f 1f 44 00 00 0f 1f 44 00 00 41 54 55 48 89 fd 53 <f0> ff 4f 34 74 46 48 8b 07 a9 00 00 01 00 75 54 44 8d 66 ff 85 f6</div> <div class="">[ +0.000103] RSP: 0018:ffff96f71ba6fd60 EFLAGS: 00010246</div> <div class="">[ +0.000032] RAX: 00000000ffffffff RBX: ffff89f1ccf86078 RCX: 0000000003fc8180</div> <div class="">[ +0.000041] RDX: ffff89f1b4746000 RSI: 0000000000000000 RDI: ffffc01343fc8180</div> <div class="">[ +0.000042] RBP: ffffc01343fc8180 R08: 0000000000000000 R09: 0000000000000246</div> <div class="">[ +0.000040] R10: 00000080b4746fff R11: 0000000000000003 R12: 0000000000000000</div> <div class="">[ +0.000041] R13: ffff89f1ccf85f80 R14: ffff89f1ccf86ef8 R15: ffff8972293b0000</div> <div class="">[ +0.000042] FS: 00007fcfb843a300(0000) GS:ffff89ef80100000(0000) knlGS:0000000000000000</div> <div class="">[ +0.000046] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033</div> <div class="">[ +0.000033] CR2: ffffc01343fc81b4 CR3: 0000000178154006 CR4: 0000000000770ee0</div> <div class="">[ +0.000041] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000</div> <div class="">[ +0.000041] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400</div> <div class="">[ +0.000041] PKRU: 55555554</div> <div class="">[ +0.000017] Call Trace:</div> <div class="">[ +0.000018] ttm_pool_free_page+0x69/0x90 [ttm]</div> <div class="">[ +0.000038] ttm_pool_type_fini+0x58/0x70 [ttm]</div> <div class="">[ +0.000034] ttm_pool_fini+0x30/0x50 [ttm]</div> <div class="">[ +0.000031] ttm_device_fini+0xf3/0x1b0 [ttm]</div> <div class="">[ +0.000032] amdgpu_ttm_fini+0x2a7/0x310 [amdgpu]</div> <div class="">[ +0.000265] gmc_v9_0_sw_fini+0x3a/0x40 [amdgpu]</div> <div class="">[ +0.000246] amdgpu_device_fini_sw+0xae/0x260 [amdgpu]</div> <div class="">[ +0.000219] amdgpu_driver_release_kms+0x12/0x30 [amdgpu]</div> <div class="">[ +0.000219] drm_dev_release+0x20/0x40 [drm]</div> <div class="">[ +0.000059] drm_release+0xa8/0xf0 [drm]</div> <div class="">[ +0.000053] __fput+0xa5/0x250</div> <div class="">[ +0.000023] task_work_run+0x5c/0xa0</div> <div class="">[ +0.000026] exit_to_user_mode_prepare+0x1db/0x1e0</div> <div class="">[ +0.000033] syscall_exit_to_user_mode+0x19/0x50</div> <div class="">[ +0.000030] do_syscall_64+0x47/0x70</div> <div class="">[ +0.000018] entry_SYSCALL_64_after_hwframe+0x44/0xae</div> <div class="">[ +0.000025] RIP: 0033:0x7fcfb86403d7</div> <div class="">[ +0.000869] Code: 64 89 02 48 c7 c0 ff ff ff ff eb bb 0f 1f 80 00 00 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 b8 03 00 00 00 0f 05 <48> 3d 00 f0 ff ff 77 41 c3 48 83 ec 18 89 7c 24 0c e8 f3 fb ff ff</div> <div class="">[ +0.001788] RSP: 002b:00007ffc8fc26c28 EFLAGS: 00000246 ORIG_RAX: 0000000000000003</div> <div class="">[ +0.000888] RAX: 0000000000000000 RBX: 000055d67a05b6a0 RCX: 00007fcfb86403d7</div> <div class="">[ +0.000867] RDX: 00007fcfb8627be0 RSI: 0000000000000000 RDI: 0000000000000003</div> <div class="">[ +0.000846] RBP: 000055d67a05b8a0 R08: 0000000000000007 R09: 0000000000000000</div> <div class="">[ +0.000816] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000</div> <div class="">[ +0.000791] R13: 0000000000000000 R14: 0000000000000000 R15: 00007fcfb8659143</div> <div class="">[ +0.000770] Modules linked in: amdgpu(E) xt_conntrack xt_MASQUERADE nfnetlink xt_addrtype iptable_filter iptable_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 br_netfilter x86_pkg_temp_thermal cdc_ether usbnet acpi_pad msr ip_tables x_tables ast drm_vram_helper drm_ttm_helper ttm iommu_v2 gpu_sched drm_kms_helper cfbfillrect syscopyarea cfbimgblt sysfillrect sysimgblt fb_sys_fops cfbcopyarea drm drm_panel_orientation_quirks [last unloaded: amdgpu]</div> <div class="">[ +0.003303] CR2: ffffc01343fc81b4</div> <div class="">[ +0.000799] ---[ end trace 2360927435b19009 ]—</div> <div class=""><br class=""> </div> </div> <div class=""><br class=""> </div> <div class=""><br class=""> </div> <blockquote type="cite" class=""> <div class=""> <div class=""> <blockquote type="cite" cite="mid:7825EEC6-BAF8-4B71-B01C-FE246D360779@microsoft.com" class=""> <div class="">The following is the new diff.</div> <div class=""><br class=""> </div> <div class=""> <div class="">diff --git a/drivers/gpu/drm/amd/amdgpu/amdgpu.h b/drivers/gpu/drm/amd/amdgpu/amdgpu.h</div> <div class="">index 182b7eae598a..48c3cd4054de 100644</div> <div class="">--- a/drivers/gpu/drm/amd/amdgpu/amdgpu.h</div> <div class="">+++ b/drivers/gpu/drm/amd/amdgpu/amdgpu.h</div> <div class="">@@ -1327,7 +1327,7 @@ int emu_soc_asic_init(struct amdgpu_device *adev);</div> <div class=""> * ASICs macro.</div> <div class=""> */</div> <div class=""> #define amdgpu_asic_set_vga_state(adev, state) (adev)->asic_funcs->set_vga_state((adev), (state))</div> <div class="">-#define amdgpu_asic_reset(adev) (adev)->asic_funcs->reset((adev))</div> <div class="">+#define amdgpu_asic_reset(adev) ({int r; pr_info("performing amdgpu_asic_reset\n"); r = (adev)->asic_funcs->reset((adev));r;})</div> <div class=""> #define amdgpu_asic_reset_method(adev) (adev)->asic_funcs->reset_method((adev))</div> <div class=""> #define amdgpu_asic_get_xclk(adev) (adev)->asic_funcs->get_xclk((adev))</div> <div class=""> #define amdgpu_asic_set_uvd_clocks(adev, v, d) (adev)->asic_funcs->set_uvd_clocks((adev), (v), (d))</div> <div class="">diff --git a/drivers/gpu/drm/amd/amdgpu/amdgpu_amdkfd.h b/drivers/gpu/drm/amd/amdgpu/amdgpu_amdkfd.h</div> <div class="">index 27c74fcec455..842abd7150a6 100644</div> <div class="">--- a/drivers/gpu/drm/amd/amdgpu/amdgpu_amdkfd.h</div> <div class="">+++ b/drivers/gpu/drm/amd/amdgpu/amdgpu_amdkfd.h</div> <div class="">@@ -134,6 +134,7 @@ struct amdkfd_process_info {</div> <div class=""> </div> <div class=""> <span class="Apple-tab-span" style="white-space:pre"> </span>/* MMU-notifier related fields */</div> <div class=""> <span class="Apple-tab-span" style="white-space:pre"> </span>atomic_t evicted_bos;</div> <div class="">+<span class="Apple-tab-span" style="white-space:pre"> </span>atomic_t invalid;</div> <div class=""> <span class="Apple-tab-span" style="white-space:pre"> </span>struct delayed_work restore_userptr_work;</div> <div class=""> <span class="Apple-tab-span" style="white-space:pre"> </span>struct pid *pid;</div> <div class=""> };</div> <div class="">diff --git a/drivers/gpu/drm/amd/amdgpu/amdgpu_amdkfd_gpuvm.c b/drivers/gpu/drm/amd/amdgpu/amdgpu_amdkfd_gpuvm.c</div> <div class="">index 99d2b15bcbf3..2a588eb9f456 100644</div> <div class="">--- a/drivers/gpu/drm/amd/amdgpu/amdgpu_amdkfd_gpuvm.c</div> <div class="">+++ b/drivers/gpu/drm/amd/amdgpu/amdgpu_amdkfd_gpuvm.c</div> <div class="">@@ -1325,6 +1325,7 @@ static int init_kfd_vm(struct amdgpu_vm *vm, void **process_info,</div> <div class=""> </div> <div class=""> <span class="Apple-tab-span" style="white-space:pre"> </span>info->pid = get_task_pid(current->group_leader, PIDTYPE_PID);</div> <div class=""> <span class="Apple-tab-span" style="white-space:pre"> </span>atomic_set(&info->evicted_bos, 0);</div> <div class="">+<span class="Apple-tab-span" style="white-space:pre"> </span>atomic_set(&info->invalid, 0);</div> <div class=""> <span class="Apple-tab-span" style="white-space:pre"> </span>INIT_DELAYED_WORK(&info->restore_userptr_work,</div> <div class=""> <span class="Apple-tab-span" style="white-space:pre"> </span> amdgpu_amdkfd_restore_userptr_worker);</div> <div class=""> </div> <div class="">@@ -2693,6 +2694,9 @@ static void amdgpu_amdkfd_restore_userptr_worker(struct work_struct *work)</div> <div class=""> <span class="Apple-tab-span" style="white-space:pre"> </span>struct mm_struct *mm;</div> <div class=""> <span class="Apple-tab-span" style="white-space:pre"> </span>int evicted_bos;</div> <div class=""> </div> <div class="">+<span class="Apple-tab-span" style="white-space:pre"> </span>if (atomic_read(&process_info->invalid))</div> <div class="">+<span class="Apple-tab-span" style="white-space:pre"> </span>return;</div> <div class="">+</div> </div> </blockquote> <p class=""><br class=""> </p> <p class="">Probably better to again use drm_dev_enter/exit guard pair instead of this flag.</p> <div class=""><br class=""> </div> </div> </div> </blockquote> <div class=""><br class=""> </div> I don’t know if I could use drm_dev_enter/exit efficiently because a process can have multiple drm_dev open. And I don’t know how I can recover/refer drm_dev(s) efficiently in the worker function in order to use drm_dev_enter/exit.<br class=""> </div> </blockquote> <p class=""><br class=""> </p> <p class="">I think that within the KFD code each kfd device belongs or points to one specific drm_device so I don't think this is a problem.</p> <p class=""><br class=""> </p> <blockquote type="cite" cite="mid:0FD33B90-BD27-4F32-9735-CA525735B5FA@microsoft.com" class=""> <div class=""> <blockquote type="cite" class=""> <div class=""> <div class=""> <p class=""><br class=""> </p> <blockquote type="cite" cite="mid:7825EEC6-BAF8-4B71-B01C-FE246D360779@microsoft.com" class=""> <div class=""> <div class=""> <span class="Apple-tab-span" style="white-space:pre"> </span>evicted_bos = atomic_read(&process_info->evicted_bos);</div> <div class=""> <span class="Apple-tab-span" style="white-space:pre"> </span>if (!evicted_bos)</div> <div class=""> <span class="Apple-tab-span" style="white-space:pre"> </span>return;</div> <div class="">diff --git a/drivers/gpu/drm/amd/amdgpu/amdgpu_device.c b/drivers/gpu/drm/amd/amdgpu/amdgpu_device.c</div> <div class="">index ec38517ab33f..e7d85d8d282d 100644</div> <div class="">--- a/drivers/gpu/drm/amd/amdgpu/amdgpu_device.c</div> <div class="">+++ b/drivers/gpu/drm/amd/amdgpu/amdgpu_device.c</div> <div class="">@@ -1054,6 +1054,7 @@ void amdgpu_device_program_register_sequence(struct amdgpu_device *adev,</div> <div class=""> */</div> <div class=""> void amdgpu_device_pci_config_reset(struct amdgpu_device *adev)</div> <div class=""> {</div> <div class="">+<span class="Apple-tab-span" style="white-space:pre"> </span>pr_debug("%s called\n",__func__);</div> <div class=""> <span class="Apple-tab-span" style="white-space:pre"> </span>pci_write_config_dword(adev->pdev, 0x7c, AMDGPU_ASIC_RESET_DATA);</div> <div class=""> }</div> <div class=""> </div> <div class="">@@ -1066,6 +1067,7 @@ void amdgpu_device_pci_config_reset(struct amdgpu_device *adev)</div> <div class=""> */</div> <div class=""> int amdgpu_device_pci_reset(struct amdgpu_device *adev)</div> <div class=""> {</div> <div class="">+<span class="Apple-tab-span" style="white-space:pre"> </span>pr_debug("%s called\n",__func__);</div> <div class=""> <span class="Apple-tab-span" style="white-space:pre"> </span>return pci_reset_function(adev->pdev);</div> <div class=""> }</div> <div class=""> </div> <div class="">@@ -4702,6 +4704,8 @@ int amdgpu_do_asic_reset(struct list_head *device_list_handle,</div> <div class=""> <span class="Apple-tab-span" style="white-space:pre"> </span>bool need_full_reset, skip_hw_reset, vram_lost = false;</div> <div class=""> <span class="Apple-tab-span" style="white-space:pre"> </span>int r = 0;</div> <div class=""> </div> <div class="">+<span class="Apple-tab-span" style="white-space:pre"> </span>pr_debug("%s called\n",__func__);</div> <div class="">+</div> <div class=""> <span class="Apple-tab-span" style="white-space:pre"> </span>/* Try reset handler method first */</div> <div class=""> <span class="Apple-tab-span" style="white-space:pre"> </span>tmp_adev = list_first_entry(device_list_handle, struct amdgpu_device,</div> <div class=""> <span class="Apple-tab-span" style="white-space:pre"> </span> reset_list);</div> <div class="">diff --git a/drivers/gpu/drm/amd/amdgpu/amdgpu_ras.c b/drivers/gpu/drm/amd/amdgpu/amdgpu_ras.c</div> <div class="">index 49bdf9ff7350..b469acb65c1e 100644</div> <div class="">--- a/drivers/gpu/drm/amd/amdgpu/amdgpu_ras.c</div> <div class="">+++ b/drivers/gpu/drm/amd/amdgpu/amdgpu_ras.c</div> <div class="">@@ -2518,7 +2518,6 @@ void amdgpu_ras_late_fini(struct amdgpu_device *adev,</div> <div class=""> <span class="Apple-tab-span" style="white-space:pre"> </span>if (!ras_block || !ih_info)</div> <div class=""> <span class="Apple-tab-span" style="white-space:pre"> </span>return;</div> <div class=""> </div> <div class="">-<span class="Apple-tab-span" style="white-space:pre"> </span>amdgpu_ras_sysfs_remove(adev, ras_block);</div> <div class=""> <span class="Apple-tab-span" style="white-space:pre"> </span>if (ih_info->cb)</div> <div class=""> <span class="Apple-tab-span" style="white-space:pre"> </span>amdgpu_ras_interrupt_remove_handler(adev, ih_info);</div> <div class=""> }</div> <div class="">@@ -2577,6 +2576,7 @@ void amdgpu_ras_suspend(struct amdgpu_device *adev)</div> <div class=""> int amdgpu_ras_pre_fini(struct amdgpu_device *adev)</div> <div class=""> {</div> <div class=""> <span class="Apple-tab-span" style="white-space:pre"> </span>struct amdgpu_ras *con = amdgpu_ras_get_context(adev);</div> <div class="">+<span class="Apple-tab-span" style="white-space:pre"> </span>struct ras_manager *obj, *tmp;</div> <div class=""> </div> <div class=""> <span class="Apple-tab-span" style="white-space:pre"> </span>if (!adev->ras_enabled || !con)</div> <div class=""> <span class="Apple-tab-span" style="white-space:pre"> </span>return 0;</div> <div class="">@@ -2585,6 +2585,13 @@ int amdgpu_ras_pre_fini(struct amdgpu_device *adev)</div> <div class=""> <span class="Apple-tab-span" style="white-space:pre"> </span>/* Need disable ras on all IPs here before ip [hw/sw]fini */</div> <div class=""> <span class="Apple-tab-span" style="white-space:pre"> </span>amdgpu_ras_disable_all_features(adev, 0);</div> <div class=""> <span class="Apple-tab-span" style="white-space:pre"> </span>amdgpu_ras_recovery_fini(adev);</div> <div class="">+</div> <div class="">+<span class="Apple-tab-span" style="white-space:pre"> </span>/* remove sysfs before pci_remove to avoid OOPSES from sysfs_remove_groups */</div> <div class="">+<span class="Apple-tab-span" style="white-space:pre"> </span>list_for_each_entry_safe(obj, tmp, &con->head, node) {</div> <div class="">+<span class="Apple-tab-span" style="white-space:pre"> </span>amdgpu_ras_sysfs_remove(adev, &obj->head);</div> <div class="">+<span class="Apple-tab-span" style="white-space:pre"> </span>put_obj(obj);</div> <div class="">+<span class="Apple-tab-span" style="white-space:pre"> </span>}</div> <div class="">+</div> <div class=""> <span class="Apple-tab-span" style="white-space:pre"> </span>return 0;</div> <div class=""> }</div> <div class=""> </div> <div class="">diff --git a/drivers/gpu/drm/amd/amdkfd/kfd_device.c b/drivers/gpu/drm/amd/amdkfd/kfd_device.c</div> <div class="">index 4e7d9cb09a69..0fa806a78e39 100644</div> <div class="">--- a/drivers/gpu/drm/amd/amdkfd/kfd_device.c</div> <div class="">+++ b/drivers/gpu/drm/amd/amdkfd/kfd_device.c</div> <div class="">@@ -693,16 +693,35 @@ bool kfd_is_locked(void)</div> <div class=""> </div> <div class=""> void kgd2kfd_suspend(struct kfd_dev *kfd, bool run_pm, bool force)</div> <div class=""> {</div> <div class="">+<span class="Apple-tab-span" style="white-space:pre"> </span>struct kfd_process *p;</div> <div class="">+<span class="Apple-tab-span" style="white-space:pre"> </span>struct amdkfd_process_info *p_info;</div> <div class="">+<span class="Apple-tab-span" style="white-space:pre"> </span>unsigned int temp;</div> <div class="">+</div> <div class=""> <span class="Apple-tab-span" style="white-space:pre"> </span>if (!kfd->init_complete)</div> <div class=""> <span class="Apple-tab-span" style="white-space:pre"> </span>return;</div> <div class=""> </div> <div class=""> <span class="Apple-tab-span" style="white-space:pre"> </span>/* for runtime suspend, skip locking kfd */</div> <div class="">-<span class="Apple-tab-span" style="white-space:pre"> </span>if (!run_pm) {</div> <div class="">+<span class="Apple-tab-span" style="white-space:pre"> </span>if (!run_pm && !drm_dev_is_unplugged(kfd->ddev)) {</div> <div class=""> <span class="Apple-tab-span" style="white-space:pre"> </span>/* For first KFD device suspend all the KFD processes */</div> <div class=""> <span class="Apple-tab-span" style="white-space:pre"> </span>if (atomic_inc_return(&kfd_locked) == 1)</div> <div class=""> <span class="Apple-tab-span" style="white-space:pre"> </span>kfd_suspend_all_processes(force);</div> <div class=""> <span class="Apple-tab-span" style="white-space:pre"> </span>}</div> <div class=""> </div> <div class="">+<span class="Apple-tab-span" style="white-space:pre"> </span>if (drm_dev_is_unplugged(kfd->ddev)){</div> <div class="">+<span class="Apple-tab-span" style="white-space:pre"> </span>int idx = srcu_read_lock(&kfd_processes_srcu);</div> <div class="">+<span class="Apple-tab-span" style="white-space:pre"> </span>pr_debug("cancel restore_userptr_wor\n");</div> <div class="">+<span class="Apple-tab-span" style="white-space:pre"> </span>hash_for_each_rcu(kfd_processes_table, temp, p, kfd_processes) {</div> <div class="">+<span class="Apple-tab-span" style="white-space:pre"> </span>if ( kfd_process_gpuidx_from_gpuid(p, kfd->id) >= 0 ) {</div> <div class="">+<span class="Apple-tab-span" style="white-space:pre"> </span>p_info = p->kgd_process_info;</div> <div class="">+<span class="Apple-tab-span" style="white-space:pre"> </span>pr_debug("cancel processes, pid = %d for gpu_id = %d", pid_nr(p_info->pid), kfd->id);</div> <div class="">+<span class="Apple-tab-span" style="white-space:pre"> </span>cancel_delayed_work_sync(&p_info->restore_userptr_work);</div> <div class="">+<span class="Apple-tab-span" style="white-space:pre"> </span>/* block all future restore_userptr_work */</div> <div class="">+<span class="Apple-tab-span" style="white-space:pre"> </span>atomic_inc(&p_info->invalid);</div> </div> </blockquote> <p class=""><br class=""> </p> <p class="">Same as i mentioned above with drm.dev_eneter/exit</p> </div> </div> </blockquote> Same as I mentioned as the process can have many drm_dev open.</div> <div class=""><br class=""> </div> <div class=""> <div class="">Final comments:</div> <div class=""><br class=""> </div> <div class="">I suspect that the my linux kernel version might not have all the fixes you did for hotplug. Can you give me a pointer to the lowest version of linux kernel (5.14 from linux kernel repo? amd-drm-staging-next does not work for MI100 out-of-box), which would pass all libdrm tests including hotplug tests (some tests hang, some failed now) ?</div> </div> </blockquote> <p class=""><br class=""> </p> <p class="">That a problem, latest working baseline I tested and confirmed passing hotplug tests is this branch and commit <a class="moz-txt-link-freetext" href="https://nam06.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgitlab.freedesktop.org%2Fagd5f%2Flinux%2F-%2Fcommit%2F86e12a53b73135806e101142e72f3f1c0e6fa8e6&data=05%7C01%7Cshuotaoxu%40microsoft.com%7C1ce273d333a04fde7dcf08da221de5f7%7C72f988bf86f141af91ab2d7cd011db47%7C1%7C0%7C637859809165356475%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=tsMzw%2BphQCOvNs9%2FFue1ApMO2RnrJvilW6Kld4rnsco%3D&reserved=0" originalsrc="https://gitlab.freedesktop.org/agd5f/linux/-/commit/86e12a53b73135806e101142e72f3f1c0e6fa8e6" shash="gXN9Lpsi5Iw/K7OtdEZwGri2cKMXM/z6BDn2Oy8zV1QmC7CyuZiwb+FGoOnV5Nh2R3qvQrELwpErPFrzDIwntKw/RWBKNNwWygGL+fFRaFcDY7VuYVtOS4IUySs6xSLHupw+3KuU/G+qPJh6lVNkqErpBn3inhRFEGsxCspPa2U="> https://gitlab.freedesktop.org/agd5f/linux/-/commit/86e12a53b73135806e101142e72f3f1c0e6fa8e6</a> which is amd-staging-drm-next. 5.14 was the branch we ups-reamed the hotplug code but it had a lot of regressions over time due to new changes (that why I added the hotplug test to try and catch them early). It would be best to run this branch on mi-100 so we have a clean baseline and only after confirming this particular branch from this commits passes libdrm tests only then start adding the KFD specific addons. Another option if you can't work with MI-100 and this branch is to try a different ASIC that does work with this branch (if possible).</p> <p class="">Andrey<br class=""> </p> </div> </div> </blockquote> OK I tried both this commit and the HEAD of and-staging-drm-next on two GPUs( MI100 and Radeon VII) both did not pass hotplugout libdrm test. I might be able to gain access to MI200, but I suspect it would work. </div> <div><br class=""> </div> <div>I copied the complete dmesgs as follows. I highlighted the OOPSES for you.</div> <div><br class=""> </div> <div><span style="background-color: rgb(255, 38, 0);" class="">Radeon VII:</span></div> <div><br class=""> </div> <div> <div>[Apr20 18:01] amdgpu 0000:05:00.0: amdgpu: amdgpu: finishing device.</div> <div>[ +0.000509] amdgpu 0000:05:00.0: amdgpu: ras disable gfx failed poison:0 ret:-22</div> <div>[ +0.014459] [drm] free PSP TMR buffer</div> <div>[ +0.000003] [drm:amdgpu_fill_buffer [amdgpu]] *ERROR* Trying to clear memory with ring turned off.</div> <div>[ +0.000230] ------------[ cut here ]------------</div> <div>[ +0.000001] WARNING: CPU: 16 PID: 2834 at drivers/gpu/drm/amd/amdgpu/amdgpu_object.c:1313 amdgpu_bo_release_notify+0x15f/0x170 [amdgpu]</div> <div>[ +0.000105] Modules linked in: nf_conntrack_netlink nfnetlink xfrm_user xt_addrtype br_netfilter xt_CHECKSUM iptable_mangle xt_MASQUERADE iptable_nat nf_nat xt_conntrack nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 ipt_REJECT nf_reject_ipv4 xt_tcpudp bridge stp llc ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter overlay esp6_offload esp6 esp4_offload esp4 xfrm_algo ipmi_ssif intel_rapl_msr snd_hda_codec_hdmi intel_rapl_common sb_edac x86_pkg_temp_thermal snd_hda_intel intel_powerclamp coretemp snd_intel_dspcfg kvm_intel snd_hda_codec snd_hda_core kvm snd_hwdep ftdi_sio snd_pcm snd_timer joydev input_leds usbserial snd irqbypass soundcore rapl iTCO_wdt iTCO_vendor_support ipmi_si mei_me intel_cstate acpi_power_meter ipmi_devintf lpc_ich mei ipmi_msghandler mac_hid sch_fq_codel ib_iser rdma_cm iw_cm ib_cm ib_core iscsi_tcp libiscsi_tcp libiscsi scsi_transport_iscsi ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy</div> <div>[ +0.000051] async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear amdgpu iommu_v2 gpu_sched drm_ttm_helper mgag200 ttm drm_shmem_helper crct10dif_pclmul drm_kms_helper crc32_pclmul syscopyarea sysfillrect hid_generic ghash_clmulni_intel sysimgblt fb_sys_fops uas aesni_intel usbhid ahci crypto_simd igb usb_storage libahci cryptd hid drm dca megaraid_sas i2c_algo_bit wmi</div> <div>[ +0.000026] CPU: 16 PID: 2834 Comm: amdgpu_test Not tainted 5.16.0+ #3</div> <div>[ +0.000003] Hardware name: Dell Inc. PowerEdge R730/0H21J3, BIOS 1.5.4 [FPGA Test BIOS] 10/002/2015</div> <div>[ +0.000001] RIP: 0010:amdgpu_bo_release_notify+0x15f/0x170 [amdgpu]</div> <div>[ +0.000103] Code: ff ff ff 48 39 c2 74 07 0f 0b e9 61 ff ff ff 4c 89 e7 e8 d4 a8 15 00 e9 54 ff ff ff e8 3a af 11 da eb cf 0f 0b e9 f0 fe ff ff <0f> 0b eb c4 e8 a8 c4 4b da 0f 1f 84 00 00 00 00 00 0f 1f 44 00 00</div> <div>[ +0.000002] RSP: 0018:ffffafed0ed27b28 EFLAGS: 00010282</div> <div>[ +0.000002] RAX: 00000000ffffffea RBX: ffff9e0c589d9458 RCX: 0000000000000001</div> <div>[ +0.000002] RDX: 0000000000000000 RSI: ffffffff9b5712d9 RDI: 00000000ffffffff</div> <div>[ +0.000001] RBP: ffffafed0ed27b48 R08: 0000000000000000 R09: 0000000000000001</div> <div>[ +0.000001] R10: ffffafed0ed27bd0 R11: ffffafed0ed277c0 R12: ffff9e0c589d9400</div> <div>[ +0.000001] R13: ffff9e0c589d9458 R14: ffff9e0c589d9558 R15: ffff9e0c5b785360</div> <div>[ +0.000001] FS: 00007fb8e81390c0(0000) GS:ffff9e2b3fc00000(0000) knlGS:0000000000000000</div> <div>[ +0.000002] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033</div> <div>[ +0.000001] CR2: 00007fff89079ea8 CR3: 000000010e764004 CR4: 00000000001706e0</div> <div>[ +0.000002] Call Trace:</div> <div>[ +0.000002] <TASK></div> <div>[ +0.000003] ttm_bo_release+0x2f2/0x370 [ttm]</div> <div>[ +0.000008] ? vprintk_default+0x1d/0x20</div> <div>[ +0.000006] ttm_bo_put+0x30/0x40 [ttm]</div> <div>[ +0.000004] amdgpu_bo_free_kernel+0xc7/0x120 [amdgpu]</div> <div>[ +0.000102] psp_tmr_terminate+0xa4/0xd0 [amdgpu]</div> <div>[ +0.000125] psp_hw_fini+0x6e/0x110 [amdgpu]</div> <div>[ +0.000122] amdgpu_device_fini_hw+0x1e5/0x3b0 [amdgpu]</div> <div>[ +0.000098] amdgpu_driver_unload_kms+0x4b/0x60 [amdgpu]</div> <div>[ +0.000098] amdgpu_pci_remove+0x46/0x60 [amdgpu]</div> <div>[ +0.000096] pci_device_remove+0x39/0xb0</div> <div>[ +0.000008] device_release_driver_internal+0xfe/0x1d0</div> <div>[ +0.000005] device_release_driver+0x12/0x20</div> <div>[ +0.000001] pci_stop_bus_device+0x68/0x90</div> <div>[ +0.000003] pci_stop_and_remove_bus_device_locked+0x1a/0x30</div> <div>[ +0.000003] remove_store+0x7c/0x90</div> <div>[ +0.000003] dev_attr_store+0x17/0x30</div> <div>[ +0.000005] sysfs_kf_write+0x3c/0x50</div> <div>[ +0.000004] kernfs_fop_write_iter+0x13c/0x1b0</div> <div>[ +0.000004] new_sync_write+0x11a/0x1b0</div> <div>[ +0.000006] vfs_write+0x247/0x2a0</div> <div>[ +0.000003] ksys_write+0xa7/0xe0</div> <div>[ +0.000003] ? fpregs_assert_state_consistent+0x23/0x50</div> <div>[ +0.000005] __x64_sys_write+0x1a/0x20</div> <div>[ +0.000003] do_syscall_64+0x3a/0xb0</div> <div>[ +0.000006] entry_SYSCALL_64_after_hwframe+0x44/0xae</div> <div>[ +0.000004] RIP: 0033:0x7fb8e76e8371</div> <div>[ +0.000003] Code: c3 0f 1f 84 00 00 00 00 00 48 8b 05 69 8c 20 00 c3 0f 1f 84 00 00 00 00 00 8b 05 9a d0 20 00 85 c0 75 16 b8 01 00 00 00 0f 05 <48> 3d 00 f0 ff ff 77 57 f3 c3 0f 1f 44 00 00 41 54 55 49 89 d4 53</div> <div>[ +0.000001] RSP: 002b:00007fff89083f68 EFLAGS: 00000246 ORIG_RAX: 0000000000000001</div> <div>[ +0.000003] RAX: ffffffffffffffda RBX: 0000000000000000 RCX: 00007fb8e76e8371</div> <div>[ +0.000001] RDX: 0000000000000001 RSI: 0000562815835316 RDI: 0000000000000005</div> <div>[ +0.000001] RBP: 0000000000000005 R08: 0000562815f732b0 R09: 0000000000000000</div> <div>[ +0.000001] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000</div> <div>[ +0.000001] R13: 0000000000000000 R14: 0000000000000000 R15: 0000562815a3e8a0</div> <div>[ +0.000003] </TASK></div> <div>[ +0.000001] ---[ end trace 7e6704984e7ed0f1 ]---</div> <div>[ +0.020476] [drm:amdgpu_fill_buffer [amdgpu]] *ERROR* Trying to clear memory with ring turned off.</div> <div>[ +0.000143] ------------[ cut here ]------------</div> <div>[ +0.000001] WARNING: CPU: 16 PID: 2834 at drivers/gpu/drm/amd/amdgpu/amdgpu_object.c:1313 amdgpu_bo_release_notify+0x15f/0x170 [amdgpu]</div> <div>[ +0.000104] Modules linked in: nf_conntrack_netlink nfnetlink xfrm_user xt_addrtype br_netfilter xt_CHECKSUM iptable_mangle xt_MASQUERADE iptable_nat nf_nat xt_conntrack nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 ipt_REJECT nf_reject_ipv4 xt_tcpudp bridge stp llc ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter overlay esp6_offload esp6 esp4_offload esp4 xfrm_algo ipmi_ssif intel_rapl_msr snd_hda_codec_hdmi intel_rapl_common sb_edac x86_pkg_temp_thermal snd_hda_intel intel_powerclamp coretemp snd_intel_dspcfg kvm_intel snd_hda_codec snd_hda_core kvm snd_hwdep ftdi_sio snd_pcm snd_timer joydev input_leds usbserial snd irqbypass soundcore rapl iTCO_wdt iTCO_vendor_support ipmi_si mei_me intel_cstate acpi_power_meter ipmi_devintf lpc_ich mei ipmi_msghandler mac_hid sch_fq_codel ib_iser rdma_cm iw_cm ib_cm ib_core iscsi_tcp libiscsi_tcp libiscsi scsi_transport_iscsi ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy</div> <div>[ +0.000044] async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear amdgpu iommu_v2 gpu_sched drm_ttm_helper mgag200 ttm drm_shmem_helper crct10dif_pclmul drm_kms_helper crc32_pclmul syscopyarea sysfillrect hid_generic ghash_clmulni_intel sysimgblt fb_sys_fops uas aesni_intel usbhid ahci crypto_simd igb usb_storage libahci cryptd hid drm dca megaraid_sas i2c_algo_bit wmi</div> <div>[ +0.000021] CPU: 16 PID: 2834 Comm: amdgpu_test Tainted: G W 5.16.0+ #3</div> <div>[ +0.000002] Hardware name: Dell Inc. PowerEdge R730/0H21J3, BIOS 1.5.4 [FPGA Test BIOS] 10/002/2015</div> <div>[ +0.000001] RIP: 0010:amdgpu_bo_release_notify+0x15f/0x170 [amdgpu]</div> <div>[ +0.000102] Code: ff ff ff 48 39 c2 74 07 0f 0b e9 61 ff ff ff 4c 89 e7 e8 d4 a8 15 00 e9 54 ff ff ff e8 3a af 11 da eb cf 0f 0b e9 f0 fe ff ff <0f> 0b eb c4 e8 a8 c4 4b da 0f 1f 84 00 00 00 00 00 0f 1f 44 00 00</div> <div>[ +0.000002] RSP: 0018:ffffafed0ed27b30 EFLAGS: 00010282</div> <div>[ +0.000002] RAX: 00000000ffffffea RBX: ffff9e0c589de058 RCX: 0000000000000001</div> <div>[ +0.000001] RDX: 0000000000000000 RSI: ffffffff9b5712d9 RDI: 00000000ffffffff</div> <div>[ +0.000002] RBP: ffffafed0ed27b50 R08: 0000000000000000 R09: 0000000000000001</div> <div>[ +0.000001] R10: ffffafed0df0fd80 R11: ffffafed0ed277c8 R12: ffff9e0c589de000</div> <div>[ +0.000001] R13: ffff9e0c589de058 R14: ffff9e0c589de158 R15: ffff9e0c5b785360</div> <div>[ +0.000001] FS: 00007fb8e81390c0(0000) GS:ffff9e2b3fc00000(0000) knlGS:0000000000000000</div> <div>[ +0.000002] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033</div> <div>[ +0.000001] CR2: 00007fff89079ea8 CR3: 000000010e764004 CR4: 00000000001706e0</div> <div>[ +0.000001] Call Trace:</div> <div>[ +0.000001] <TASK></div> <div>[ +0.000002] ttm_bo_release+0x2f2/0x370 [ttm]</div> <div>[ +0.000005] ? __cond_resched+0x1d/0x30</div> <div>[ +0.000006] ttm_bo_put+0x30/0x40 [ttm]</div> <div>[ +0.000004] amdgpu_bo_free_kernel+0xc7/0x120 [amdgpu]</div> <div>[ +0.000102] psp_v11_0_ring_destroy+0x41/0x50 [amdgpu]</div> <div>[ +0.000126] psp_hw_fini+0x86/0x110 [amdgpu]</div> <div>[ +0.000129] amdgpu_device_fini_hw+0x1e5/0x3b0 [amdgpu]</div> <div>[ +0.000101] amdgpu_driver_unload_kms+0x4b/0x60 [amdgpu]</div> <div>[ +0.000102] amdgpu_pci_remove+0x46/0x60 [amdgpu]</div> <div>[ +0.000100] pci_device_remove+0x39/0xb0</div> <div>[ +0.000003] device_release_driver_internal+0xfe/0x1d0</div> <div>[ +0.000003] device_release_driver+0x12/0x20</div> <div>[ +0.000001] pci_stop_bus_device+0x68/0x90</div> <div>[ +0.000003] pci_stop_and_remove_bus_device_locked+0x1a/0x30</div> <div>[ +0.000002] remove_store+0x7c/0x90</div> <div>[ +0.000003] dev_attr_store+0x17/0x30</div> <div>[ +0.000003] sysfs_kf_write+0x3c/0x50</div> <div>[ +0.000003] kernfs_fop_write_iter+0x13c/0x1b0</div> <div>[ +0.000004] new_sync_write+0x11a/0x1b0</div> <div>[ +0.000003] vfs_write+0x247/0x2a0</div> <div>[ +0.000003] ksys_write+0xa7/0xe0</div> <div>[ +0.000003] ? fpregs_assert_state_consistent+0x23/0x50</div> <div>[ +0.000003] __x64_sys_write+0x1a/0x20</div> <div>[ +0.000003] do_syscall_64+0x3a/0xb0</div> <div>[ +0.000003] entry_SYSCALL_64_after_hwframe+0x44/0xae</div> <div>[ +0.000003] RIP: 0033:0x7fb8e76e8371</div> <div>[ +0.000002] Code: c3 0f 1f 84 00 00 00 00 00 48 8b 05 69 8c 20 00 c3 0f 1f 84 00 00 00 00 00 8b 05 9a d0 20 00 85 c0 75 16 b8 01 00 00 00 0f 05 <48> 3d 00 f0 ff ff 77 57 f3 c3 0f 1f 44 00 00 41 54 55 49 89 d4 53</div> <div>[ +0.000002] RSP: 002b:00007fff89083f68 EFLAGS: 00000246 ORIG_RAX: 0000000000000001</div> <div>[ +0.000002] RAX: ffffffffffffffda RBX: 0000000000000000 RCX: 00007fb8e76e8371</div> <div>[ +0.000001] RDX: 0000000000000001 RSI: 0000562815835316 RDI: 0000000000000005</div> <div>[ +0.000001] RBP: 0000000000000005 R08: 0000562815f732b0 R09: 0000000000000000</div> <div>[ +0.000001] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000</div> <div>[ +0.000001] R13: 0000000000000000 R14: 0000000000000000 R15: 0000562815a3e8a0</div> <div>[ +0.000003] </TASK></div> <div>[ +0.000001] ---[ end trace 7e6704984e7ed0f2 ]---</div> <div>[ +0.000627] [drm:amdgpu_fill_buffer [amdgpu]] *ERROR* Trying to clear memory with ring turned off.</div> <div>[ +0.000174] ------------[ cut here ]------------</div> <div>[ +0.000001] WARNING: CPU: 16 PID: 2834 at drivers/gpu/drm/amd/amdgpu/amdgpu_object.c:1313 amdgpu_bo_release_notify+0x15f/0x170 [amdgpu]</div> <div>[ +0.000110] Modules linked in: nf_conntrack_netlink nfnetlink xfrm_user xt_addrtype br_netfilter xt_CHECKSUM iptable_mangle xt_MASQUERADE iptable_nat nf_nat xt_conntrack nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 ipt_REJECT nf_reject_ipv4 xt_tcpudp bridge stp llc ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter overlay esp6_offload esp6 esp4_offload esp4 xfrm_algo ipmi_ssif intel_rapl_msr snd_hda_codec_hdmi intel_rapl_common sb_edac x86_pkg_temp_thermal snd_hda_intel intel_powerclamp coretemp snd_intel_dspcfg kvm_intel snd_hda_codec snd_hda_core kvm snd_hwdep ftdi_sio snd_pcm snd_timer joydev input_leds usbserial snd irqbypass soundcore rapl iTCO_wdt iTCO_vendor_support ipmi_si mei_me intel_cstate acpi_power_meter ipmi_devintf lpc_ich mei ipmi_msghandler mac_hid sch_fq_codel ib_iser rdma_cm iw_cm ib_cm ib_core iscsi_tcp libiscsi_tcp libiscsi scsi_transport_iscsi ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy</div> <div>[ +0.000046] async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear amdgpu iommu_v2 gpu_sched drm_ttm_helper mgag200 ttm drm_shmem_helper crct10dif_pclmul drm_kms_helper crc32_pclmul syscopyarea sysfillrect hid_generic ghash_clmulni_intel sysimgblt fb_sys_fops uas aesni_intel usbhid ahci crypto_simd igb usb_storage libahci cryptd hid drm dca megaraid_sas i2c_algo_bit wmi</div> <div>[ +0.000025] CPU: 16 PID: 2834 Comm: amdgpu_test Tainted: G W 5.16.0+ #3</div> <div>[ +0.000003] Hardware name: Dell Inc. PowerEdge R730/0H21J3, BIOS 1.5.4 [FPGA Test BIOS] 10/002/2015</div> <div>[ +0.000002] RIP: 0010:amdgpu_bo_release_notify+0x15f/0x170 [amdgpu]</div> <div>[ +0.000107] Code: ff ff ff 48 39 c2 74 07 0f 0b e9 61 ff ff ff 4c 89 e7 e8 d4 a8 15 00 e9 54 ff ff ff e8 3a af 11 da eb cf 0f 0b e9 f0 fe ff ff <0f> 0b eb c4 e8 a8 c4 4b da 0f 1f 84 00 00 00 00 00 0f 1f 44 00 00</div> <div>[ +0.000002] RSP: 0018:ffffafed0ed27b58 EFLAGS: 00010282</div> <div>[ +0.000002] RAX: 00000000ffffffea RBX: ffff9e0c589d8c58 RCX: 0000000000000001</div> <div>[ +0.000001] RDX: 0000000000000000 RSI: ffffffff9b5712d9 RDI: 00000000ffffffff</div> <div>[ +0.000001] RBP: ffffafed0ed27b78 R08: 0000000000000000 R09: 0000000000000001</div> <div>[ +0.000002] R10: ffffafed0ed27b08 R11: ffffafed0ed277f0 R12: ffff9e0c589d8c00</div> <div>[ +0.000001] R13: ffff9e0c589d8c58 R14: ffff9e0c589d8d58 R15: ffff9e0c5b785360</div> <div>[ +0.000001] FS: 00007fb8e81390c0(0000) GS:ffff9e2b3fc00000(0000) knlGS:0000000000000000</div> <div>[ +0.000002] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033</div> <div>[ +0.000001] CR2: 00007fff89079ea8 CR3: 000000010e764004 CR4: 00000000001706e0</div> <div>[ +0.000001] Call Trace:</div> <div>[ +0.000001] <TASK></div> <div>[ +0.000002] ttm_bo_release+0x2f2/0x370 [ttm]</div> <div>[ +0.000005] ? __vunmap+0x1c9/0x210</div> <div>[ +0.000007] ttm_bo_put+0x30/0x40 [ttm]</div> <div>[ +0.000004] amdgpu_bo_free_kernel+0xc7/0x120 [amdgpu]</div> <div>[ +0.000106] psp_hw_fini+0xba/0x110 [amdgpu]</div> <div>[ +0.000129] amdgpu_device_fini_hw+0x1e5/0x3b0 [amdgpu]</div> <div>[ +0.000101] amdgpu_driver_unload_kms+0x4b/0x60 [amdgpu]</div> <div>[ +0.000103] amdgpu_pci_remove+0x46/0x60 [amdgpu]</div> <div>[ +0.000100] pci_device_remove+0x39/0xb0</div> <div>[ +0.000003] device_release_driver_internal+0xfe/0x1d0</div> <div>[ +0.000002] device_release_driver+0x12/0x20</div> <div>[ +0.000002] pci_stop_bus_device+0x68/0x90</div> <div>[ +0.000003] pci_stop_and_remove_bus_device_locked+0x1a/0x30</div> <div>[ +0.000002] remove_store+0x7c/0x90</div> <div>[ +0.000003] dev_attr_store+0x17/0x30</div> <div>[ +0.000002] sysfs_kf_write+0x3c/0x50</div> <div>[ +0.000003] kernfs_fop_write_iter+0x13c/0x1b0</div> <div>[ +0.000004] new_sync_write+0x11a/0x1b0</div> <div>[ +0.000004] vfs_write+0x247/0x2a0</div> <div>[ +0.000003] ksys_write+0xa7/0xe0</div> <div>[ +0.000002] ? fpregs_assert_state_consistent+0x23/0x50</div> <div>[ +0.000003] __x64_sys_write+0x1a/0x20</div> <div>[ +0.000003] do_syscall_64+0x3a/0xb0</div> <div>[ +0.000003] entry_SYSCALL_64_after_hwframe+0x44/0xae</div> <div>[ +0.000003] RIP: 0033:0x7fb8e76e8371</div> <div>[ +0.000002] Code: c3 0f 1f 84 00 00 00 00 00 48 8b 05 69 8c 20 00 c3 0f 1f 84 00 00 00 00 00 8b 05 9a d0 20 00 85 c0 75 16 b8 01 00 00 00 0f 05 <48> 3d 00 f0 ff ff 77 57 f3 c3 0f 1f 44 00 00 41 54 55 49 89 d4 53</div> <div>[ +0.000002] RSP: 002b:00007fff89083f68 EFLAGS: 00000246 ORIG_RAX: 0000000000000001</div> <div>[ +0.000002] RAX: ffffffffffffffda RBX: 0000000000000000 RCX: 00007fb8e76e8371</div> <div>[ +0.000001] RDX: 0000000000000001 RSI: 0000562815835316 RDI: 0000000000000005</div> <div>[ +0.000001] RBP: 0000000000000005 R08: 0000562815f732b0 R09: 0000000000000000</div> <div>[ +0.000001] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000</div> <div>[ +0.000002] R13: 0000000000000000 R14: 0000000000000000 R15: 0000562815a3e8a0</div> <div>[ +0.000002] </TASK></div> <div>[ +0.000001] ---[ end trace 7e6704984e7ed0f3 ]---</div> <div>[ +0.000022] [drm:amdgpu_fill_buffer [amdgpu]] *ERROR* Trying to clear memory with ring turned off.</div> <div>[ +0.000420] ------------[ cut here ]------------</div> <div>[ +0.000006] WARNING: CPU: 28 PID: 2834 at drivers/gpu/drm/amd/amdgpu/amdgpu_object.c:1313 amdgpu_bo_release_notify+0x15f/0x170 [amdgpu]</div> <div>[ +0.000317] Modules linked in: nf_conntrack_netlink nfnetlink xfrm_user xt_addrtype br_netfilter xt_CHECKSUM iptable_mangle xt_MASQUERADE iptable_nat nf_nat xt_conntrack nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 ipt_REJECT nf_reject_ipv4 xt_tcpudp bridge stp llc ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter overlay esp6_offload esp6 esp4_offload esp4 xfrm_algo ipmi_ssif intel_rapl_msr snd_hda_codec_hdmi intel_rapl_common sb_edac x86_pkg_temp_thermal snd_hda_intel intel_powerclamp coretemp snd_intel_dspcfg kvm_intel snd_hda_codec snd_hda_core kvm snd_hwdep ftdi_sio snd_pcm snd_timer joydev input_leds usbserial snd irqbypass soundcore rapl iTCO_wdt iTCO_vendor_support ipmi_si mei_me intel_cstate acpi_power_meter ipmi_devintf lpc_ich mei ipmi_msghandler mac_hid sch_fq_codel ib_iser rdma_cm iw_cm ib_cm ib_core iscsi_tcp libiscsi_tcp libiscsi scsi_transport_iscsi ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy</div> <div>[ +0.000114] async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear amdgpu iommu_v2 gpu_sched drm_ttm_helper mgag200 ttm drm_shmem_helper crct10dif_pclmul drm_kms_helper crc32_pclmul syscopyarea sysfillrect hid_generic ghash_clmulni_intel sysimgblt fb_sys_fops uas aesni_intel usbhid ahci crypto_simd igb usb_storage libahci cryptd hid drm dca megaraid_sas i2c_algo_bit wmi</div> <div>[ +0.000058] CPU: 28 PID: 2834 Comm: amdgpu_test Tainted: G W 5.16.0+ #3</div> <div>[ +0.000005] Hardware name: Dell Inc. PowerEdge R730/0H21J3, BIOS 1.5.4 [FPGA Test BIOS] 10/002/2015</div> <div>[ +0.000003] RIP: 0010:amdgpu_bo_release_notify+0x15f/0x170 [amdgpu]</div> <div>[ +0.000309] Code: ff ff ff 48 39 c2 74 07 0f 0b e9 61 ff ff ff 4c 89 e7 e8 d4 a8 15 00 e9 54 ff ff ff e8 3a af 11 da eb cf 0f 0b e9 f0 fe ff ff <0f> 0b eb c4 e8 a8 c4 4b da 0f 1f 84 00 00 00 00 00 0f 1f 44 00 00</div> <div>[ +0.000005] RSP: 0018:ffffafed0ed27b58 EFLAGS: 00010282</div> <div>[ +0.000005] RAX: 00000000ffffffea RBX: ffff9e0c589d8858 RCX: 0000000000000001</div> <div>[ +0.000003] RDX: 0000000000000000 RSI: ffffffff9b5712d9 RDI: 00000000ffffffff</div> <div>[ +0.000003] RBP: ffffafed0ed27b78 R08: 0000000000000000 R09: 0000000000000001</div> <div>[ +0.000002] R10: 0000000000000c32 R11: ffffafed0ed277f0 R12: ffff9e0c589d8800</div> <div>[ +0.000003] R13: ffff9e0c589d8858 R14: ffff9e0c589d8958 R15: ffff9e0c5b785360</div> <div>[ +0.000003] FS: 00007fb8e81390c0(0000) GS:ffff9e2b3fd80000(0000) knlGS:0000000000000000</div> <div>[ +0.000004] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033</div> <div>[ +0.000003] CR2: 00007f68a9ecb1d8 CR3: 000000010e764004 CR4: 00000000001706e0</div> <div>[ +0.000003] Call Trace:</div> <div>[ +0.000002] <TASK></div> <div>[ +0.000005] ttm_bo_release+0x2f2/0x370 [ttm]</div> <div>[ +0.000012] ? __cond_resched+0x1d/0x30</div> <div>[ +0.000011] ttm_bo_put+0x30/0x40 [ttm]</div> <div>[ +0.000010] amdgpu_bo_free_kernel+0xc7/0x120 [amdgpu]</div> <div>[ +0.000234] psp_hw_fini+0xd4/0x110 [amdgpu]</div> <div>[ +0.000292] amdgpu_device_fini_hw+0x1e5/0x3b0 [amdgpu]</div> <div>[ +0.000230] amdgpu_driver_unload_kms+0x4b/0x60 [amdgpu]</div> <div>[ +0.000230] amdgpu_pci_remove+0x46/0x60 [amdgpu]</div> <div>[ +0.000225] pci_device_remove+0x39/0xb0</div> <div>[ +0.000007] device_release_driver_internal+0xfe/0x1d0</div> <div>[ +0.000006] device_release_driver+0x12/0x20</div> <div>[ +0.000004] pci_stop_bus_device+0x68/0x90</div> <div>[ +0.000006] pci_stop_and_remove_bus_device_locked+0x1a/0x30</div> <div>[ +0.000005] remove_store+0x7c/0x90</div> <div>[ +0.000007] dev_attr_store+0x17/0x30</div> <div>[ +0.000006] sysfs_kf_write+0x3c/0x50</div> <div>[ +0.000007] kernfs_fop_write_iter+0x13c/0x1b0</div> <div>[ +0.000007] new_sync_write+0x11a/0x1b0</div> <div>[ +0.000009] vfs_write+0x247/0x2a0</div> <div>[ +0.000006] ksys_write+0xa7/0xe0</div> <div>[ +0.000006] ? fpregs_assert_state_consistent+0x23/0x50</div> <div>[ +0.000008] __x64_sys_write+0x1a/0x20</div> <div>[ +0.000006] do_syscall_64+0x3a/0xb0</div> <div>[ +0.000008] entry_SYSCALL_64_after_hwframe+0x44/0xae</div> <div>[ +0.000006] RIP: 0033:0x7fb8e76e8371</div> <div>[ +0.000005] Code: c3 0f 1f 84 00 00 00 00 00 48 8b 05 69 8c 20 00 c3 0f 1f 84 00 00 00 00 00 8b 05 9a d0 20 00 85 c0 75 16 b8 01 00 00 00 0f 05 <48> 3d 00 f0 ff ff 77 57 f3 c3 0f 1f 44 00 00 41 54 55 49 89 d4 53</div> <div>[ +0.000005] RSP: 002b:00007fff89083f68 EFLAGS: 00000246 ORIG_RAX: 0000000000000001</div> <div>[ +0.000004] RAX: ffffffffffffffda RBX: 0000000000000000 RCX: 00007fb8e76e8371</div> <div>[ +0.000003] RDX: 0000000000000001 RSI: 0000562815835316 RDI: 0000000000000005</div> <div>[ +0.000003] RBP: 0000000000000005 R08: 0000562815f732b0 R09: 0000000000000000</div> <div>[ +0.000003] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000</div> <div>[ +0.000002] R13: 0000000000000000 R14: 0000000000000000 R15: 0000562815a3e8a0</div> <div>[ +0.000006] </TASK></div> <div>[ +0.000002] ---[ end trace 7e6704984e7ed0f4 ]---</div> <div>[ +0.130454] pci 0000:05:00.0: Removing from iommu group 24</div> <div>[ +0.000164] [drm:amdgpu_fill_buffer [amdgpu]] *ERROR* Trying to clear memory with ring turned off.</div> <div>[ +0.000339] ------------[ cut here ]------------</div> <div>[ +0.000002] WARNING: CPU: 28 PID: 2834 at drivers/gpu/drm/amd/amdgpu/amdgpu_object.c:1313 amdgpu_bo_release_notify+0x15f/0x170 [amdgpu]</div> <div>[ +0.000186] Modules linked in: nf_conntrack_netlink nfnetlink xfrm_user xt_addrtype br_netfilter xt_CHECKSUM iptable_mangle xt_MASQUERADE iptable_nat nf_nat xt_conntrack nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 ipt_REJECT nf_reject_ipv4 xt_tcpudp bridge stp llc ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter overlay esp6_offload esp6 esp4_offload esp4 xfrm_algo ipmi_ssif intel_rapl_msr snd_hda_codec_hdmi intel_rapl_common sb_edac x86_pkg_temp_thermal snd_hda_intel intel_powerclamp coretemp snd_intel_dspcfg kvm_intel snd_hda_codec snd_hda_core kvm snd_hwdep ftdi_sio snd_pcm snd_timer joydev input_leds usbserial snd irqbypass soundcore rapl iTCO_wdt iTCO_vendor_support ipmi_si mei_me intel_cstate acpi_power_meter ipmi_devintf lpc_ich mei ipmi_msghandler mac_hid sch_fq_codel ib_iser rdma_cm iw_cm ib_cm ib_core iscsi_tcp libiscsi_tcp libiscsi scsi_transport_iscsi ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy</div> <div>[ +0.000088] async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear amdgpu iommu_v2 gpu_sched drm_ttm_helper mgag200 ttm drm_shmem_helper crct10dif_pclmul drm_kms_helper crc32_pclmul syscopyarea sysfillrect hid_generic ghash_clmulni_intel sysimgblt fb_sys_fops uas aesni_intel usbhid ahci crypto_simd igb usb_storage libahci cryptd hid drm dca megaraid_sas i2c_algo_bit wmi</div> <div>[ +0.000045] CPU: 28 PID: 2834 Comm: amdgpu_test Tainted: G W 5.16.0+ #3</div> <div>[ +0.000004] Hardware name: Dell Inc. PowerEdge R730/0H21J3, BIOS 1.5.4 [FPGA Test BIOS] 10/002/2015</div> <div>[ +0.000003] RIP: 0010:amdgpu_bo_release_notify+0x15f/0x170 [amdgpu]</div> <div>[ +0.000183] Code: ff ff ff 48 39 c2 74 07 0f 0b e9 61 ff ff ff 4c 89 e7 e8 d4 a8 15 00 e9 54 ff ff ff e8 3a af 11 da eb cf 0f 0b e9 f0 fe ff ff <0f> 0b eb c4 e8 a8 c4 4b da 0f 1f 84 00 00 00 00 00 0f 1f 44 00 00</div> <div>[ +0.000003] RSP: 0018:ffffafed0ed27cd0 EFLAGS: 00010282</div> <div>[ +0.000004] RAX: 00000000ffffffea RBX: ffff9e0c6cae0058 RCX: 0000000000000001</div> <div>[ +0.000003] RDX: 0000000000000000 RSI: ffffffff9b5712d9 RDI: 00000000ffffffff</div> <div>[ +0.000002] RBP: ffffafed0ed27cf0 R08: 0000000000000000 R09: 0000000000000001</div> <div>[ +0.000002] R10: ffffafed0ed27cf0 R11: ffffafed0ed27968 R12: ffff9e0c6cae0000</div> <div>[ +0.000002] R13: ffff9e0c6cae0058 R14: ffff9e0c6cae0158 R15: ffff9e0c6cae0000</div> <div>[ +0.000002] FS: 00007fb8e81390c0(0000) GS:ffff9e2b3fd80000(0000) knlGS:0000000000000000</div> <div>[ +0.000003] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033</div> <div>[ +0.000003] CR2: 00007f68a9ecb1d8 CR3: 000000010e764004 CR4: 00000000001706e0</div> <div>[ +0.000002] Call Trace:</div> <div>[ +0.000003] <TASK></div> <div>[ +0.000005] ttm_bo_release+0x2f2/0x370 [ttm]</div> <div>[ +0.000013] ttm_bo_put+0x30/0x40 [ttm]</div> <div>[ +0.000008] amdgpu_bo_unref+0x1e/0x30 [amdgpu]</div> <div>[ +0.000182] amdgpu_driver_postclose_kms+0x173/0x300 [amdgpu]</div> <div>[ +0.000174] drm_file_free.part.10+0x275/0x2c0 [drm]</div> <div>[ +0.000045] drm_close_helper.isra.11+0x60/0x70 [drm]</div> <div>[ +0.000029] drm_release+0x6a/0xe0 [drm]</div> <div>[ +0.000029] __fput+0x99/0x260</div> <div>[ +0.000009] ____fput+0xe/0x10</div> <div>[ +0.000005] task_work_run+0x6c/0xa0</div> <div>[ +0.000006] exit_to_user_mode_prepare+0x1af/0x1c0</div> <div>[ +0.000005] syscall_exit_to_user_mode+0x2a/0x40</div> <div>[ +0.000006] do_syscall_64+0x46/0xb0</div> <div>[ +0.000006] entry_SYSCALL_64_after_hwframe+0x44/0xae</div> <div>[ +0.000005] RIP: 0033:0x7fb8e76e8511</div> <div>[ +0.000005] Code: f7 d8 64 89 02 48 c7 c0 ff ff ff ff c3 66 2e 0f 1f 84 00 00 00 00 00 66 90 8b 05 fa ce 20 00 85 c0 75 16 b8 03 00 00 00 0f 05 <48> 3d 00 f0 ff ff 77 3f f3 c3 0f 1f 44 00 00 53 89 fb 48 83 ec 10</div> <div>[ +0.000003] RSP: 002b:00007fff89083f58 EFLAGS: 00000246 ORIG_RAX: 0000000000000003</div> <div>[ +0.000004] RAX: 0000000000000000 RBX: 0000562815a3e6a0 RCX: 00007fb8e76e8511</div> <div>[ +0.000002] RDX: 00007fb8e76d1ca0 RSI: 0000562815f75100 RDI: 0000000000000003</div> <div>[ +0.000002] RBP: 0000562815a3e8a0 R08: 0000000000000000 R09: 0000000000000000</div> <div>[ +0.000002] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000</div> <div>[ +0.000002] R13: 0000000000000000 R14: 0000000000000000 R15: 0000562815a3e8a0</div> <div>[ +0.000005] </TASK></div> <div>[ +0.000002] ---[ end trace 7e6704984e7ed0f5 ]---</div> <div>[ +0.001061] [drm:amdgpu_fill_buffer [amdgpu]] *ERROR* Trying to clear memory with ring turned off.</div> <div>[ +0.000346] ------------[ cut here ]------------</div> <div>[ +0.000003] WARNING: CPU: 14 PID: 2834 at drivers/gpu/drm/amd/amdgpu/amdgpu_object.c:1313 amdgpu_bo_release_notify+0x15f/0x170 [amdgpu]</div> <div>[ +0.000230] Modules linked in: nf_conntrack_netlink nfnetlink xfrm_user xt_addrtype br_netfilter xt_CHECKSUM iptable_mangle xt_MASQUERADE iptable_nat nf_nat xt_conntrack nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 ipt_REJECT nf_reject_ipv4 xt_tcpudp bridge stp llc ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter overlay esp6_offload esp6 esp4_offload esp4 xfrm_algo ipmi_ssif intel_rapl_msr snd_hda_codec_hdmi intel_rapl_common sb_edac x86_pkg_temp_thermal snd_hda_intel intel_powerclamp coretemp snd_intel_dspcfg kvm_intel snd_hda_codec snd_hda_core kvm snd_hwdep ftdi_sio snd_pcm snd_timer joydev input_leds usbserial snd irqbypass soundcore rapl iTCO_wdt iTCO_vendor_support ipmi_si mei_me intel_cstate acpi_power_meter ipmi_devintf lpc_ich mei ipmi_msghandler mac_hid sch_fq_codel ib_iser rdma_cm iw_cm ib_cm ib_core iscsi_tcp libiscsi_tcp libiscsi scsi_transport_iscsi ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy</div> <div>[ +0.000103] async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear amdgpu iommu_v2 gpu_sched drm_ttm_helper mgag200 ttm drm_shmem_helper crct10dif_pclmul drm_kms_helper crc32_pclmul syscopyarea sysfillrect hid_generic ghash_clmulni_intel sysimgblt fb_sys_fops uas aesni_intel usbhid ahci crypto_simd igb usb_storage libahci cryptd hid drm dca megaraid_sas i2c_algo_bit wmi</div> <div>[ +0.000049] CPU: 14 PID: 2834 Comm: amdgpu_test Tainted: G W 5.16.0+ #3</div> <div>[ +0.000006] Hardware name: Dell Inc. PowerEdge R730/0H21J3, BIOS 1.5.4 [FPGA Test BIOS] 10/002/2015</div> <div>[ +0.000002] RIP: 0010:amdgpu_bo_release_notify+0x15f/0x170 [amdgpu]</div> <div>[ +0.000228] Code: ff ff ff 48 39 c2 74 07 0f 0b e9 61 ff ff ff 4c 89 e7 e8 d4 a8 15 00 e9 54 ff ff ff e8 3a af 11 da eb cf 0f 0b e9 f0 fe ff ff <0f> 0b eb c4 e8 a8 c4 4b da 0f 1f 84 00 00 00 00 00 0f 1f 44 00 00</div> <div>[ +0.000004] RSP: 0018:ffffafed0ed27cb8 EFLAGS: 00010282</div> <div>[ +0.000005] RAX: 00000000ffffffea RBX: ffff9e0c589d8458 RCX: 0000000000000001</div> <div>[ +0.000003] RDX: 0000000000000000 RSI: ffffffff9b5712d9 RDI: 00000000ffffffff</div> <div>[ +0.000003] RBP: ffffafed0ed27cd8 R08: 0000000000000000 R09: 0000000000000001</div> <div>[ +0.000002] R10: dead000000000122 R11: ffffafed0ed27950 R12: ffff9e0c589d8400</div> <div>[ +0.000003] R13: ffff9e0c589d8458 R14: ffff9e0c589d8558 R15: ffff9e0c5b785360</div> <div>[ +0.000003] FS: 00007fb8e81390c0(0000) GS:ffff9e2b3fbc0000(0000) knlGS:0000000000000000</div> <div>[ +0.000003] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033</div> <div>[ +0.000003] CR2: 00007fce894ebc20 CR3: 000000010e764002 CR4: 00000000001706e0</div> <div>[ +0.000004] Call Trace:</div> <div>[ +0.000002] <TASK></div> <div>[ +0.000004] ttm_bo_release+0x2f2/0x370 [ttm]</div> <div>[ +0.000014] ttm_bo_put+0x30/0x40 [ttm]</div> <div>[ +0.000010] amdgpu_bo_free_kernel+0xc7/0x120 [amdgpu]</div> <div>[ +0.000225] amdgpu_vce_sw_fini+0x42/0x90 [amdgpu]</div> <div>[ +0.000298] vce_v4_0_sw_fini+0x2f/0x50 [amdgpu]</div> <div>[ +0.000290] amdgpu_device_fini_sw+0xcc/0x320 [amdgpu]</div> <div>[ +0.000214] amdgpu_driver_release_kms+0x16/0x30 [amdgpu]</div> <div>[ +0.000215] drm_dev_release+0x28/0x40 [drm]</div> <div>[ +0.000046] drm_minor_release+0x30/0x40 [drm]</div> <div>[ +0.000041] drm_release+0xa1/0xe0 [drm]</div> <div>[ +0.000037] __fput+0x99/0x260</div> <div>[ +0.000008] ____fput+0xe/0x10</div> <div>[ +0.000006] task_work_run+0x6c/0xa0</div> <div>[ +0.000006] exit_to_user_mode_prepare+0x1af/0x1c0</div> <div>[ +0.000006] syscall_exit_to_user_mode+0x2a/0x40</div> <div>[ +0.000005] do_syscall_64+0x46/0xb0</div> <div>[ +0.000007] entry_SYSCALL_64_after_hwframe+0x44/0xae</div> <div>[ +0.000006] RIP: 0033:0x7fb8e76e8511</div> <div>[ +0.000004] Code: f7 d8 64 89 02 48 c7 c0 ff ff ff ff c3 66 2e 0f 1f 84 00 00 00 00 00 66 90 8b 05 fa ce 20 00 85 c0 75 16 b8 03 00 00 00 0f 05 <48> 3d 00 f0 ff ff 77 3f f3 c3 0f 1f 44 00 00 53 89 fb 48 83 ec 10</div> <div>[ +0.000004] RSP: 002b:00007fff89083f58 EFLAGS: 00000246 ORIG_RAX: 0000000000000003</div> <div>[ +0.000005] RAX: 0000000000000000 RBX: 0000562815a3e6a0 RCX: 00007fb8e76e8511</div> <div>[ +0.000003] RDX: 00007fb8e76d1ca0 RSI: 0000562815f75100 RDI: 0000000000000003</div> <div>[ +0.000002] RBP: 0000562815a3e8a0 R08: 0000000000000000 R09: 0000000000000000</div> <div>[ +0.000002] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000</div> <div>[ +0.000003] R13: 0000000000000000 R14: 0000000000000000 R15: 0000562815a3e8a0</div> <div>[ +0.000006] </TASK></div> <div>[ +0.000001] ---[ end trace 7e6704984e7ed0f6 ]---</div> <div>[ +0.000532] [drm:amdgpu_fill_buffer [amdgpu]] *ERROR* Trying to clear memory with ring turned off.</div> <div>[ +0.000362] ------------[ cut here ]------------</div> <div>[ +0.000003] WARNING: CPU: 30 PID: 2834 at drivers/gpu/drm/amd/amdgpu/amdgpu_object.c:1313 amdgpu_bo_release_notify+0x15f/0x170 [amdgpu]</div> <div>[ +0.000233] Modules linked in: nf_conntrack_netlink nfnetlink xfrm_user xt_addrtype br_netfilter xt_CHECKSUM iptable_mangle xt_MASQUERADE iptable_nat nf_nat xt_conntrack nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 ipt_REJECT nf_reject_ipv4 xt_tcpudp bridge stp llc ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter overlay esp6_offload esp6 esp4_offload esp4 xfrm_algo ipmi_ssif intel_rapl_msr snd_hda_codec_hdmi intel_rapl_common sb_edac x86_pkg_temp_thermal snd_hda_intel intel_powerclamp coretemp snd_intel_dspcfg kvm_intel snd_hda_codec snd_hda_core kvm snd_hwdep ftdi_sio snd_pcm snd_timer joydev input_leds usbserial snd irqbypass soundcore rapl iTCO_wdt iTCO_vendor_support ipmi_si mei_me intel_cstate acpi_power_meter ipmi_devintf lpc_ich mei ipmi_msghandler mac_hid sch_fq_codel ib_iser rdma_cm iw_cm ib_cm ib_core iscsi_tcp libiscsi_tcp libiscsi scsi_transport_iscsi ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy</div> <div>[ +0.000102] async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear amdgpu iommu_v2 gpu_sched drm_ttm_helper mgag200 ttm drm_shmem_helper crct10dif_pclmul drm_kms_helper crc32_pclmul syscopyarea sysfillrect hid_generic ghash_clmulni_intel sysimgblt fb_sys_fops uas aesni_intel usbhid ahci crypto_simd igb usb_storage libahci cryptd hid drm dca megaraid_sas i2c_algo_bit wmi</div> <div>[ +0.000048] CPU: 30 PID: 2834 Comm: amdgpu_test Tainted: G W 5.16.0+ #3</div> <div>[ +0.000005] Hardware name: Dell Inc. PowerEdge R730/0H21J3, BIOS 1.5.4 [FPGA Test BIOS] 10/002/2015</div> <div>[ +0.000003] RIP: 0010:amdgpu_bo_release_notify+0x15f/0x170 [amdgpu]</div> <div>[ +0.000228] Code: ff ff ff 48 39 c2 74 07 0f 0b e9 61 ff ff ff 4c 89 e7 e8 d4 a8 15 00 e9 54 ff ff ff e8 3a af 11 da eb cf 0f 0b e9 f0 fe ff ff <0f> 0b eb c4 e8 a8 c4 4b da 0f 1f 84 00 00 00 00 00 0f 1f 44 00 00</div> <div>[ +0.000004] RSP: 0018:ffffafed0ed27c78 EFLAGS: 00010282</div> <div>[ +0.000005] RAX: 00000000ffffffea RBX: ffff9e0c589db458 RCX: 0000000000000001</div> <div>[ +0.000003] RDX: 0000000000000000 RSI: ffffffff9b5712d9 RDI: 00000000ffffffff</div> <div>[ +0.000003] RBP: ffffafed0ed27c98 R08: 0000000000000000 R09: 0000000000000001</div> <div>[ +0.000002] R10: dead000000000122 R11: ffffafed0ed27910 R12: ffff9e0c589db400</div> <div>[ +0.000003] R13: ffff9e0c589db458 R14: ffff9e0c589db558 R15: ffff9e0c5b785360</div> <div>[ +0.000002] FS: 00007fb8e81390c0(0000) GS:ffff9e2b3fdc0000(0000) knlGS:0000000000000000</div> <div>[ +0.000004] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033</div> <div>[ +0.000003] CR2: 00007ffe1c1c1000 CR3: 000000010e764002 CR4: 00000000001706e0</div> <div>[ +0.000004] Call Trace:</div> <div>[ +0.000002] <TASK></div> <div>[ +0.000005] ttm_bo_release+0x2f2/0x370 [ttm]</div> <div>[ +0.000012] ? __free_pages+0x7e/0xa0</div> <div>[ +0.000012] ttm_bo_put+0x30/0x40 [ttm]</div> <div>[ +0.000010] amdgpu_bo_free_kernel+0xc7/0x120 [amdgpu]</div> <div>[ +0.000226] amdgpu_uvd_sw_fini+0x9b/0x120 [amdgpu]</div> <div>[ +0.000295] uvd_v7_0_sw_fini+0x9d/0xb0 [amdgpu]</div> <div>[ +0.000290] amdgpu_device_fini_sw+0xcc/0x320 [amdgpu]</div> <div>[ +0.000214] amdgpu_driver_release_kms+0x16/0x30 [amdgpu]</div> <div>[ +0.000215] drm_dev_release+0x28/0x40 [drm]</div> <div>[ +0.000043] drm_minor_release+0x30/0x40 [drm]</div> <div>[ +0.000042] drm_release+0xa1/0xe0 [drm]</div> <div>[ +0.000037] __fput+0x99/0x260</div> <div>[ +0.000007] ____fput+0xe/0x10</div> <div>[ +0.000006] task_work_run+0x6c/0xa0</div> <div>[ +0.000006] exit_to_user_mode_prepare+0x1af/0x1c0</div> <div>[ +0.000006] syscall_exit_to_user_mode+0x2a/0x40</div> <div>[ +0.000005] do_syscall_64+0x46/0xb0</div> <div>[ +0.000007] entry_SYSCALL_64_after_hwframe+0x44/0xae</div> <div>[ +0.000005] RIP: 0033:0x7fb8e76e8511</div> <div>[ +0.000004] Code: f7 d8 64 89 02 48 c7 c0 ff ff ff ff c3 66 2e 0f 1f 84 00 00 00 00 00 66 90 8b 05 fa ce 20 00 85 c0 75 16 b8 03 00 00 00 0f 05 <48> 3d 00 f0 ff ff 77 3f f3 c3 0f 1f 44 00 00 53 89 fb 48 83 ec 10</div> <div>[ +0.000004] RSP: 002b:00007fff89083f58 EFLAGS: 00000246 ORIG_RAX: 0000000000000003</div> <div>[ +0.000005] RAX: 0000000000000000 RBX: 0000562815a3e6a0 RCX: 00007fb8e76e8511</div> <div>[ +0.000003] RDX: 00007fb8e76d1ca0 RSI: 0000562815f75100 RDI: 0000000000000003</div> <div>[ +0.000002] RBP: 0000562815a3e8a0 R08: 0000000000000000 R09: 0000000000000000</div> <div>[ +0.000002] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000</div> <div>[ +0.000003] R13: 0000000000000000 R14: 0000000000000000 R15: 0000562815a3e8a0</div> <div>[ +0.000006] </TASK></div> <div>[ +0.000001] ---[ end trace 7e6704984e7ed0f7 ]---</div> <div>[ +0.000659] [drm:amdgpu_fill_buffer [amdgpu]] *ERROR* Trying to clear memory with ring turned off.</div> <div>[ +0.000311] ------------[ cut here ]------------</div> <div>[ +0.000001] WARNING: CPU: 30 PID: 2834 at drivers/gpu/drm/amd/amdgpu/amdgpu_object.c:1313 amdgpu_bo_release_notify+0x15f/0x170 [amdgpu]</div> <div>[ +0.000229] Modules linked in: nf_conntrack_netlink nfnetlink xfrm_user xt_addrtype br_netfilter xt_CHECKSUM iptable_mangle xt_MASQUERADE iptable_nat nf_nat xt_conntrack nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 ipt_REJECT nf_reject_ipv4 xt_tcpudp bridge stp llc ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter overlay esp6_offload esp6 esp4_offload esp4 xfrm_algo ipmi_ssif intel_rapl_msr snd_hda_codec_hdmi intel_rapl_common sb_edac x86_pkg_temp_thermal snd_hda_intel intel_powerclamp coretemp snd_intel_dspcfg kvm_intel snd_hda_codec snd_hda_core kvm snd_hwdep ftdi_sio snd_pcm snd_timer joydev input_leds usbserial snd irqbypass soundcore rapl iTCO_wdt iTCO_vendor_support ipmi_si mei_me intel_cstate acpi_power_meter ipmi_devintf lpc_ich mei ipmi_msghandler mac_hid sch_fq_codel ib_iser rdma_cm iw_cm ib_cm ib_core iscsi_tcp libiscsi_tcp libiscsi scsi_transport_iscsi ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy</div> <div>[ +0.000100] async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear amdgpu iommu_v2 gpu_sched drm_ttm_helper mgag200 ttm drm_shmem_helper crct10dif_pclmul drm_kms_helper crc32_pclmul syscopyarea sysfillrect hid_generic ghash_clmulni_intel sysimgblt fb_sys_fops uas aesni_intel usbhid ahci crypto_simd igb usb_storage libahci cryptd hid drm dca megaraid_sas i2c_algo_bit wmi</div> <div>[ +0.000047] CPU: 30 PID: 2834 Comm: amdgpu_test Tainted: G W 5.16.0+ #3</div> <div>[ +0.000004] Hardware name: Dell Inc. PowerEdge R730/0H21J3, BIOS 1.5.4 [FPGA Test BIOS] 10/002/2015</div> <div>[ +0.000002] RIP: 0010:amdgpu_bo_release_notify+0x15f/0x170 [amdgpu]</div> <div>[ +0.000247] Code: ff ff ff 48 39 c2 74 07 0f 0b e9 61 ff ff ff 4c 89 e7 e8 d4 a8 15 00 e9 54 ff ff ff e8 3a af 11 da eb cf 0f 0b e9 f0 fe ff ff <0f> 0b eb c4 e8 a8 c4 4b da 0f 1f 84 00 00 00 00 00 0f 1f 44 00 00</div> <div>[ +0.000006] RSP: 0018:ffffafed0ed27c78 EFLAGS: 00010282</div> <div>[ +0.000004] RAX: 00000000ffffffea RBX: ffff9e0c589df458 RCX: 0000000000000001</div> <div>[ +0.000003] RDX: 0000000000000000 RSI: ffffffff9b5712d9 RDI: 00000000ffffffff</div> <div>[ +0.000004] RBP: ffffafed0ed27c98 R08: 0000000000000000 R09: 0000000000000001</div> <div>[ +0.000003] R10: dead000000000122 R11: ffffafed0ed27910 R12: ffff9e0c589df400</div> <div>[ +0.000003] R13: ffff9e0c589df458 R14: ffff9e0c589df558 R15: ffff9e0c5b785360</div> <div>[ +0.000003] FS: 00007fb8e81390c0(0000) GS:ffff9e2b3fdc0000(0000) knlGS:0000000000000000</div> <div>[ +0.000005] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033</div> <div>[ +0.000003] CR2: 00007ffe1c1c1000 CR3: 000000010e764002 CR4: 00000000001706e0</div> <div>[ +0.000004] Call Trace:</div> <div>[ +0.000002] <TASK></div> <div>[ +0.000004] ttm_bo_release+0x2f2/0x370 [ttm]</div> <div>[ +0.000013] ? __free_pages+0x7e/0xa0</div> <div>[ +0.000010] ttm_bo_put+0x30/0x40 [ttm]</div> <div>[ +0.000010] amdgpu_bo_free_kernel+0xc7/0x120 [amdgpu]</div> <div>[ +0.000225] amdgpu_uvd_sw_fini+0x9b/0x120 [amdgpu]</div> <div>[ +0.000303] uvd_v7_0_sw_fini+0x9d/0xb0 [amdgpu]</div> <div>[ +0.000305] amdgpu_device_fini_sw+0xcc/0x320 [amdgpu]</div> <div>[ +0.000229] amdgpu_driver_release_kms+0x16/0x30 [amdgpu]</div> <div>[ +0.000230] drm_dev_release+0x28/0x40 [drm]</div> <div>[ +0.000044] drm_minor_release+0x30/0x40 [drm]</div> <div>[ +0.000044] drm_release+0xa1/0xe0 [drm]</div> <div>[ +0.000039] __fput+0x99/0x260</div> <div>[ +0.000008] ____fput+0xe/0x10</div> <div>[ +0.000006] task_work_run+0x6c/0xa0</div> <div>[ +0.000007] exit_to_user_mode_prepare+0x1af/0x1c0</div> <div>[ +0.000006] syscall_exit_to_user_mode+0x2a/0x40</div> <div>[ +0.000005] do_syscall_64+0x46/0xb0</div> <div>[ +0.000007] entry_SYSCALL_64_after_hwframe+0x44/0xae</div> <div>[ +0.000005] RIP: 0033:0x7fb8e76e8511</div> <div>[ +0.000005] Code: f7 d8 64 89 02 48 c7 c0 ff ff ff ff c3 66 2e 0f 1f 84 00 00 00 00 00 66 90 8b 05 fa ce 20 00 85 c0 75 16 b8 03 00 00 00 0f 05 <48> 3d 00 f0 ff ff 77 3f f3 c3 0f 1f 44 00 00 53 89 fb 48 83 ec 10</div> <div>[ +0.000004] RSP: 002b:00007fff89083f58 EFLAGS: 00000246 ORIG_RAX: 0000000000000003</div> <div>[ +0.000005] RAX: 0000000000000000 RBX: 0000562815a3e6a0 RCX: 00007fb8e76e8511</div> <div>[ +0.000002] RDX: 00007fb8e76d1ca0 RSI: 0000562815f75100 RDI: 0000000000000003</div> <div>[ +0.000003] RBP: 0000562815a3e8a0 R08: 0000000000000000 R09: 0000000000000000</div> <div>[ +0.000002] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000</div> <div>[ +0.000003] R13: 0000000000000000 R14: 0000000000000000 R15: 0000562815a3e8a0</div> <div>[ +0.000006] </TASK></div> <div>[ +0.000002] ---[ end trace 7e6704984e7ed0f8 ]---</div> <div>[ +0.000745] [drm:amdgpu_fill_buffer [amdgpu]] *ERROR* Trying to clear memory with ring turned off.</div> <div>[ +0.000330] ------------[ cut here ]------------</div> <div>[ +0.000002] WARNING: CPU: 30 PID: 2834 at drivers/gpu/drm/amd/amdgpu/amdgpu_object.c:1313 amdgpu_bo_release_notify+0x15f/0x170 [amdgpu]</div> <div>[ +0.000243] Modules linked in: nf_conntrack_netlink nfnetlink xfrm_user xt_addrtype br_netfilter xt_CHECKSUM iptable_mangle xt_MASQUERADE iptable_nat nf_nat xt_conntrack nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 ipt_REJECT nf_reject_ipv4 xt_tcpudp bridge stp llc ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter overlay esp6_offload esp6 esp4_offload esp4 xfrm_algo ipmi_ssif intel_rapl_msr snd_hda_codec_hdmi intel_rapl_common sb_edac x86_pkg_temp_thermal snd_hda_intel intel_powerclamp coretemp snd_intel_dspcfg kvm_intel snd_hda_codec snd_hda_core kvm snd_hwdep ftdi_sio snd_pcm snd_timer joydev input_leds usbserial snd irqbypass soundcore rapl iTCO_wdt iTCO_vendor_support ipmi_si mei_me intel_cstate acpi_power_meter ipmi_devintf lpc_ich mei ipmi_msghandler mac_hid sch_fq_codel ib_iser rdma_cm iw_cm ib_cm ib_core iscsi_tcp libiscsi_tcp libiscsi scsi_transport_iscsi ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy</div> <div>[ +0.000107] async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear amdgpu iommu_v2 gpu_sched drm_ttm_helper mgag200 ttm drm_shmem_helper crct10dif_pclmul drm_kms_helper crc32_pclmul syscopyarea sysfillrect hid_generic ghash_clmulni_intel sysimgblt fb_sys_fops uas aesni_intel usbhid ahci crypto_simd igb usb_storage libahci cryptd hid drm dca megaraid_sas i2c_algo_bit wmi</div> <div>[ +0.000050] CPU: 30 PID: 2834 Comm: amdgpu_test Tainted: G W 5.16.0+ #3</div> <div>[ +0.000005] Hardware name: Dell Inc. PowerEdge R730/0H21J3, BIOS 1.5.4 [FPGA Test BIOS] 10/002/2015</div> <div>[ +0.000003] RIP: 0010:amdgpu_bo_release_notify+0x15f/0x170 [amdgpu]</div> <div>[ +0.000241] Code: ff ff ff 48 39 c2 74 07 0f 0b e9 61 ff ff ff 4c 89 e7 e8 d4 a8 15 00 e9 54 ff ff ff e8 3a af 11 da eb cf 0f 0b e9 f0 fe ff ff <0f> 0b eb c4 e8 a8 c4 4b da 0f 1f 84 00 00 00 00 00 0f 1f 44 00 00</div> <div>[ +0.000004] RSP: 0018:ffffafed0ed27ca8 EFLAGS: 00010282</div> <div>[ +0.000004] RAX: 00000000ffffffea RBX: ffff9e0c58fd2458 RCX: 0000000000000001</div> <div>[ +0.000003] RDX: 0000000000000000 RSI: ffffffff9b5712d9 RDI: 00000000ffffffff</div> <div>[ +0.000003] RBP: ffffafed0ed27cc8 R08: 0000000000000000 R09: 0000000000000001</div> <div>[ +0.000003] R10: ffffafed0ed27d48 R11: ffffafed0ed27940 R12: ffff9e0c58fd2400</div> <div>[ +0.000002] R13: ffff9e0c58fd2458 R14: ffff9e0c58fd2558 R15: ffff9e0c5b785360</div> <div>[ +0.000003] FS: 00007fb8e81390c0(0000) GS:ffff9e2b3fdc0000(0000) knlGS:0000000000000000</div> <div>[ +0.000004] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033</div> <div>[ +0.000003] CR2: 00007ffe1c1c1000 CR3: 000000010e764002 CR4: 00000000001706e0</div> <div>[ +0.000003] Call Trace:</div> <div>[ +0.000002] <TASK></div> <div>[ +0.000004] ttm_bo_release+0x2f2/0x370 [ttm]</div> <div>[ +0.000011] ? ttm_bo_release+0x261/0x370 [ttm]</div> <div>[ +0.000012] ? __vunmap+0x1c9/0x210</div> <div>[ +0.000007] ttm_bo_put+0x30/0x40 [ttm]</div> <div>[ +0.000011] amdgpu_bo_free_kernel+0xc7/0x120 [amdgpu]</div> <div>[ +0.000242] amdgpu_gfx_mqd_sw_fini+0x96/0x110 [amdgpu]</div> <div>[ +0.000297] gfx_v9_0_sw_fini+0x7b/0x180 [amdgpu]</div> <div>[ +0.000321] amdgpu_device_fini_sw+0xcc/0x320 [amdgpu]</div> <div>[ +0.000231] amdgpu_driver_release_kms+0x16/0x30 [amdgpu]</div> <div>[ +0.000232] drm_dev_release+0x28/0x40 [drm]</div> <div>[ +0.000044] drm_minor_release+0x30/0x40 [drm]</div> <div>[ +0.000044] drm_release+0xa1/0xe0 [drm]</div> <div>[ +0.000040] __fput+0x99/0x260</div> <div>[ +0.000007] ____fput+0xe/0x10</div> <div>[ +0.000007] task_work_run+0x6c/0xa0</div> <div>[ +0.000006] exit_to_user_mode_prepare+0x1af/0x1c0</div> <div>[ +0.000006] syscall_exit_to_user_mode+0x2a/0x40</div> <div>[ +0.000005] do_syscall_64+0x46/0xb0</div> <div>[ +0.000007] entry_SYSCALL_64_after_hwframe+0x44/0xae</div> <div>[ +0.000006] RIP: 0033:0x7fb8e76e8511</div> <div>[ +0.000004] Code: f7 d8 64 89 02 48 c7 c0 ff ff ff ff c3 66 2e 0f 1f 84 00 00 00 00 00 66 90 8b 05 fa ce 20 00 85 c0 75 16 b8 03 00 00 00 0f 05 <48> 3d 00 f0 ff ff 77 3f f3 c3 0f 1f 44 00 00 53 89 fb 48 83 ec 10</div> <div>[ +0.000004] RSP: 002b:00007fff89083f58 EFLAGS: 00000246 ORIG_RAX: 0000000000000003</div> <div>[ +0.000005] RAX: 0000000000000000 RBX: 0000562815a3e6a0 RCX: 00007fb8e76e8511</div> <div>[ +0.000002] RDX: 00007fb8e76d1ca0 RSI: 0000562815f75100 RDI: 0000000000000003</div> <div>[ +0.000003] RBP: 0000562815a3e8a0 R08: 0000000000000000 R09: 0000000000000000</div> <div>[ +0.000002] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000</div> <div>[ +0.000003] R13: 0000000000000000 R14: 0000000000000000 R15: 0000562815a3e8a0</div> <div>[ +0.000006] </TASK></div> <div>[ +0.000002] ---[ end trace 7e6704984e7ed0f9 ]---</div> <div>[ +0.000652] [drm:amdgpu_fill_buffer [amdgpu]] *ERROR* Trying to clear memory with ring turned off.</div> <div>[ +0.000329] ------------[ cut here ]------------</div> <div>[ +0.000001] WARNING: CPU: 30 PID: 2834 at drivers/gpu/drm/amd/amdgpu/amdgpu_object.c:1313 amdgpu_bo_release_notify+0x15f/0x170 [amdgpu]</div> <div>[ +0.000208] Modules linked in: nf_conntrack_netlink nfnetlink xfrm_user xt_addrtype br_netfilter xt_CHECKSUM iptable_mangle xt_MASQUERADE iptable_nat nf_nat xt_conntrack nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 ipt_REJECT nf_reject_ipv4 xt_tcpudp bridge stp llc ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter overlay esp6_offload esp6 esp4_offload esp4 xfrm_algo ipmi_ssif intel_rapl_msr snd_hda_codec_hdmi intel_rapl_common sb_edac x86_pkg_temp_thermal snd_hda_intel intel_powerclamp coretemp snd_intel_dspcfg kvm_intel snd_hda_codec snd_hda_core kvm snd_hwdep ftdi_sio snd_pcm snd_timer joydev input_leds usbserial snd irqbypass soundcore rapl iTCO_wdt iTCO_vendor_support ipmi_si mei_me intel_cstate acpi_power_meter ipmi_devintf lpc_ich mei ipmi_msghandler mac_hid sch_fq_codel ib_iser rdma_cm iw_cm ib_cm ib_core iscsi_tcp libiscsi_tcp libiscsi scsi_transport_iscsi ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy</div> <div>[ +0.000044] async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear amdgpu iommu_v2 gpu_sched drm_ttm_helper mgag200 ttm drm_shmem_helper crct10dif_pclmul drm_kms_helper crc32_pclmul syscopyarea sysfillrect hid_generic ghash_clmulni_intel sysimgblt fb_sys_fops uas aesni_intel usbhid ahci crypto_simd igb usb_storage libahci cryptd hid drm dca megaraid_sas i2c_algo_bit wmi</div> <div>[ +0.000020] CPU: 30 PID: 2834 Comm: amdgpu_test Tainted: G W 5.16.0+ #3</div> <div>[ +0.000002] Hardware name: Dell Inc. PowerEdge R730/0H21J3, BIOS 1.5.4 [FPGA Test BIOS] 10/002/2015</div> <div>[ +0.000001] RIP: 0010:amdgpu_bo_release_notify+0x15f/0x170 [amdgpu]</div> <div>[ +0.000108] Code: ff ff ff 48 39 c2 74 07 0f 0b e9 61 ff ff ff 4c 89 e7 e8 d4 a8 15 00 e9 54 ff ff ff e8 3a af 11 da eb cf 0f 0b e9 f0 fe ff ff <0f> 0b eb c4 e8 a8 c4 4b da 0f 1f 84 00 00 00 00 00 0f 1f 44 00 00</div> <div>[ +0.000002] RSP: 0018:ffffafed0ed27cb8 EFLAGS: 00010282</div> <div>[ +0.000001] RAX: 00000000ffffffea RBX: ffff9e0c58fd2058 RCX: 0000000000000001</div> <div>[ +0.000002] RDX: 0000000000000000 RSI: ffffffff9b5712d9 RDI: 00000000ffffffff</div> <div>[ +0.000001] RBP: ffffafed0ed27cd8 R08: 0000000000000000 R09: 0000000000000001</div> <div>[ +0.000001] R10: ffffafed0ed27c70 R11: ffffafed0ed27950 R12: ffff9e0c58fd2000</div> <div>[ +0.000001] R13: ffff9e0c58fd2058 R14: ffff9e0c58fd2158 R15: ffff9e0c5b785360</div> <div>[ +0.000001] FS: 00007fb8e81390c0(0000) GS:ffff9e2b3fdc0000(0000) knlGS:0000000000000000</div> <div>[ +0.000002] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033</div> <div>[ +0.000001] CR2: 00007ffe1c1c1000 CR3: 000000010e764002 CR4: 00000000001706e0</div> <div>[ +0.000001] Call Trace:</div> <div>[ +0.000001] <TASK></div> <div>[ +0.000002] ttm_bo_release+0x2f2/0x370 [ttm]</div> <div>[ +0.000005] ? ttm_bo_release+0x261/0x370 [ttm]</div> <div>[ +0.000005] ttm_bo_put+0x30/0x40 [ttm]</div> <div>[ +0.000003] amdgpu_bo_free_kernel+0xc7/0x120 [amdgpu]</div> <div>[ +0.000107] gfx_v9_0_mec_fini+0x1d/0x30 [amdgpu]</div> <div>[ +0.000132] gfx_v9_0_sw_fini+0x97/0x180 [amdgpu]</div> <div>[ +0.000129] amdgpu_device_fini_sw+0xcc/0x320 [amdgpu]</div> <div>[ +0.000104] amdgpu_driver_release_kms+0x16/0x30 [amdgpu]</div> <div>[ +0.000102] drm_dev_release+0x28/0x40 [drm]</div> <div>[ +0.000020] drm_minor_release+0x30/0x40 [drm]</div> <div>[ +0.000017] drm_release+0xa1/0xe0 [drm]</div> <div>[ +0.000016] __fput+0x99/0x260</div> <div>[ +0.000003] ____fput+0xe/0x10</div> <div>[ +0.000003] task_work_run+0x6c/0xa0</div> <div>[ +0.000003] exit_to_user_mode_prepare+0x1af/0x1c0</div> <div>[ +0.000002] syscall_exit_to_user_mode+0x2a/0x40</div> <div>[ +0.000003] do_syscall_64+0x46/0xb0</div> <div>[ +0.000002] entry_SYSCALL_64_after_hwframe+0x44/0xae</div> <div>[ +0.000003] RIP: 0033:0x7fb8e76e8511</div> <div>[ +0.000001] Code: f7 d8 64 89 02 48 c7 c0 ff ff ff ff c3 66 2e 0f 1f 84 00 00 00 00 00 66 90 8b 05 fa ce 20 00 85 c0 75 16 b8 03 00 00 00 0f 05 <48> 3d 00 f0 ff ff 77 3f f3 c3 0f 1f 44 00 00 53 89 fb 48 83 ec 10</div> <div>[ +0.000002] RSP: 002b:00007fff89083f58 EFLAGS: 00000246 ORIG_RAX: 0000000000000003</div> <div>[ +0.000002] RAX: 0000000000000000 RBX: 0000562815a3e6a0 RCX: 00007fb8e76e8511</div> <div>[ +0.000001] RDX: 00007fb8e76d1ca0 RSI: 0000562815f75100 RDI: 0000000000000003</div> <div>[ +0.000001] RBP: 0000562815a3e8a0 R08: 0000000000000000 R09: 0000000000000000</div> <div>[ +0.000001] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000</div> <div>[ +0.000001] R13: 0000000000000000 R14: 0000000000000000 R15: 0000562815a3e8a0</div> <div>[ +0.000002] </TASK></div> <div>[ +0.000001] ---[ end trace 7e6704984e7ed0fa ]---</div> <div>[ +0.000617] [drm:amdgpu_fill_buffer [amdgpu]] *ERROR* Trying to clear memory with ring turned off.</div> <div>[ +0.000147] ------------[ cut here ]------------</div> <div>[ +0.000000] WARNING: CPU: 30 PID: 2834 at drivers/gpu/drm/amd/amdgpu/amdgpu_object.c:1313 amdgpu_bo_release_notify+0x15f/0x170 [amdgpu]</div> <div>[ +0.000109] Modules linked in: nf_conntrack_netlink nfnetlink xfrm_user xt_addrtype br_netfilter xt_CHECKSUM iptable_mangle xt_MASQUERADE iptable_nat nf_nat xt_conntrack nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 ipt_REJECT nf_reject_ipv4 xt_tcpudp bridge stp llc ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter overlay esp6_offload esp6 esp4_offload esp4 xfrm_algo ipmi_ssif intel_rapl_msr snd_hda_codec_hdmi intel_rapl_common sb_edac x86_pkg_temp_thermal snd_hda_intel intel_powerclamp coretemp snd_intel_dspcfg kvm_intel snd_hda_codec snd_hda_core kvm snd_hwdep ftdi_sio snd_pcm snd_timer joydev input_leds usbserial snd irqbypass soundcore rapl iTCO_wdt iTCO_vendor_support ipmi_si mei_me intel_cstate acpi_power_meter ipmi_devintf lpc_ich mei ipmi_msghandler mac_hid sch_fq_codel ib_iser rdma_cm iw_cm ib_cm ib_core iscsi_tcp libiscsi_tcp libiscsi scsi_transport_iscsi ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy</div> <div>[ +0.000044] async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear amdgpu iommu_v2 gpu_sched drm_ttm_helper mgag200 ttm drm_shmem_helper crct10dif_pclmul drm_kms_helper crc32_pclmul syscopyarea sysfillrect hid_generic ghash_clmulni_intel sysimgblt fb_sys_fops uas aesni_intel usbhid ahci crypto_simd igb usb_storage libahci cryptd hid drm dca megaraid_sas i2c_algo_bit wmi</div> <div>[ +0.000020] CPU: 30 PID: 2834 Comm: amdgpu_test Tainted: G W 5.16.0+ #3</div> <div>[ +0.000002] Hardware name: Dell Inc. PowerEdge R730/0H21J3, BIOS 1.5.4 [FPGA Test BIOS] 10/002/2015</div> <div>[ +0.000001] RIP: 0010:amdgpu_bo_release_notify+0x15f/0x170 [amdgpu]</div> <div>[ +0.000118] Code: ff ff ff 48 39 c2 74 07 0f 0b e9 61 ff ff ff 4c 89 e7 e8 d4 a8 15 00 e9 54 ff ff ff e8 3a af 11 da eb cf 0f 0b e9 f0 fe ff ff <0f> 0b eb c4 e8 a8 c4 4b da 0f 1f 84 00 00 00 00 00 0f 1f 44 00 00</div> <div>[ +0.000003] RSP: 0018:ffffafed0ed27cd0 EFLAGS: 00010282</div> <div>[ +0.000002] RAX: 00000000ffffffea RBX: ffff9e0c58fd7458 RCX: 0000000000000001</div> <div>[ +0.000002] RDX: 0000000000000000 RSI: ffffffff9b5712d9 RDI: 00000000ffffffff</div> <div>[ +0.000002] RBP: ffffafed0ed27cf0 R08: 0000000000000000 R09: 0000000000000001</div> <div>[ +0.000001] R10: ffffafed0ed27c68 R11: ffffafed0ed27968 R12: ffff9e0c58fd7400</div> <div>[ +0.000002] R13: ffff9e0c58fd7458 R14: ffff9e0c58fd7558 R15: ffff9e0c5b785360</div> <div>[ +0.000002] FS: 00007fb8e81390c0(0000) GS:ffff9e2b3fdc0000(0000) knlGS:0000000000000000</div> <div>[ +0.000002] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033</div> <div>[ +0.000001] CR2: 00007ffe1c1c1000 CR3: 000000010e764002 CR4: 00000000001706e0</div> <div>[ +0.000002] Call Trace:</div> <div>[ +0.000001] <TASK></div> <div>[ +0.000003] ttm_bo_release+0x2f2/0x370 [ttm]</div> <div>[ +0.000006] ttm_bo_put+0x30/0x40 [ttm]</div> <div>[ +0.000005] amdgpu_bo_free_kernel+0xc7/0x120 [amdgpu]</div> <div>[ +0.000107] gfx_v9_0_sw_fini+0xb1/0x180 [amdgpu]</div> <div>[ +0.000130] amdgpu_device_fini_sw+0xcc/0x320 [amdgpu]</div> <div>[ +0.000103] amdgpu_driver_release_kms+0x16/0x30 [amdgpu]</div> <div>[ +0.000108] drm_dev_release+0x28/0x40 [drm]</div> <div>[ +0.000020] drm_minor_release+0x30/0x40 [drm]</div> <div>[ +0.000017] drm_release+0xa1/0xe0 [drm]</div> <div>[ +0.000016] __fput+0x99/0x260</div> <div>[ +0.000004] ____fput+0xe/0x10</div> <div>[ +0.000002] task_work_run+0x6c/0xa0</div> <div>[ +0.000003] exit_to_user_mode_prepare+0x1af/0x1c0</div> <div>[ +0.000003] syscall_exit_to_user_mode+0x2a/0x40</div> <div>[ +0.000002] do_syscall_64+0x46/0xb0</div> <div>[ +0.000003] entry_SYSCALL_64_after_hwframe+0x44/0xae</div> <div>[ +0.000002] RIP: 0033:0x7fb8e76e8511</div> <div>[ +0.000002] Code: f7 d8 64 89 02 48 c7 c0 ff ff ff ff c3 66 2e 0f 1f 84 00 00 00 00 00 66 90 8b 05 fa ce 20 00 85 c0 75 16 b8 03 00 00 00 0f 05 <48> 3d 00 f0 ff ff 77 3f f3 c3 0f 1f 44 00 00 53 89 fb 48 83 ec 10</div> <div>[ +0.000001] RSP: 002b:00007fff89083f58 EFLAGS: 00000246 ORIG_RAX: 0000000000000003</div> <div>[ +0.000002] RAX: 0000000000000000 RBX: 0000562815a3e6a0 RCX: 00007fb8e76e8511</div> <div>[ +0.000001] RDX: 00007fb8e76d1ca0 RSI: 0000562815f75100 RDI: 0000000000000003</div> <div>[ +0.000001] RBP: 0000562815a3e8a0 R08: 0000000000000000 R09: 0000000000000000</div> <div>[ +0.000001] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000</div> <div>[ +0.000001] R13: 0000000000000000 R14: 0000000000000000 R15: 0000562815a3e8a0</div> <div>[ +0.000003] </TASK></div> <div>[ +0.000000] ---[ end trace 7e6704984e7ed0fb ]---</div> <div>[ +0.000583] ------------[ cut here ]------------</div> <div>[ +0.000004] sysfs group 'power' not found for kobject 'i2c-5'</div> <div>[ +0.000008] WARNING: CPU: 22 PID: 2834 at fs/sysfs/group.c:280 sysfs_remove_group+0x80/0x90</div> <div>[ +0.000012] Modules linked in: nf_conntrack_netlink nfnetlink xfrm_user xt_addrtype br_netfilter xt_CHECKSUM iptable_mangle xt_MASQUERADE iptable_nat nf_nat xt_conntrack nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 ipt_REJECT nf_reject_ipv4 xt_tcpudp bridge stp llc ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter overlay esp6_offload esp6 esp4_offload esp4 xfrm_algo ipmi_ssif intel_rapl_msr snd_hda_codec_hdmi intel_rapl_common sb_edac x86_pkg_temp_thermal snd_hda_intel intel_powerclamp coretemp snd_intel_dspcfg kvm_intel snd_hda_codec snd_hda_core kvm snd_hwdep ftdi_sio snd_pcm snd_timer joydev input_leds usbserial snd irqbypass soundcore rapl iTCO_wdt iTCO_vendor_support ipmi_si mei_me intel_cstate acpi_power_meter ipmi_devintf lpc_ich mei ipmi_msghandler mac_hid sch_fq_codel ib_iser rdma_cm iw_cm ib_cm ib_core iscsi_tcp libiscsi_tcp libiscsi scsi_transport_iscsi ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy</div> <div>[ +0.000089] async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear amdgpu iommu_v2 gpu_sched drm_ttm_helper mgag200 ttm drm_shmem_helper crct10dif_pclmul drm_kms_helper crc32_pclmul syscopyarea sysfillrect hid_generic ghash_clmulni_intel sysimgblt fb_sys_fops uas aesni_intel usbhid ahci crypto_simd igb usb_storage libahci cryptd hid drm dca megaraid_sas i2c_algo_bit wmi</div> <div>[ +0.000042] CPU: 22 PID: 2834 Comm: amdgpu_test Tainted: G W 5.16.0+ #3</div> <div>[ +0.000004] Hardware name: Dell Inc. PowerEdge R730/0H21J3, BIOS 1.5.4 [FPGA Test BIOS] 10/002/2015</div> <div>[ +0.000003] RIP: 0010:sysfs_remove_group+0x80/0x90</div> <div>[ +0.000006] Code: e8 b5 b4 ff ff 5b 41 5c 41 5d 5d c3 48 89 df e8 b6 b0 ff ff eb c6 49 8b 55 00 49 8b 34 24 48 c7 c7 78 65 59 9b e8 40 4b cb ff <0f> 0b 5b 41 5c 41 5d 5d c3 0f 1f 80 00 00 00 00 0f 1f 44 00 00 48</div> <div>[ +0.000004] RSP: 0018:ffffafed0ed27b88 EFLAGS: 00010286</div> <div>[ +0.000004] RAX: 0000000000000000 RBX: 0000000000000000 RCX: 0000000000000001</div> <div>[ +0.000002] RDX: 0000000080000001 RSI: ffffffff9b5712d9 RDI: 00000000ffffffff</div> <div>[ +0.000003] RBP: ffffafed0ed27ba0 R08: 0000000000000000 R09: 0000000000000001</div> <div>[ +0.000002] R10: 0000000000000000 R11: ffffafed0ed27958 R12: ffffffff9b2b95a0</div> <div>[ +0.000003] R13: ffff9e0c58fd1c18 R14: ffff9e0c5b7885c0 R15: 00000000ffffffff</div> <div>[ +0.000002] FS: 00007fb8e81390c0(0000) GS:ffff9e2b3fcc0000(0000) knlGS:0000000000000000</div> <div>[ +0.000003] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033</div> <div>[ +0.000003] CR2: 00007fd86c031378 CR3: 000000010e764001 CR4: 00000000001706e0</div> <div>[ +0.000003] Call Trace:</div> <div>[ +0.000002] <TASK></div> <div>[ +0.000003] dpm_sysfs_remove+0x59/0x60</div> <div>[ +0.000010] device_del+0xb8/0x3f0</div> <div>[ +0.000008] cdev_device_del+0x1a/0x40</div> <div>[ +0.000005] i2cdev_detach_adapter+0x85/0xc0</div> <div>[ +0.000008] i2cdev_notifier_call+0x1f/0x40</div> <div>[ +0.000006] blocking_notifier_call_chain+0x69/0x90</div> <div>[ +0.000006] device_del+0xb0/0x3f0</div> <div>[ +0.000006] device_unregister+0x17/0x60</div> <div>[ +0.000004] i2c_del_adapter+0x251/0x310</div> <div>[ +0.000008] smu_v11_0_i2c_control_fini+0x19/0x40 [amdgpu]</div> <div>[ +0.000229] vega20_smu_fini+0x1e/0xe0 [amdgpu]</div> <div>[ +0.000314] hwmgr_sw_fini+0x28/0x30 [amdgpu]</div> <div>[ +0.000318] pp_sw_fini+0x19/0x40 [amdgpu]</div> <div>[ +0.000340] amdgpu_device_fini_sw+0xcc/0x320 [amdgpu]</div> <div>[ +0.000196] amdgpu_driver_release_kms+0x16/0x30 [amdgpu]</div> <div>[ +0.000197] drm_dev_release+0x28/0x40 [drm]</div> <div>[ +0.000039] drm_minor_release+0x30/0x40 [drm]</div> <div>[ +0.000037] drm_release+0xa1/0xe0 [drm]</div> <div>[ +0.000034] __fput+0x99/0x260</div> <div>[ +0.000007] ____fput+0xe/0x10</div> <div>[ +0.000005] task_work_run+0x6c/0xa0</div> <div>[ +0.000006] exit_to_user_mode_prepare+0x1af/0x1c0</div> <div>[ +0.000005] syscall_exit_to_user_mode+0x2a/0x40</div> <div>[ +0.000004] do_syscall_64+0x46/0xb0</div> <div>[ +0.000006] entry_SYSCALL_64_after_hwframe+0x44/0xae</div> <div>[ +0.000005] RIP: 0033:0x7fb8e76e8511</div> <div>[ +0.000004] Code: f7 d8 64 89 02 48 c7 c0 ff ff ff ff c3 66 2e 0f 1f 84 00 00 00 00 00 66 90 8b 05 fa ce 20 00 85 c0 75 16 b8 03 00 00 00 0f 05 <48> 3d 00 f0 ff ff 77 3f f3 c3 0f 1f 44 00 00 53 89 fb 48 83 ec 10</div> <div>[ +0.000004] RSP: 002b:00007fff89083f58 EFLAGS: 00000246 ORIG_RAX: 0000000000000003</div> <div>[ +0.000004] RAX: 0000000000000000 RBX: 0000562815a3e6a0 RCX: 00007fb8e76e8511</div> <div>[ +0.000003] RDX: 00007fb8e76d1ca0 RSI: 0000562815f75100 RDI: 0000000000000003</div> <div>[ +0.000002] RBP: 0000562815a3e8a0 R08: 0000000000000000 R09: 0000000000000000</div> <div>[ +0.000002] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000</div> <div>[ +0.000002] R13: 0000000000000000 R14: 0000000000000000 R15: 0000562815a3e8a0</div> <div>[ +0.000005] </TASK></div> <div>[ +0.000002] ---[ end trace 7e6704984e7ed0fc ]---</div> <div>[ +0.000062] ------------[ cut here ]------------</div> <div>[ +0.000002] sysfs group 'power' not found for kobject 'i2c-5'</div> <div>[ +0.000007] WARNING: CPU: 22 PID: 2834 at fs/sysfs/group.c:280 sysfs_remove_group+0x80/0x90</div> <div>[ +0.000009] Modules linked in: nf_conntrack_netlink nfnetlink xfrm_user xt_addrtype br_netfilter xt_CHECKSUM iptable_mangle xt_MASQUERADE iptable_nat nf_nat xt_conntrack nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 ipt_REJECT nf_reject_ipv4 xt_tcpudp bridge stp llc ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter overlay esp6_offload esp6 esp4_offload esp4 xfrm_algo ipmi_ssif intel_rapl_msr snd_hda_codec_hdmi intel_rapl_common sb_edac x86_pkg_temp_thermal snd_hda_intel intel_powerclamp coretemp snd_intel_dspcfg kvm_intel snd_hda_codec snd_hda_core kvm snd_hwdep ftdi_sio snd_pcm snd_timer joydev input_leds usbserial snd irqbypass soundcore rapl iTCO_wdt iTCO_vendor_support ipmi_si mei_me intel_cstate acpi_power_meter ipmi_devintf lpc_ich mei ipmi_msghandler mac_hid sch_fq_codel ib_iser rdma_cm iw_cm ib_cm ib_core iscsi_tcp libiscsi_tcp libiscsi scsi_transport_iscsi ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy</div> <div>[ +0.000085] async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear amdgpu iommu_v2 gpu_sched drm_ttm_helper mgag200 ttm drm_shmem_helper crct10dif_pclmul drm_kms_helper crc32_pclmul syscopyarea sysfillrect hid_generic ghash_clmulni_intel sysimgblt fb_sys_fops uas aesni_intel usbhid ahci crypto_simd igb usb_storage libahci cryptd hid drm dca megaraid_sas i2c_algo_bit wmi</div> <div>[ +0.000040] CPU: 22 PID: 2834 Comm: amdgpu_test Tainted: G W 5.16.0+ #3</div> <div>[ +0.000004] Hardware name: Dell Inc. PowerEdge R730/0H21J3, BIOS 1.5.4 [FPGA Test BIOS] 10/002/2015</div> <div>[ +0.000002] RIP: 0010:sysfs_remove_group+0x80/0x90</div> <div>[ +0.000006] Code: e8 b5 b4 ff ff 5b 41 5c 41 5d 5d c3 48 89 df e8 b6 b0 ff ff eb c6 49 8b 55 00 49 8b 34 24 48 c7 c7 78 65 59 9b e8 40 4b cb ff <0f> 0b 5b 41 5c 41 5d 5d c3 0f 1f 80 00 00 00 00 0f 1f 44 00 00 48</div> <div>[ +0.000004] RSP: 0018:ffffafed0ed27c70 EFLAGS: 00010286</div> <div>[ +0.000003] RAX: 0000000000000000 RBX: 0000000000000000 RCX: 0000000000000001</div> <div>[ +0.000002] RDX: 0000000080000001 RSI: ffffffff9b5712d9 RDI: 00000000ffffffff</div> <div>[ +0.000003] RBP: ffffafed0ed27c88 R08: 0000000000000000 R09: 0000000000000001</div> <div>[ +0.000002] R10: ffffafed0ed27ba0 R11: ffffafed0ed27a40 R12: ffffffff9b2b95a0</div> <div>[ +0.000002] R13: ffff9e0c5b7885c0 R14: ffff9e0c488650d0 R15: ffff9e0c530a6a80</div> <div>[ +0.000003] FS: 00007fb8e81390c0(0000) GS:ffff9e2b3fcc0000(0000) knlGS:0000000000000000</div> <div>[ +0.000003] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033</div> <div>[ +0.000003] CR2: 00007fd86c031378 CR3: 000000010e764001 CR4: 00000000001706e0</div> <div>[ +0.000002] Call Trace:</div> <div>[ +0.000002] <TASK></div> <div>[ +0.000002] dpm_sysfs_remove+0x59/0x60</div> <div>[ +0.000007] device_del+0xb8/0x3f0</div> <div>[ +0.000006] device_unregister+0x17/0x60</div> <div>[ +0.000005] i2c_del_adapter+0x251/0x310</div> <div>[ +0.000006] smu_v11_0_i2c_control_fini+0x19/0x40 [amdgpu]</div> <div>[ +0.000228] vega20_smu_fini+0x1e/0xe0 [amdgpu]</div> <div>[ +0.000330] hwmgr_sw_fini+0x28/0x30 [amdgpu]</div> <div>[ +0.000317] pp_sw_fini+0x19/0x40 [amdgpu]</div> <div>[ +0.000338] amdgpu_device_fini_sw+0xcc/0x320 [amdgpu]</div> <div>[ +0.000197] amdgpu_driver_release_kms+0x16/0x30 [amdgpu]</div> <div>[ +0.000197] drm_dev_release+0x28/0x40 [drm]</div> <div>[ +0.000037] drm_minor_release+0x30/0x40 [drm]</div> <div>[ +0.000038] drm_release+0xa1/0xe0 [drm]</div> <div>[ +0.000034] __fput+0x99/0x260</div> <div>[ +0.000007] ____fput+0xe/0x10</div> <div>[ +0.000006] task_work_run+0x6c/0xa0</div> <div>[ +0.000005] exit_to_user_mode_prepare+0x1af/0x1c0</div> <div>[ +0.000005] syscall_exit_to_user_mode+0x2a/0x40</div> <div>[ +0.000005] do_syscall_64+0x46/0xb0</div> <div>[ +0.000006] entry_SYSCALL_64_after_hwframe+0x44/0xae</div> <div>[ +0.000004] RIP: 0033:0x7fb8e76e8511</div> <div>[ +0.000004] Code: f7 d8 64 89 02 48 c7 c0 ff ff ff ff c3 66 2e 0f 1f 84 00 00 00 00 00 66 90 8b 05 fa ce 20 00 85 c0 75 16 b8 03 00 00 00 0f 05 <48> 3d 00 f0 ff ff 77 3f f3 c3 0f 1f 44 00 00 53 89 fb 48 83 ec 10</div> <div>[ +0.000003] RSP: 002b:00007fff89083f58 EFLAGS: 00000246 ORIG_RAX: 0000000000000003</div> <div>[ +0.000004] RAX: 0000000000000000 RBX: 0000562815a3e6a0 RCX: 00007fb8e76e8511</div> <div>[ +0.000002] RDX: 00007fb8e76d1ca0 RSI: 0000562815f75100 RDI: 0000000000000003</div> <div>[ +0.000002] RBP: 0000562815a3e8a0 R08: 0000000000000000 R09: 0000000000000000</div> <div>[ +0.000002] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000</div> <div>[ +0.000003] R13: 0000000000000000 R14: 0000000000000000 R15: 0000562815a3e8a0</div> <div>[ +0.000004] </TASK></div> <div>[ +0.000002] ---[ end trace 7e6704984e7ed0fd ]---</div> <div>[ +0.000027] [drm:amdgpu_fill_buffer [amdgpu]] *ERROR* Trying to clear memory with ring turned off.</div> <div>[ +0.000284] ------------[ cut here ]------------</div> <div>[ +0.000002] WARNING: CPU: 22 PID: 2834 at drivers/gpu/drm/amd/amdgpu/amdgpu_object.c:1313 amdgpu_bo_release_notify+0x15f/0x170 [amdgpu]</div> <div>[ +0.000209] Modules linked in: nf_conntrack_netlink nfnetlink xfrm_user xt_addrtype br_netfilter xt_CHECKSUM iptable_mangle xt_MASQUERADE iptable_nat nf_nat xt_conntrack nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 ipt_REJECT nf_reject_ipv4 xt_tcpudp bridge stp llc ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter overlay esp6_offload esp6 esp4_offload esp4 xfrm_algo ipmi_ssif intel_rapl_msr snd_hda_codec_hdmi intel_rapl_common sb_edac x86_pkg_temp_thermal snd_hda_intel intel_powerclamp coretemp snd_intel_dspcfg kvm_intel snd_hda_codec snd_hda_core kvm snd_hwdep ftdi_sio snd_pcm snd_timer joydev input_leds usbserial snd irqbypass soundcore rapl iTCO_wdt iTCO_vendor_support ipmi_si mei_me intel_cstate acpi_power_meter ipmi_devintf lpc_ich mei ipmi_msghandler mac_hid sch_fq_codel ib_iser rdma_cm iw_cm ib_cm ib_core iscsi_tcp libiscsi_tcp libiscsi scsi_transport_iscsi ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy</div> <div>[ +0.000092] async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear amdgpu iommu_v2 gpu_sched drm_ttm_helper mgag200 ttm drm_shmem_helper crct10dif_pclmul drm_kms_helper crc32_pclmul syscopyarea sysfillrect hid_generic ghash_clmulni_intel sysimgblt fb_sys_fops uas aesni_intel usbhid ahci crypto_simd igb usb_storage libahci cryptd hid drm dca megaraid_sas i2c_algo_bit wmi</div> <div>[ +0.000043] CPU: 22 PID: 2834 Comm: amdgpu_test Tainted: G W 5.16.0+ #3</div> <div>[ +0.000005] Hardware name: Dell Inc. PowerEdge R730/0H21J3, BIOS 1.5.4 [FPGA Test BIOS] 10/002/2015</div> <div>[ +0.000002] RIP: 0010:amdgpu_bo_release_notify+0x15f/0x170 [amdgpu]</div> <div>[ +0.000207] Code: ff ff ff 48 39 c2 74 07 0f 0b e9 61 ff ff ff 4c 89 e7 e8 d4 a8 15 00 e9 54 ff ff ff e8 3a af 11 da eb cf 0f 0b e9 f0 fe ff ff <0f> 0b eb c4 e8 a8 c4 4b da 0f 1f 84 00 00 00 00 00 0f 1f 44 00 00</div> <div>[ +0.000004] RSP: 0018:ffffafed0ed27ca8 EFLAGS: 00010282</div> <div>[ +0.000004] RAX: 00000000ffffffea RBX: ffff9e0c58ec5058 RCX: 0000000000000001</div> <div>[ +0.000002] RDX: 0000000000000000 RSI: ffffffff9b5712d9 RDI: 00000000ffffffff</div> <div>[ +0.000003] RBP: ffffafed0ed27cc8 R08: 0000000000000000 R09: 0000000000000001</div> <div>[ +0.000002] R10: 0000000000000000 R11: ffffafed0ed27940 R12: ffff9e0c58ec5000</div> <div>[ +0.000002] R13: ffff9e0c58ec5058 R14: ffff9e0c58ec5158 R15: ffff9e0c5b785360</div> <div>[ +0.000003] FS: 00007fb8e81390c0(0000) GS:ffff9e2b3fcc0000(0000) knlGS:0000000000000000</div> <div>[ +0.000003] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033</div> <div>[ +0.000002] CR2: 00007fd86c031378 CR3: 000000010e764001 CR4: 00000000001706e0</div> <div>[ +0.000003] Call Trace:</div> <div>[ +0.000001] <TASK></div> <div>[ +0.000003] ttm_bo_release+0x2f2/0x370 [ttm]</div> <div>[ +0.000011] ? idr_remove+0x11/0x20</div> <div>[ +0.000008] ttm_bo_put+0x30/0x40 [ttm]</div> <div>[ +0.000010] amdgpu_bo_free_kernel+0xc7/0x120 [amdgpu]</div> <div>[ +0.000206] vega20_smu_fini+0x38/0xe0 [amdgpu]</div> <div>[ +0.000320] hwmgr_sw_fini+0x28/0x30 [amdgpu]</div> <div>[ +0.000317] pp_sw_fini+0x19/0x40 [amdgpu]</div> <div>[ +0.000339] amdgpu_device_fini_sw+0xcc/0x320 [amdgpu]</div> <div>[ +0.000197] amdgpu_driver_release_kms+0x16/0x30 [amdgpu]</div> <div>[ +0.000198] drm_dev_release+0x28/0x40 [drm]</div> <div>[ +0.000038] drm_minor_release+0x30/0x40 [drm]</div> <div>[ +0.000037] drm_release+0xa1/0xe0 [drm]</div> <div>[ +0.000034] __fput+0x99/0x260</div> <div>[ +0.000007] ____fput+0xe/0x10</div> <div>[ +0.000006] task_work_run+0x6c/0xa0</div> <div>[ +0.000005] exit_to_user_mode_prepare+0x1af/0x1c0</div> <div>[ +0.000005] syscall_exit_to_user_mode+0x2a/0x40</div> <div>[ +0.000005] do_syscall_64+0x46/0xb0</div> <div>[ +0.000006] entry_SYSCALL_64_after_hwframe+0x44/0xae</div> <div>[ +0.000004] RIP: 0033:0x7fb8e76e8511</div> <div>[ +0.000004] Code: f7 d8 64 89 02 48 c7 c0 ff ff ff ff c3 66 2e 0f 1f 84 00 00 00 00 00 66 90 8b 05 fa ce 20 00 85 c0 75 16 b8 03 00 00 00 0f 05 <48> 3d 00 f0 ff ff 77 3f f3 c3 0f 1f 44 00 00 53 89 fb 48 83 ec 10</div> <div>[ +0.000003] RSP: 002b:00007fff89083f58 EFLAGS: 00000246 ORIG_RAX: 0000000000000003</div> <div>[ +0.000004] RAX: 0000000000000000 RBX: 0000562815a3e6a0 RCX: 00007fb8e76e8511</div> <div>[ +0.000002] RDX: 00007fb8e76d1ca0 RSI: 0000562815f75100 RDI: 0000000000000003</div> <div>[ +0.000003] RBP: 0000562815a3e8a0 R08: 0000000000000000 R09: 0000000000000000</div> <div>[ +0.000002] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000</div> <div>[ +0.000002] R13: 0000000000000000 R14: 0000000000000000 R15: 0000562815a3e8a0</div> <div>[ +0.000005] </TASK></div> <div>[ +0.000002] ---[ end trace 7e6704984e7ed0fe ]---</div> <div>[ +0.000516] [drm:amdgpu_fill_buffer [amdgpu]] *ERROR* Trying to clear memory with ring turned off.</div> <div>[ +0.000321] ------------[ cut here ]------------</div> <div>[ +0.000002] WARNING: CPU: 6 PID: 2834 at drivers/gpu/drm/amd/amdgpu/amdgpu_object.c:1313 amdgpu_bo_release_notify+0x15f/0x170 [amdgpu]</div> <div>[ +0.000215] Modules linked in: nf_conntrack_netlink nfnetlink xfrm_user xt_addrtype br_netfilter xt_CHECKSUM iptable_mangle xt_MASQUERADE iptable_nat nf_nat xt_conntrack nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 ipt_REJECT nf_reject_ipv4 xt_tcpudp bridge stp llc ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter overlay esp6_offload esp6 esp4_offload esp4 xfrm_algo ipmi_ssif intel_rapl_msr snd_hda_codec_hdmi intel_rapl_common sb_edac x86_pkg_temp_thermal snd_hda_intel intel_powerclamp coretemp snd_intel_dspcfg kvm_intel snd_hda_codec snd_hda_core kvm snd_hwdep ftdi_sio snd_pcm snd_timer joydev input_leds usbserial snd irqbypass soundcore rapl iTCO_wdt iTCO_vendor_support ipmi_si mei_me intel_cstate acpi_power_meter ipmi_devintf lpc_ich mei ipmi_msghandler mac_hid sch_fq_codel ib_iser rdma_cm iw_cm ib_cm ib_core iscsi_tcp libiscsi_tcp libiscsi scsi_transport_iscsi ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy</div> <div>[ +0.000094] async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear amdgpu iommu_v2 gpu_sched drm_ttm_helper mgag200 ttm drm_shmem_helper crct10dif_pclmul drm_kms_helper crc32_pclmul syscopyarea sysfillrect hid_generic ghash_clmulni_intel sysimgblt fb_sys_fops uas aesni_intel usbhid ahci crypto_simd igb usb_storage libahci cryptd hid drm dca megaraid_sas i2c_algo_bit wmi</div> <div>[ +0.000044] CPU: 6 PID: 2834 Comm: amdgpu_test Tainted: G W 5.16.0+ #3</div> <div>[ +0.000005] Hardware name: Dell Inc. PowerEdge R730/0H21J3, BIOS 1.5.4 [FPGA Test BIOS] 10/002/2015</div> <div>[ +0.000003] RIP: 0010:amdgpu_bo_release_notify+0x15f/0x170 [amdgpu]</div> <div>[ +0.000210] Code: ff ff ff 48 39 c2 74 07 0f 0b e9 61 ff ff ff 4c 89 e7 e8 d4 a8 15 00 e9 54 ff ff ff e8 3a af 11 da eb cf 0f 0b e9 f0 fe ff ff <0f> 0b eb c4 e8 a8 c4 4b da 0f 1f 84 00 00 00 00 00 0f 1f 44 00 00</div> <div>[ +0.000004] RSP: 0018:ffffafed0ed27ca8 EFLAGS: 00010282</div> <div>[ +0.000004] RAX: 00000000ffffffea RBX: ffff9e0c58ec1c58 RCX: 0000000000000001</div> <div>[ +0.000003] RDX: 0000000000000000 RSI: ffffffff9b5712d9 RDI: 00000000ffffffff</div> <div>[ +0.000003] RBP: ffffafed0ed27cc8 R08: 0000000000000000 R09: 0000000000000001</div> <div>[ +0.000002] R10: 0000000000000c32 R11: ffffafed0ed27940 R12: ffff9e0c58ec1c00</div> <div>[ +0.000003] R13: ffff9e0c58ec1c58 R14: ffff9e0c58ec1d58 R15: ffff9e0c5b785360</div> <div>[ +0.000002] FS: 00007fb8e81390c0(0000) GS:ffff9e2b3fac0000(0000) knlGS:0000000000000000</div> <div>[ +0.000004] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033</div> <div>[ +0.000003] CR2: 00007f09d1154000 CR3: 000000010e764006 CR4: 00000000001706e0</div> <div>[ +0.000003] Call Trace:</div> <div>[ +0.000002] <TASK></div> <div>[ +0.000004] ttm_bo_release+0x2f2/0x370 [ttm]</div> <div>[ +0.000011] ? __cond_resched+0x1d/0x30</div> <div>[ +0.000010] ttm_bo_put+0x30/0x40 [ttm]</div> <div>[ +0.000009] amdgpu_bo_free_kernel+0xc7/0x120 [amdgpu]</div> <div>[ +0.000208] vega20_smu_fini+0x49/0xe0 [amdgpu]</div> <div>[ +0.000339] hwmgr_sw_fini+0x28/0x30 [amdgpu]</div> <div>[ +0.000333] pp_sw_fini+0x19/0x40 [amdgpu]</div> <div>[ +0.000362] amdgpu_device_fini_sw+0xcc/0x320 [amdgpu]</div> <div>[ +0.000212] amdgpu_driver_release_kms+0x16/0x30 [amdgpu]</div> <div>[ +0.000213] drm_dev_release+0x28/0x40 [drm]</div> <div>[ +0.000041] drm_minor_release+0x30/0x40 [drm]</div> <div>[ +0.000041] drm_release+0xa1/0xe0 [drm]</div> <div>[ +0.000036] __fput+0x99/0x260</div> <div>[ +0.000007] ____fput+0xe/0x10</div> <div>[ +0.000006] task_work_run+0x6c/0xa0</div> <div>[ +0.000006] exit_to_user_mode_prepare+0x1af/0x1c0</div> <div>[ +0.000006] syscall_exit_to_user_mode+0x2a/0x40</div> <div>[ +0.000005] do_syscall_64+0x46/0xb0</div> <div>[ +0.000006] entry_SYSCALL_64_after_hwframe+0x44/0xae</div> <div>[ +0.000006] RIP: 0033:0x7fb8e76e8511</div> <div>[ +0.000004] Code: f7 d8 64 89 02 48 c7 c0 ff ff ff ff c3 66 2e 0f 1f 84 00 00 00 00 00 66 90 8b 05 fa ce 20 00 85 c0 75 16 b8 03 00 00 00 0f 05 <48> 3d 00 f0 ff ff 77 3f f3 c3 0f 1f 44 00 00 53 89 fb 48 83 ec 10</div> <div>[ +0.000004] RSP: 002b:00007fff89083f58 EFLAGS: 00000246 ORIG_RAX: 0000000000000003</div> <div>[ +0.000004] RAX: 0000000000000000 RBX: 0000562815a3e6a0 RCX: 00007fb8e76e8511</div> <div>[ +0.000003] RDX: 00007fb8e76d1ca0 RSI: 0000562815f75100 RDI: 0000000000000003</div> <div>[ +0.000002] RBP: 0000562815a3e8a0 R08: 0000000000000000 R09: 0000000000000000</div> <div>[ +0.000003] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000</div> <div>[ +0.000002] R13: 0000000000000000 R14: 0000000000000000 R15: 0000562815a3e8a0</div> <div>[ +0.000006] </TASK></div> <div>[ +0.000001] ---[ end trace 7e6704984e7ed0ff ]---</div> <div>[ +0.000648] [drm:amdgpu_fill_buffer [amdgpu]] *ERROR* Trying to clear memory with ring turned off.</div> <div>[ +0.000323] ------------[ cut here ]------------</div> <div>[ +0.000003] WARNING: CPU: 6 PID: 2834 at drivers/gpu/drm/amd/amdgpu/amdgpu_object.c:1313 amdgpu_bo_release_notify+0x15f/0x170 [amdgpu]</div> <div>[ +0.000232] Modules linked in: nf_conntrack_netlink nfnetlink xfrm_user xt_addrtype br_netfilter xt_CHECKSUM iptable_mangle xt_MASQUERADE iptable_nat nf_nat xt_conntrack nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 ipt_REJECT nf_reject_ipv4 xt_tcpudp bridge stp llc ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter overlay esp6_offload esp6 esp4_offload esp4 xfrm_algo ipmi_ssif intel_rapl_msr snd_hda_codec_hdmi intel_rapl_common sb_edac x86_pkg_temp_thermal snd_hda_intel intel_powerclamp coretemp snd_intel_dspcfg kvm_intel snd_hda_codec snd_hda_core kvm snd_hwdep ftdi_sio snd_pcm snd_timer joydev input_leds usbserial snd irqbypass soundcore rapl iTCO_wdt iTCO_vendor_support ipmi_si mei_me intel_cstate acpi_power_meter ipmi_devintf lpc_ich mei ipmi_msghandler mac_hid sch_fq_codel ib_iser rdma_cm iw_cm ib_cm ib_core iscsi_tcp libiscsi_tcp libiscsi scsi_transport_iscsi ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy</div> <div>[ +0.000100] async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear amdgpu iommu_v2 gpu_sched drm_ttm_helper mgag200 ttm drm_shmem_helper crct10dif_pclmul drm_kms_helper crc32_pclmul syscopyarea sysfillrect hid_generic ghash_clmulni_intel sysimgblt fb_sys_fops uas aesni_intel usbhid ahci crypto_simd igb usb_storage libahci cryptd hid drm dca megaraid_sas i2c_algo_bit wmi</div> <div>[ +0.000046] CPU: 6 PID: 2834 Comm: amdgpu_test Tainted: G W 5.16.0+ #3</div> <div>[ +0.000005] Hardware name: Dell Inc. PowerEdge R730/0H21J3, BIOS 1.5.4 [FPGA Test BIOS] 10/002/2015</div> <div>[ +0.000002] RIP: 0010:amdgpu_bo_release_notify+0x15f/0x170 [amdgpu]</div> <div>[ +0.000224] Code: ff ff ff 48 39 c2 74 07 0f 0b e9 61 ff ff ff 4c 89 e7 e8 d4 a8 15 00 e9 54 ff ff ff e8 3a af 11 da eb cf 0f 0b e9 f0 fe ff ff <0f> 0b eb c4 e8 a8 c4 4b da 0f 1f 84 00 00 00 00 00 0f 1f 44 00 00</div> <div>[ +0.000004] RSP: 0018:ffffafed0ed27ca8 EFLAGS: 00010282</div> <div>[ +0.000004] RAX: 00000000ffffffea RBX: ffff9e0c58ec4458 RCX: 0000000000000001</div> <div>[ +0.000002] RDX: 0000000000000000 RSI: ffffffff9b5712d9 RDI: 00000000ffffffff</div> <div>[ +0.000003] RBP: ffffafed0ed27cc8 R08: 0000000000000000 R09: 0000000000000001</div> <div>[ +0.000002] R10: ffffafed0e81fd80 R11: ffffafed0ed27940 R12: ffff9e0c58ec4400</div> <div>[ +0.000002] R13: ffff9e0c58ec4458 R14: ffff9e0c58ec4558 R15: ffff9e0c5b785360</div> <div>[ +0.000003] FS: 00007fb8e81390c0(0000) GS:ffff9e2b3fac0000(0000) knlGS:0000000000000000</div> <div>[ +0.000004] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033</div> <div>[ +0.000002] CR2: 00007f09d1154000 CR3: 000000010e764006 CR4: 00000000001706e0</div> <div>[ +0.000003] Call Trace:</div> <div>[ +0.000002] <TASK></div> <div>[ +0.000004] ttm_bo_release+0x2f2/0x370 [ttm]</div> <div>[ +0.000010] ? __cond_resched+0x1d/0x30</div> <div>[ +0.000009] ttm_bo_put+0x30/0x40 [ttm]</div> <div>[ +0.000010] amdgpu_bo_free_kernel+0xc7/0x120 [amdgpu]</div> <div>[ +0.000223] vega20_smu_fini+0x63/0xe0 [amdgpu]</div> <div>[ +0.000343] hwmgr_sw_fini+0x28/0x30 [amdgpu]</div> <div>[ +0.000343] pp_sw_fini+0x19/0x40 [amdgpu]</div> <div>[ +0.000365] amdgpu_device_fini_sw+0xcc/0x320 [amdgpu]</div> <div>[ +0.000211] amdgpu_driver_release_kms+0x16/0x30 [amdgpu]</div> <div>[ +0.000212] drm_dev_release+0x28/0x40 [drm]</div> <div>[ +0.000041] drm_minor_release+0x30/0x40 [drm]</div> <div>[ +0.000040] drm_release+0xa1/0xe0 [drm]</div> <div>[ +0.000037] __fput+0x99/0x260</div> <div>[ +0.000007] ____fput+0xe/0x10</div> <div>[ +0.000006] task_work_run+0x6c/0xa0</div> <div>[ +0.000005] exit_to_user_mode_prepare+0x1af/0x1c0</div> <div>[ +0.000006] syscall_exit_to_user_mode+0x2a/0x40</div> <div>[ +0.000005] do_syscall_64+0x46/0xb0</div> <div>[ +0.000006] entry_SYSCALL_64_after_hwframe+0x44/0xae</div> <div>[ +0.000005] RIP: 0033:0x7fb8e76e8511</div> <div>[ +0.000004] Code: f7 d8 64 89 02 48 c7 c0 ff ff ff ff c3 66 2e 0f 1f 84 00 00 00 00 00 66 90 8b 05 fa ce 20 00 85 c0 75 16 b8 03 00 00 00 0f 05 <48> 3d 00 f0 ff ff 77 3f f3 c3 0f 1f 44 00 00 53 89 fb 48 83 ec 10</div> <div>[ +0.000004] RSP: 002b:00007fff89083f58 EFLAGS: 00000246 ORIG_RAX: 0000000000000003</div> <div>[ +0.000004] RAX: 0000000000000000 RBX: 0000562815a3e6a0 RCX: 00007fb8e76e8511</div> <div>[ +0.000002] RDX: 00007fb8e76d1ca0 RSI: 0000562815f75100 RDI: 0000000000000003</div> <div>[ +0.000003] RBP: 0000562815a3e8a0 R08: 0000000000000000 R09: 0000000000000000</div> <div>[ +0.000002] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000</div> <div>[ +0.000002] R13: 0000000000000000 R14: 0000000000000000 R15: 0000562815a3e8a0</div> <div>[ +0.000005] </TASK></div> <div>[ +0.000002] ---[ end trace 7e6704984e7ed100 ]---</div> <div>[ +0.000648] [drm:amdgpu_fill_buffer [amdgpu]] *ERROR* Trying to clear memory with ring turned off.</div> <div>[ +0.000176] ------------[ cut here ]------------</div> <div>[ +0.000002] WARNING: CPU: 6 PID: 2834 at drivers/gpu/drm/amd/amdgpu/amdgpu_object.c:1313 amdgpu_bo_release_notify+0x15f/0x170 [amdgpu]</div> <div>[ +0.000107] Modules linked in: nf_conntrack_netlink nfnetlink xfrm_user xt_addrtype br_netfilter xt_CHECKSUM iptable_mangle xt_MASQUERADE iptable_nat nf_nat xt_conntrack nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 ipt_REJECT nf_reject_ipv4 xt_tcpudp bridge stp llc ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter overlay esp6_offload esp6 esp4_offload esp4 xfrm_algo ipmi_ssif intel_rapl_msr snd_hda_codec_hdmi intel_rapl_common sb_edac x86_pkg_temp_thermal snd_hda_intel intel_powerclamp coretemp snd_intel_dspcfg kvm_intel snd_hda_codec snd_hda_core kvm snd_hwdep ftdi_sio snd_pcm snd_timer joydev input_leds usbserial snd irqbypass soundcore rapl iTCO_wdt iTCO_vendor_support ipmi_si mei_me intel_cstate acpi_power_meter ipmi_devintf lpc_ich mei ipmi_msghandler mac_hid sch_fq_codel ib_iser rdma_cm iw_cm ib_cm ib_core iscsi_tcp libiscsi_tcp libiscsi scsi_transport_iscsi ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy</div> <div>[ +0.000044] async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear amdgpu iommu_v2 gpu_sched drm_ttm_helper mgag200 ttm drm_shmem_helper crct10dif_pclmul drm_kms_helper crc32_pclmul syscopyarea sysfillrect hid_generic ghash_clmulni_intel sysimgblt fb_sys_fops uas aesni_intel usbhid ahci crypto_simd igb usb_storage libahci cryptd hid drm dca megaraid_sas i2c_algo_bit wmi</div> <div>[ +0.000021] CPU: 6 PID: 2834 Comm: amdgpu_test Tainted: G W 5.16.0+ #3</div> <div>[ +0.000002] Hardware name: Dell Inc. PowerEdge R730/0H21J3, BIOS 1.5.4 [FPGA Test BIOS] 10/002/2015</div> <div>[ +0.000001] RIP: 0010:amdgpu_bo_release_notify+0x15f/0x170 [amdgpu]</div> <div>[ +0.000104] Code: ff ff ff 48 39 c2 74 07 0f 0b e9 61 ff ff ff 4c 89 e7 e8 d4 a8 15 00 e9 54 ff ff ff e8 3a af 11 da eb cf 0f 0b e9 f0 fe ff ff <0f> 0b eb c4 e8 a8 c4 4b da 0f 1f 84 00 00 00 00 00 0f 1f 44 00 00</div> <div>[ +0.000002] RSP: 0018:ffffafed0ed27ca8 EFLAGS: 00010282</div> <div>[ +0.000002] RAX: 00000000ffffffea RBX: ffff9e0c58fd6858 RCX: 0000000000000001</div> <div>[ +0.000001] RDX: 0000000000000000 RSI: ffffffff9b5712d9 RDI: 00000000ffffffff</div> <div>[ +0.000001] RBP: ffffafed0ed27cc8 R08: 0000000000000000 R09: 0000000000000001</div> <div>[ +0.000001] R10: ffffafed0e81fd80 R11: ffffafed0ed27940 R12: ffff9e0c58fd6800</div> <div>[ +0.000002] R13: ffff9e0c58fd6858 R14: ffff9e0c58fd6958 R15: ffff9e0c5b785360</div> <div>[ +0.000001] FS: 00007fb8e81390c0(0000) GS:ffff9e2b3fac0000(0000) knlGS:0000000000000000</div> <div>[ +0.000002] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033</div> <div>[ +0.000001] CR2: 00007f09d1154000 CR3: 000000010e764006 CR4: 00000000001706e0</div> <div>[ +0.000001] Call Trace:</div> <div>[ +0.000001] <TASK></div> <div>[ +0.000002] ttm_bo_release+0x2f2/0x370 [ttm]</div> <div>[ +0.000005] ? __cond_resched+0x1d/0x30</div> <div>[ +0.000004] ttm_bo_put+0x30/0x40 [ttm]</div> <div>[ +0.000004] amdgpu_bo_free_kernel+0xc7/0x120 [amdgpu]</div> <div>[ +0.000115] vega20_smu_fini+0x7d/0xe0 [amdgpu]</div> <div>[ +0.000162] hwmgr_sw_fini+0x28/0x30 [amdgpu]</div> <div>[ +0.000158] pp_sw_fini+0x19/0x40 [amdgpu]</div> <div>[ +0.000169] amdgpu_device_fini_sw+0xcc/0x320 [amdgpu]</div> <div>[ +0.000101] amdgpu_driver_release_kms+0x16/0x30 [amdgpu]</div> <div>[ +0.000101] drm_dev_release+0x28/0x40 [drm]</div> <div>[ +0.000019] drm_minor_release+0x30/0x40 [drm]</div> <div>[ +0.000018] drm_release+0xa1/0xe0 [drm]</div> <div>[ +0.000016] __fput+0x99/0x260</div> <div>[ +0.000003] ____fput+0xe/0x10</div> <div>[ +0.000003] task_work_run+0x6c/0xa0</div> <div>[ +0.000002] exit_to_user_mode_prepare+0x1af/0x1c0</div> <div>[ +0.000003] syscall_exit_to_user_mode+0x2a/0x40</div> <div>[ +0.000002] do_syscall_64+0x46/0xb0</div> <div>[ +0.000003] entry_SYSCALL_64_after_hwframe+0x44/0xae</div> <div>[ +0.000003] RIP: 0033:0x7fb8e76e8511</div> <div>[ +0.000001] Code: f7 d8 64 89 02 48 c7 c0 ff ff ff ff c3 66 2e 0f 1f 84 00 00 00 00 00 66 90 8b 05 fa ce 20 00 85 c0 75 16 b8 03 00 00 00 0f 05 <48> 3d 00 f0 ff ff 77 3f f3 c3 0f 1f 44 00 00 53 89 fb 48 83 ec 10</div> <div>[ +0.000002] RSP: 002b:00007fff89083f58 EFLAGS: 00000246 ORIG_RAX: 0000000000000003</div> <div>[ +0.000002] RAX: 0000000000000000 RBX: 0000562815a3e6a0 RCX: 00007fb8e76e8511</div> <div>[ +0.000001] RDX: 00007fb8e76d1ca0 RSI: 0000562815f75100 RDI: 0000000000000003</div> <div>[ +0.000001] RBP: 0000562815a3e8a0 R08: 0000000000000000 R09: 0000000000000000</div> <div>[ +0.000001] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000</div> <div>[ +0.000001] R13: 0000000000000000 R14: 0000000000000000 R15: 0000562815a3e8a0</div> <div>[ +0.000003] </TASK></div> <div>[ +0.000000] ---[ end trace 7e6704984e7ed101 ]---</div> <div>[ +0.000513] [drm:amdgpu_fill_buffer [amdgpu]] *ERROR* Trying to clear memory with ring turned off.</div> <div>[ +0.000220] ------------[ cut here ]------------</div> <div>[ +0.000001] WARNING: CPU: 12 PID: 2834 at drivers/gpu/drm/amd/amdgpu/amdgpu_object.c:1313 amdgpu_bo_release_notify+0x15f/0x170 [amdgpu]</div> <div>[ +0.000141] Modules linked in: nf_conntrack_netlink nfnetlink xfrm_user xt_addrtype br_netfilter xt_CHECKSUM iptable_mangle xt_MASQUERADE iptable_nat nf_nat xt_conntrack nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 ipt_REJECT nf_reject_ipv4 xt_tcpudp bridge stp llc ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter overlay esp6_offload esp6 esp4_offload esp4 xfrm_algo ipmi_ssif intel_rapl_msr snd_hda_codec_hdmi intel_rapl_common sb_edac x86_pkg_temp_thermal snd_hda_intel intel_powerclamp coretemp snd_intel_dspcfg kvm_intel snd_hda_codec snd_hda_core kvm snd_hwdep ftdi_sio snd_pcm snd_timer joydev input_leds usbserial snd irqbypass soundcore rapl iTCO_wdt iTCO_vendor_support ipmi_si mei_me intel_cstate acpi_power_meter ipmi_devintf lpc_ich mei ipmi_msghandler mac_hid sch_fq_codel ib_iser rdma_cm iw_cm ib_cm ib_core iscsi_tcp libiscsi_tcp libiscsi scsi_transport_iscsi ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy</div> <div>[ +0.000062] async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear amdgpu iommu_v2 gpu_sched drm_ttm_helper mgag200 ttm drm_shmem_helper crct10dif_pclmul drm_kms_helper crc32_pclmul syscopyarea sysfillrect hid_generic ghash_clmulni_intel sysimgblt fb_sys_fops uas aesni_intel usbhid ahci crypto_simd igb usb_storage libahci cryptd hid drm dca megaraid_sas i2c_algo_bit wmi</div> <div>[ +0.000029] CPU: 12 PID: 2834 Comm: amdgpu_test Tainted: G W 5.16.0+ #3</div> <div>[ +0.000004] Hardware name: Dell Inc. PowerEdge R730/0H21J3, BIOS 1.5.4 [FPGA Test BIOS] 10/002/2015</div> <div>[ +0.000001] RIP: 0010:amdgpu_bo_release_notify+0x15f/0x170 [amdgpu]</div> <div>[ +0.000138] Code: ff ff ff 48 39 c2 74 07 0f 0b e9 61 ff ff ff 4c 89 e7 e8 d4 a8 15 00 e9 54 ff ff ff e8 3a af 11 da eb cf 0f 0b e9 f0 fe ff ff <0f> 0b eb c4 e8 a8 c4 4b da 0f 1f 84 00 00 00 00 00 0f 1f 44 00 00</div> <div>[ +0.000003] RSP: 0018:ffffafed0ed27ca8 EFLAGS: 00010282</div> <div>[ +0.000003] RAX: 00000000ffffffea RBX: ffff9e0c58fd5058 RCX: 0000000000000001</div> <div>[ +0.000002] RDX: 0000000000000000 RSI: ffffffff9b5712d9 RDI: 00000000ffffffff</div> <div>[ +0.000001] RBP: ffffafed0ed27cc8 R08: 0000000000000000 R09: 0000000000000001</div> <div>[ +0.000002] R10: 0000000000000c32 R11: ffffafed0ed27940 R12: ffff9e0c58fd5000</div> <div>[ +0.000002] R13: ffff9e0c58fd5058 R14: ffff9e0c58fd5158 R15: ffff9e0c5b785360</div> <div>[ +0.000001] FS: 00007fb8e81390c0(0000) GS:ffff9e2b3fb80000(0000) knlGS:0000000000000000</div> <div>[ +0.000003] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033</div> <div>[ +0.000001] CR2: 00007fce896fdd10 CR3: 000000010e764003 CR4: 00000000001706e0</div> <div>[ +0.000002] Call Trace:</div> <div>[ +0.000002] <TASK></div> <div>[ +0.000003] ttm_bo_release+0x2f2/0x370 [ttm]</div> <div>[ +0.000007] ? __cond_resched+0x1d/0x30</div> <div>[ +0.000006] ttm_bo_put+0x30/0x40 [ttm]</div> <div>[ +0.000006] amdgpu_bo_free_kernel+0xc7/0x120 [amdgpu]</div> <div>[ +0.000137] vega20_smu_fini+0x97/0xe0 [amdgpu]</div> <div>[ +0.000221] hwmgr_sw_fini+0x28/0x30 [amdgpu]</div> <div>[ +0.000218] pp_sw_fini+0x19/0x40 [amdgpu]</div> <div>[ +0.000237] amdgpu_device_fini_sw+0xcc/0x320 [amdgpu]</div> <div>[ +0.000138] amdgpu_driver_release_kms+0x16/0x30 [amdgpu]</div> <div>[ +0.000139] drm_dev_release+0x28/0x40 [drm]</div> <div>[ +0.000027] drm_minor_release+0x30/0x40 [drm]</div> <div>[ +0.000026] drm_release+0xa1/0xe0 [drm]</div> <div>[ +0.000024] __fput+0x99/0x260</div> <div>[ +0.000004] ____fput+0xe/0x10</div> <div>[ +0.000004] task_work_run+0x6c/0xa0</div> <div>[ +0.000004] exit_to_user_mode_prepare+0x1af/0x1c0</div> <div>[ +0.000004] syscall_exit_to_user_mode+0x2a/0x40</div> <div>[ +0.000003] do_syscall_64+0x46/0xb0</div> <div>[ +0.000004] entry_SYSCALL_64_after_hwframe+0x44/0xae</div> <div>[ +0.000004] RIP: 0033:0x7fb8e76e8511</div> <div>[ +0.000003] Code: f7 d8 64 89 02 48 c7 c0 ff ff ff ff c3 66 2e 0f 1f 84 00 00 00 00 00 66 90 8b 05 fa ce 20 00 85 c0 75 16 b8 03 00 00 00 0f 05 <48> 3d 00 f0 ff ff 77 3f f3 c3 0f 1f 44 00 00 53 89 fb 48 83 ec 10</div> <div>[ +0.000002] RSP: 002b:00007fff89083f58 EFLAGS: 00000246 ORIG_RAX: 0000000000000003</div> <div>[ +0.000003] RAX: 0000000000000000 RBX: 0000562815a3e6a0 RCX: 00007fb8e76e8511</div> <div>[ +0.000002] RDX: 00007fb8e76d1ca0 RSI: 0000562815f75100 RDI: 0000000000000003</div> <div>[ +0.000001] RBP: 0000562815a3e8a0 R08: 0000000000000000 R09: 0000000000000000</div> <div>[ +0.000002] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000</div> <div>[ +0.000001] R13: 0000000000000000 R14: 0000000000000000 R15: 0000562815a3e8a0</div> <div>[ +0.000004] </TASK></div> <div>[ +0.000001] ---[ end trace 7e6704984e7ed102 ]---</div> <div>[ +0.000007] [drm:amdgpu_fill_buffer [amdgpu]] *ERROR* Trying to clear memory with ring turned off.</div> <div>[ +0.000197] ------------[ cut here ]------------</div> <div>[ +0.000001] WARNING: CPU: 12 PID: 2834 at drivers/gpu/drm/amd/amdgpu/amdgpu_object.c:1313 amdgpu_bo_release_notify+0x15f/0x170 [amdgpu]</div> <div>[ +0.000148] Modules linked in: nf_conntrack_netlink nfnetlink xfrm_user xt_addrtype br_netfilter xt_CHECKSUM iptable_mangle xt_MASQUERADE iptable_nat nf_nat xt_conntrack nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 ipt_REJECT nf_reject_ipv4 xt_tcpudp bridge stp llc ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter overlay esp6_offload esp6 esp4_offload esp4 xfrm_algo ipmi_ssif intel_rapl_msr snd_hda_codec_hdmi intel_rapl_common sb_edac x86_pkg_temp_thermal snd_hda_intel intel_powerclamp coretemp snd_intel_dspcfg kvm_intel snd_hda_codec snd_hda_core kvm snd_hwdep ftdi_sio snd_pcm snd_timer joydev input_leds usbserial snd irqbypass soundcore rapl iTCO_wdt iTCO_vendor_support ipmi_si mei_me intel_cstate acpi_power_meter ipmi_devintf lpc_ich mei ipmi_msghandler mac_hid sch_fq_codel ib_iser rdma_cm iw_cm ib_cm ib_core iscsi_tcp libiscsi_tcp libiscsi scsi_transport_iscsi ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy</div> <div>[ +0.000064] async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear amdgpu iommu_v2 gpu_sched drm_ttm_helper mgag200 ttm drm_shmem_helper crct10dif_pclmul drm_kms_helper crc32_pclmul syscopyarea sysfillrect hid_generic ghash_clmulni_intel sysimgblt fb_sys_fops uas aesni_intel usbhid ahci crypto_simd igb usb_storage libahci cryptd hid drm dca megaraid_sas i2c_algo_bit wmi</div> <div>[ +0.000031] CPU: 12 PID: 2834 Comm: amdgpu_test Tainted: G W 5.16.0+ #3</div> <div>[ +0.000003] Hardware name: Dell Inc. PowerEdge R730/0H21J3, BIOS 1.5.4 [FPGA Test BIOS] 10/002/2015</div> <div>[ +0.000001] RIP: 0010:amdgpu_bo_release_notify+0x15f/0x170 [amdgpu]</div> <div>[ +0.000146] Code: ff ff ff 48 39 c2 74 07 0f 0b e9 61 ff ff ff 4c 89 e7 e8 d4 a8 15 00 e9 54 ff ff ff e8 3a af 11 da eb cf 0f 0b e9 f0 fe ff ff <0f> 0b eb c4 e8 a8 c4 4b da 0f 1f 84 00 00 00 00 00 0f 1f 44 00 00</div> <div>[ +0.000002] RSP: 0018:ffffafed0ed27ca8 EFLAGS: 00010282</div> <div>[ +0.000003] RAX: 00000000ffffffea RBX: ffff9e0c58fd4058 RCX: 0000000000000001</div> <div>[ +0.000001] RDX: 0000000000000000 RSI: ffffffff9b5712d9 RDI: 00000000ffffffff</div> <div>[ +0.000002] RBP: ffffafed0ed27cc8 R08: 0000000000000000 R09: 0000000000000001</div> <div>[ +0.000002] R10: ffffafed0ed27c58 R11: ffffafed0ed27940 R12: ffff9e0c58fd4000</div> <div>[ +0.000001] R13: ffff9e0c58fd4058 R14: ffff9e0c58fd4158 R15: ffff9e0c5b785360</div> <div>[ +0.000002] FS: 00007fb8e81390c0(0000) GS:ffff9e2b3fb80000(0000) knlGS:0000000000000000</div> <div>[ +0.000002] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033</div> <div>[ +0.000002] CR2: 00007fce896fdd10 CR3: 000000010e764003 CR4: 00000000001706e0</div> <div>[ +0.000002] Call Trace:</div> <div>[ +0.000001] <TASK></div> <div>[ +0.000002] ttm_bo_release+0x2f2/0x370 [ttm]</div> <div>[ +0.000006] ? __cond_resched+0x1d/0x30</div> <div>[ +0.000006] ttm_bo_put+0x30/0x40 [ttm]</div> <div>[ +0.000007] amdgpu_bo_free_kernel+0xc7/0x120 [amdgpu]</div> <div>[ +0.000187] vega20_smu_fini+0xb1/0xe0 [amdgpu]</div> <div>[ +0.000225] hwmgr_sw_fini+0x28/0x30 [amdgpu]</div> <div>[ +0.000223] pp_sw_fini+0x19/0x40 [amdgpu]</div> <div>[ +0.000240] amdgpu_device_fini_sw+0xcc/0x320 [amdgpu]</div> <div>[ +0.000138] amdgpu_driver_release_kms+0x16/0x30 [amdgpu]</div> <div>[ +0.000140] drm_dev_release+0x28/0x40 [drm]</div> <div>[ +0.000027] drm_minor_release+0x30/0x40 [drm]</div> <div>[ +0.000026] drm_release+0xa1/0xe0 [drm]</div> <div>[ +0.000024] __fput+0x99/0x260</div> <div>[ +0.000005] ____fput+0xe/0x10</div> <div>[ +0.000003] task_work_run+0x6c/0xa0</div> <div>[ +0.000004] exit_to_user_mode_prepare+0x1af/0x1c0</div> <div>[ +0.000004] syscall_exit_to_user_mode+0x2a/0x40</div> <div>[ +0.000003] do_syscall_64+0x46/0xb0</div> <div>[ +0.000004] entry_SYSCALL_64_after_hwframe+0x44/0xae</div> <div>[ +0.000003] RIP: 0033:0x7fb8e76e8511</div> <div>[ +0.000003] Code: f7 d8 64 89 02 48 c7 c0 ff ff ff ff c3 66 2e 0f 1f 84 00 00 00 00 00 66 90 8b 05 fa ce 20 00 85 c0 75 16 b8 03 00 00 00 0f 05 <48> 3d 00 f0 ff ff 77 3f f3 c3 0f 1f 44 00 00 53 89 fb 48 83 ec 10</div> <div>[ +0.000003] RSP: 002b:00007fff89083f58 EFLAGS: 00000246 ORIG_RAX: 0000000000000003</div> <div>[ +0.000002] RAX: 0000000000000000 RBX: 0000562815a3e6a0 RCX: 00007fb8e76e8511</div> <div>[ +0.000002] RDX: 00007fb8e76d1ca0 RSI: 0000562815f75100 RDI: 0000000000000003</div> <div>[ +0.000002] RBP: 0000562815a3e8a0 R08: 0000000000000000 R09: 0000000000000000</div> <div>[ +0.000001] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000</div> <div>[ +0.000002] R13: 0000000000000000 R14: 0000000000000000 R15: 0000562815a3e8a0</div> <div>[ +0.000003] </TASK></div> <div>[ +0.000001] ---[ end trace 7e6704984e7ed103 ]---</div> <div>[ +0.000050] [drm:amdgpu_fill_buffer [amdgpu]] *ERROR* Trying to clear memory with ring turned off.</div> <div>[ +0.000197] ------------[ cut here ]------------</div> <div>[ +0.000001] WARNING: CPU: 12 PID: 2834 at drivers/gpu/drm/amd/amdgpu/amdgpu_object.c:1313 amdgpu_bo_release_notify+0x15f/0x170 [amdgpu]</div> <div>[ +0.000148] Modules linked in: nf_conntrack_netlink nfnetlink xfrm_user xt_addrtype br_netfilter xt_CHECKSUM iptable_mangle xt_MASQUERADE iptable_nat nf_nat xt_conntrack nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 ipt_REJECT nf_reject_ipv4 xt_tcpudp bridge stp llc ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter overlay esp6_offload esp6 esp4_offload esp4 xfrm_algo ipmi_ssif intel_rapl_msr snd_hda_codec_hdmi intel_rapl_common sb_edac x86_pkg_temp_thermal snd_hda_intel intel_powerclamp coretemp snd_intel_dspcfg kvm_intel snd_hda_codec snd_hda_core kvm snd_hwdep ftdi_sio snd_pcm snd_timer joydev input_leds usbserial snd irqbypass soundcore rapl iTCO_wdt iTCO_vendor_support ipmi_si mei_me intel_cstate acpi_power_meter ipmi_devintf lpc_ich mei ipmi_msghandler mac_hid sch_fq_codel ib_iser rdma_cm iw_cm ib_cm ib_core iscsi_tcp libiscsi_tcp libiscsi scsi_transport_iscsi ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy</div> <div>[ +0.000064] async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear amdgpu iommu_v2 gpu_sched drm_ttm_helper mgag200 ttm drm_shmem_helper crct10dif_pclmul drm_kms_helper crc32_pclmul syscopyarea sysfillrect hid_generic ghash_clmulni_intel sysimgblt fb_sys_fops uas aesni_intel usbhid ahci crypto_simd igb usb_storage libahci cryptd hid drm dca megaraid_sas i2c_algo_bit wmi</div> <div>[ +0.000031] CPU: 12 PID: 2834 Comm: amdgpu_test Tainted: G W 5.16.0+ #3</div> <div>[ +0.000003] Hardware name: Dell Inc. PowerEdge R730/0H21J3, BIOS 1.5.4 [FPGA Test BIOS] 10/002/2015</div> <div>[ +0.000001] RIP: 0010:amdgpu_bo_release_notify+0x15f/0x170 [amdgpu]</div> <div>[ +0.000147] Code: ff ff ff 48 39 c2 74 07 0f 0b e9 61 ff ff ff 4c 89 e7 e8 d4 a8 15 00 e9 54 ff ff ff e8 3a af 11 da eb cf 0f 0b e9 f0 fe ff ff <0f> 0b eb c4 e8 a8 c4 4b da 0f 1f 84 00 00 00 00 00 0f 1f 44 00 00</div> <div>[ +0.000002] RSP: 0018:ffffafed0ed27cf0 EFLAGS: 00010282</div> <div>[ +0.000003] RAX: 00000000ffffffea RBX: ffff9e0c58ec6458 RCX: 0000000000000001</div> <div>[ +0.000001] RDX: 0000000000000000 RSI: ffffffff9b5712d9 RDI: 00000000ffffffff</div> <div>[ +0.000002] RBP: ffffafed0ed27d10 R08: 0000000000000000 R09: 0000000000000001</div> <div>[ +0.000001] R10: ffffafed0ed27ca0 R11: ffffafed0ed27988 R12: ffff9e0c58ec6400</div> <div>[ +0.000002] R13: ffff9e0c58ec6458 R14: ffff9e0c58ec6558 R15: ffff9e0c5b785360</div> <div>[ +0.000002] FS: 00007fb8e81390c0(0000) GS:ffff9e2b3fb80000(0000) knlGS:0000000000000000</div> <div>[ +0.000002] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033</div> <div>[ +0.000002] CR2: 00007fce896fdd10 CR3: 000000010e764003 CR4: 00000000001706e0</div> <div>[ +0.000002] Call Trace:</div> <div>[ +0.000001] <TASK></div> <div>[ +0.000002] ttm_bo_release+0x2f2/0x370 [ttm]</div> <div>[ +0.000007] ? __vunmap+0x1c9/0x210</div> <div>[ +0.000005] ttm_bo_put+0x30/0x40 [ttm]</div> <div>[ +0.000007] amdgpu_bo_free_kernel+0xc7/0x120 [amdgpu]</div> <div>[ +0.000146] amdgpu_device_fini_sw+0x27d/0x320 [amdgpu]</div> <div>[ +0.000138] amdgpu_driver_release_kms+0x16/0x30 [amdgpu]</div> <div>[ +0.000140] drm_dev_release+0x28/0x40 [drm]</div> <div>[ +0.000026] drm_minor_release+0x30/0x40 [drm]</div> <div>[ +0.000026] drm_release+0xa1/0xe0 [drm]</div> <div>[ +0.000024] __fput+0x99/0x260</div> <div>[ +0.000004] ____fput+0xe/0x10</div> <div>[ +0.000004] task_work_run+0x6c/0xa0</div> <div>[ +0.000004] exit_to_user_mode_prepare+0x1af/0x1c0</div> <div>[ +0.000003] syscall_exit_to_user_mode+0x2a/0x40</div> <div>[ +0.000004] do_syscall_64+0x46/0xb0</div> <div>[ +0.000004] entry_SYSCALL_64_after_hwframe+0x44/0xae</div> <div>[ +0.000003] RIP: 0033:0x7fb8e76e8511</div> <div>[ +0.000002] Code: f7 d8 64 89 02 48 c7 c0 ff ff ff ff c3 66 2e 0f 1f 84 00 00 00 00 00 66 90 8b 05 fa ce 20 00 85 c0 75 16 b8 03 00 00 00 0f 05 <48> 3d 00 f0 ff ff 77 3f f3 c3 0f 1f 44 00 00 53 89 fb 48 83 ec 10</div> <div>[ +0.000003] RSP: 002b:00007fff89083f58 EFLAGS: 00000246 ORIG_RAX: 0000000000000003</div> <div>[ +0.000002] RAX: 0000000000000000 RBX: 0000562815a3e6a0 RCX: 00007fb8e76e8511</div> <div>[ +0.000002] RDX: 00007fb8e76d1ca0 RSI: 0000562815f75100 RDI: 0000000000000003</div> <div>[ +0.000002] RBP: 0000562815a3e8a0 R08: 0000000000000000 R09: 0000000000000000</div> <div>[ +0.000001] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000</div> <div>[ +0.000001] R13: 0000000000000000 R14: 0000000000000000 R15: 0000562815a3e8a0</div> <div>[ +0.000004] </TASK></div> <div>[ +0.000001] ---[ end trace 7e6704984e7ed104 ]---</div> <div>[ +0.000050] [drm:amdgpu_fill_buffer [amdgpu]] *ERROR* Trying to clear memory with ring turned off.</div> <div>[ +0.000196] ------------[ cut here ]------------</div> <div>[ +0.000001] WARNING: CPU: 12 PID: 2834 at drivers/gpu/drm/amd/amdgpu/amdgpu_object.c:1313 amdgpu_bo_release_notify+0x15f/0x170 [amdgpu]</div> <div>[ +0.000147] Modules linked in: nf_conntrack_netlink nfnetlink xfrm_user xt_addrtype br_netfilter xt_CHECKSUM iptable_mangle xt_MASQUERADE iptable_nat nf_nat xt_conntrack nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 ipt_REJECT nf_reject_ipv4 xt_tcpudp bridge stp llc ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter overlay esp6_offload esp6 esp4_offload esp4 xfrm_algo ipmi_ssif intel_rapl_msr snd_hda_codec_hdmi intel_rapl_common sb_edac x86_pkg_temp_thermal snd_hda_intel intel_powerclamp coretemp snd_intel_dspcfg kvm_intel snd_hda_codec snd_hda_core kvm snd_hwdep ftdi_sio snd_pcm snd_timer joydev input_leds usbserial snd irqbypass soundcore rapl iTCO_wdt iTCO_vendor_support ipmi_si mei_me intel_cstate acpi_power_meter ipmi_devintf lpc_ich mei ipmi_msghandler mac_hid sch_fq_codel ib_iser rdma_cm iw_cm ib_cm ib_core iscsi_tcp libiscsi_tcp libiscsi scsi_transport_iscsi ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy</div> <div>[ +0.000064] async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear amdgpu iommu_v2 gpu_sched drm_ttm_helper mgag200 ttm drm_shmem_helper crct10dif_pclmul drm_kms_helper crc32_pclmul syscopyarea sysfillrect hid_generic ghash_clmulni_intel sysimgblt fb_sys_fops uas aesni_intel usbhid ahci crypto_simd igb usb_storage libahci cryptd hid drm dca megaraid_sas i2c_algo_bit wmi</div> <div>[ +0.000030] CPU: 12 PID: 2834 Comm: amdgpu_test Tainted: G W 5.16.0+ #3</div> <div>[ +0.000003] Hardware name: Dell Inc. PowerEdge R730/0H21J3, BIOS 1.5.4 [FPGA Test BIOS] 10/002/2015</div> <div>[ +0.000001] RIP: 0010:amdgpu_bo_release_notify+0x15f/0x170 [amdgpu]</div> <div>[ +0.000146] Code: ff ff ff 48 39 c2 74 07 0f 0b e9 61 ff ff ff 4c 89 e7 e8 d4 a8 15 00 e9 54 ff ff ff e8 3a af 11 da eb cf 0f 0b e9 f0 fe ff ff <0f> 0b eb c4 e8 a8 c4 4b da 0f 1f 84 00 00 00 00 00 0f 1f 44 00 00</div> <div>[ +0.000002] RSP: 0018:ffffafed0ed27cc8 EFLAGS: 00010282</div> <div>[ +0.000003] RAX: 00000000ffffffea RBX: ffff9e0c58ec7858 RCX: 0000000000000001</div> <div>[ +0.000001] RDX: 0000000000000000 RSI: ffffffff9b5712d9 RDI: 00000000ffffffff</div> <div>[ +0.000002] RBP: ffffafed0ed27ce8 R08: 0000000000000000 R09: 0000000000000001</div> <div>[ +0.000002] R10: 0000000000000002 R11: ffffafed0ed27960 R12: ffff9e0c58ec7800</div> <div>[ +0.000001] R13: ffff9e0c58ec7858 R14: ffff9e0c58ec7958 R15: ffff9e0c5b785360</div> <div>[ +0.000002] FS: 00007fb8e81390c0(0000) GS:ffff9e2b3fb80000(0000) knlGS:0000000000000000</div> <div>[ +0.000002] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033</div> <div>[ +0.000002] CR2: 00007fce896fdd10 CR3: 000000010e764003 CR4: 00000000001706e0</div> <div>[ +0.000002] Call Trace:</div> <div>[ +0.000000] <TASK></div> <div>[ +0.000002] ttm_bo_release+0x2f2/0x370 [ttm]</div> <div>[ +0.000008] ? amdgpu_fence_release+0x19/0x20 [amdgpu]</div> <div>[ +0.000142] ? dma_fence_release+0x4f/0x140</div> <div>[ +0.000008] ttm_bo_put+0x30/0x40 [ttm]</div> <div>[ +0.000007] amdgpu_bo_free_kernel+0xc7/0x120 [amdgpu]</div> <div>[ +0.000145] amdgpu_gart_table_vram_free+0x1e/0x20 [amdgpu]</div> <div>[ +0.000146] gmc_v9_0_sw_fini+0x2a/0x50 [amdgpu]</div> <div>[ +0.000173] amdgpu_device_fini_sw+0xcc/0x320 [amdgpu]</div> <div>[ +0.000138] amdgpu_driver_release_kms+0x16/0x30 [amdgpu]</div> <div>[ +0.000140] drm_dev_release+0x28/0x40 [drm]</div> <div>[ +0.000027] drm_minor_release+0x30/0x40 [drm]</div> <div>[ +0.000026] drm_release+0xa1/0xe0 [drm]</div> <div>[ +0.000040] __fput+0x99/0x260</div> <div>[ +0.000006] ____fput+0xe/0x10</div> <div>[ +0.000004] task_work_run+0x6c/0xa0</div> <div>[ +0.000004] exit_to_user_mode_prepare+0x1af/0x1c0</div> <div>[ +0.000005] syscall_exit_to_user_mode+0x2a/0x40</div> <div>[ +0.000003] do_syscall_64+0x46/0xb0</div> <div>[ +0.000005] entry_SYSCALL_64_after_hwframe+0x44/0xae</div> <div>[ +0.000004] RIP: 0033:0x7fb8e76e8511</div> <div>[ +0.000003] Code: f7 d8 64 89 02 48 c7 c0 ff ff ff ff c3 66 2e 0f 1f 84 00 00 00 00 00 66 90 8b 05 fa ce 20 00 85 c0 75 16 b8 03 00 00 00 0f 05 <48> 3d 00 f0 ff ff 77 3f f3 c3 0f 1f 44 00 00 53 89 fb 48 83 ec 10</div> <div>[ +0.000003] RSP: 002b:00007fff89083f58 EFLAGS: 00000246 ORIG_RAX: 0000000000000003</div> <div>[ +0.000003] RAX: 0000000000000000 RBX: 0000562815a3e6a0 RCX: 00007fb8e76e8511</div> <div>[ +0.000002] RDX: 00007fb8e76d1ca0 RSI: 0000562815f75100 RDI: 0000000000000003</div> <div>[ +0.000002] RBP: 0000562815a3e8a0 R08: 0000000000000000 R09: 0000000000000000</div> <div>[ +0.000002] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000</div> <div>[ +0.000002] R13: 0000000000000000 R14: 0000000000000000 R15: 0000562815a3e8a0</div> <div>[ +0.000004] </TASK></div> <div>[ +0.000002] ---[ end trace 7e6704984e7ed105 ]---</div> <div>[ +0.000112] ------------[ cut here ]------------</div> <div>[ +0.000004] kernfs: can not remove 'mem_info_preempt_used', no directory</div> <div>[ +0.000011] WARNING: CPU: 20 PID: 2834 at fs/kernfs/dir.c:1536 kernfs_remove_by_name_ns+0x8d/0xa0</div> <div>[ +0.000022] Modules linked in: nf_conntrack_netlink nfnetlink xfrm_user xt_addrtype br_netfilter xt_CHECKSUM iptable_mangle xt_MASQUERADE iptable_nat nf_nat xt_conntrack nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 ipt_REJECT nf_reject_ipv4 xt_tcpudp bridge stp llc ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter overlay esp6_offload esp6 esp4_offload esp4 xfrm_algo ipmi_ssif intel_rapl_msr snd_hda_codec_hdmi intel_rapl_common sb_edac x86_pkg_temp_thermal snd_hda_intel intel_powerclamp coretemp snd_intel_dspcfg kvm_intel snd_hda_codec snd_hda_core kvm snd_hwdep ftdi_sio snd_pcm snd_timer joydev input_leds usbserial snd irqbypass soundcore rapl iTCO_wdt iTCO_vendor_support ipmi_si mei_me intel_cstate acpi_power_meter ipmi_devintf lpc_ich mei ipmi_msghandler mac_hid sch_fq_codel ib_iser rdma_cm iw_cm ib_cm ib_core iscsi_tcp libiscsi_tcp libiscsi scsi_transport_iscsi ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy</div> <div>[ +0.000146] async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear amdgpu iommu_v2 gpu_sched drm_ttm_helper mgag200 ttm drm_shmem_helper crct10dif_pclmul drm_kms_helper crc32_pclmul syscopyarea sysfillrect hid_generic ghash_clmulni_intel sysimgblt fb_sys_fops uas aesni_intel usbhid ahci crypto_simd igb usb_storage libahci cryptd hid drm dca megaraid_sas i2c_algo_bit wmi</div> <div>[ +0.000054] CPU: 20 PID: 2834 Comm: amdgpu_test Tainted: G W 5.16.0+ #3</div> <div>[ +0.000005] Hardware name: Dell Inc. PowerEdge R730/0H21J3, BIOS 1.5.4 [FPGA Test BIOS] 10/002/2015</div> <div>[ +0.000003] RIP: 0010:kernfs_remove_by_name_ns+0x8d/0xa0</div> <div>[ +0.000011] Code: 41 5c 41 5d 5d c3 48 c7 c7 00 81 a1 9b e8 7b 2d d2 ff b8 fe ff ff ff 5b 41 5c 41 5d 5d c3 48 c7 c7 50 63 59 9b e8 03 80 cb ff <0f> 0b b8 fe ff ff ff eb cc 66 2e 0f 1f 84 00 00 00 00 00 0f 1f 44</div> <div>[ +0.000024] RSP: 0018:ffffafed0ed27d08 EFLAGS: 00010282</div> <div>[ +0.000004] RAX: 0000000000000000 RBX: ffff9e0c5b780000 RCX: 0000000000000001</div> <div>[ +0.000004] RDX: 0000000080000001 RSI: ffffffff9b5712d9 RDI: 00000000ffffffff</div> <div>[ +0.000003] RBP: ffffafed0ed27d20 R08: 0000000000000000 R09: 0000000000000001</div> <div>[ +0.000003] R10: ffffafed0ed27c30 R11: ffffafed0ed27ad8 R12: ffffffffc0e23107</div> <div>[ +0.000003] R13: ffff9e0c5b7959b8 R14: ffff9e0c5b796918 R15: ffff9e0c530a6a80</div> <div>[ +0.000004] FS: 00007fb8e81390c0(0000) GS:ffff9e2b3fc80000(0000) knlGS:0000000000000000</div> <div>[ +0.000004] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033</div> <div>[ +0.000002] CR2: 00007f6ecf7498a0 CR3: 000000010e764006 CR4: 00000000001706e0</div> <div>[ +0.000004] Call Trace:</div> <div>[ +0.000002] <TASK></div> <div>[ +0.000004] sysfs_remove_file_ns+0x15/0x20</div> <div>[ +0.000007] device_remove_file+0x15/0x20</div> <div>[ +0.000015] amdgpu_preempt_mgr_fini+0x70/0xc0 [amdgpu]</div> <div>[ +0.000323] amdgpu_ttm_fini+0x128/0x190 [amdgpu]</div> <div>[ +0.000301] amdgpu_bo_fini+0x25/0x90 [amdgpu]</div> <div>[ +0.000295] gmc_v9_0_sw_fini+0x3e/0x50 [amdgpu]</div> <div>[ +0.000284] amdgpu_device_fini_sw+0xcc/0x320 [amdgpu]</div> <div>[ +0.000196] amdgpu_driver_release_kms+0x16/0x30 [amdgpu]</div> <div>[ +0.000204] drm_dev_release+0x28/0x40 [drm]</div> <div>[ +0.000038] drm_minor_release+0x30/0x40 [drm]</div> <div>[ +0.000038] drm_release+0xa1/0xe0 [drm]</div> <div>[ +0.000034] __fput+0x99/0x260</div> <div>[ +0.000007] ____fput+0xe/0x10</div> <div>[ +0.000006] task_work_run+0x6c/0xa0</div> <div>[ +0.000006] exit_to_user_mode_prepare+0x1af/0x1c0</div> <div>[ +0.000005] syscall_exit_to_user_mode+0x2a/0x40</div> <div>[ +0.000005] do_syscall_64+0x46/0xb0</div> <div>[ +0.000006] entry_SYSCALL_64_after_hwframe+0x44/0xae</div> <div>[ +0.000005] RIP: 0033:0x7fb8e76e8511</div> <div>[ +0.000004] Code: f7 d8 64 89 02 48 c7 c0 ff ff ff ff c3 66 2e 0f 1f 84 00 00 00 00 00 66 90 8b 05 fa ce 20 00 85 c0 75 16 b8 03 00 00 00 0f 05 <48> 3d 00 f0 ff ff 77 3f f3 c3 0f 1f 44 00 00 53 89 fb 48 83 ec 10</div> <div>[ +0.000004] RSP: 002b:00007fff89083f58 EFLAGS: 00000246 ORIG_RAX: 0000000000000003</div> <div>[ +0.000004] RAX: 0000000000000000 RBX: 0000562815a3e6a0 RCX: 00007fb8e76e8511</div> <div>[ +0.000003] RDX: 00007fb8e76d1ca0 RSI: 0000562815f75100 RDI: 0000000000000003</div> <div>[ +0.000002] RBP: 0000562815a3e8a0 R08: 0000000000000000 R09: 0000000000000000</div> <div>[ +0.000002] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000</div> <div>[ +0.000002] R13: 0000000000000000 R14: 0000000000000000 R15: 0000562815a3e8a0</div> <div>[ +0.000005] </TASK></div> <div>[ +0.000002] ---[ end trace 7e6704984e7ed106 ]---</div> <div>[ +0.000383] [drm] amdgpu: ttm finalized</div> <div>[ +0.000004] ------------[ cut here ]------------</div> <div>[ +0.000001] kernfs: can not remove 'df_cntr_avail', no directory</div> <div>[ +0.000008] WARNING: CPU: 20 PID: 2834 at fs/kernfs/dir.c:1536 kernfs_remove_by_name_ns+0x8d/0xa0</div> <div>[ +0.000008] Modules linked in: nf_conntrack_netlink nfnetlink xfrm_user xt_addrtype br_netfilter xt_CHECKSUM iptable_mangle xt_MASQUERADE iptable_nat nf_nat xt_conntrack nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 ipt_REJECT nf_reject_ipv4 xt_tcpudp bridge stp llc ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter overlay esp6_offload esp6 esp4_offload esp4 xfrm_algo ipmi_ssif intel_rapl_msr snd_hda_codec_hdmi intel_rapl_common sb_edac x86_pkg_temp_thermal snd_hda_intel intel_powerclamp coretemp snd_intel_dspcfg kvm_intel snd_hda_codec snd_hda_core kvm snd_hwdep ftdi_sio snd_pcm snd_timer joydev input_leds usbserial snd irqbypass soundcore rapl iTCO_wdt iTCO_vendor_support ipmi_si mei_me intel_cstate acpi_power_meter ipmi_devintf lpc_ich mei ipmi_msghandler mac_hid sch_fq_codel ib_iser rdma_cm iw_cm ib_cm ib_core iscsi_tcp libiscsi_tcp libiscsi scsi_transport_iscsi ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy</div> <div>[ +0.000094] async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear amdgpu iommu_v2 gpu_sched drm_ttm_helper mgag200 ttm drm_shmem_helper crct10dif_pclmul drm_kms_helper crc32_pclmul syscopyarea sysfillrect hid_generic ghash_clmulni_intel sysimgblt fb_sys_fops uas aesni_intel usbhid ahci crypto_simd igb usb_storage libahci cryptd hid drm dca megaraid_sas i2c_algo_bit wmi</div> <div>[ +0.000045] CPU: 20 PID: 2834 Comm: amdgpu_test Tainted: G W 5.16.0+ #3</div> <div>[ +0.000004] Hardware name: Dell Inc. PowerEdge R730/0H21J3, BIOS 1.5.4 [FPGA Test BIOS] 10/002/2015</div> <div>[ +0.000003] RIP: 0010:kernfs_remove_by_name_ns+0x8d/0xa0</div> <div>[ +0.000005] Code: 41 5c 41 5d 5d c3 48 c7 c7 00 81 a1 9b e8 7b 2d d2 ff b8 fe ff ff ff 5b 41 5c 41 5d 5d c3 48 c7 c7 50 63 59 9b e8 03 80 cb ff <0f> 0b b8 fe ff ff ff eb cc 66 2e 0f 1f 84 00 00 00 00 00 0f 1f 44</div> <div>[ +0.000005] RSP: 0018:ffffafed0ed27d70 EFLAGS: 00010286</div> <div>[ +0.000004] RAX: 0000000000000000 RBX: ffff9e0c5b780000 RCX: 0000000000000001</div> <div>[ +0.000002] RDX: 0000000080000001 RSI: ffffffff9b5712d9 RDI: 00000000ffffffff</div> <div>[ +0.000003] RBP: ffffafed0ed27d88 R08: 0000000000000000 R09: 0000000000000001</div> <div>[ +0.000003] R10: 000000000000001f R11: ffffafed0ed27b40 R12: ffffffffc0e24a09</div> <div>[ +0.000002] R13: ffff9e0c5b7959b8 R14: ffff9e0c5b796918 R15: ffff9e0c530a6a80</div> <div>[ +0.000003] FS: 00007fb8e81390c0(0000) GS:ffff9e2b3fc80000(0000) knlGS:0000000000000000</div> <div>[ +0.000003] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033</div> <div>[ +0.000003] CR2: 00007f6ecf7498a0 CR3: 000000010e764006 CR4: 00000000001706e0</div> <div>[ +0.000003] Call Trace:</div> <div>[ +0.000001] <TASK></div> <div>[ +0.000003] sysfs_remove_file_ns+0x15/0x20</div> <div>[ +0.000006] device_remove_file+0x15/0x20</div> <div>[ +0.000005] df_v3_6_sw_fini+0x18/0x20 [amdgpu]</div> <div>[ +0.000257] soc15_common_sw_fini+0x23/0x30 [amdgpu]</div> <div>[ +0.000247] amdgpu_device_fini_sw+0xcc/0x320 [amdgpu]</div> <div>[ +0.000197] amdgpu_driver_release_kms+0x16/0x30 [amdgpu]</div> <div>[ +0.000199] drm_dev_release+0x28/0x40 [drm]</div> <div>[ +0.000040] drm_minor_release+0x30/0x40 [drm]</div> <div>[ +0.000038] drm_release+0xa1/0xe0 [drm]</div> <div>[ +0.000034] __fput+0x99/0x260</div> <div>[ +0.000007] ____fput+0xe/0x10</div> <div>[ +0.000005] task_work_run+0x6c/0xa0</div> <div>[ +0.000006] exit_to_user_mode_prepare+0x1af/0x1c0</div> <div>[ +0.000005] syscall_exit_to_user_mode+0x2a/0x40</div> <div>[ +0.000005] do_syscall_64+0x46/0xb0</div> <div>[ +0.000006] entry_SYSCALL_64_after_hwframe+0x44/0xae</div> <div>[ +0.000005] RIP: 0033:0x7fb8e76e8511</div> <div>[ +0.000003] Code: f7 d8 64 89 02 48 c7 c0 ff ff ff ff c3 66 2e 0f 1f 84 00 00 00 00 00 66 90 8b 05 fa ce 20 00 85 c0 75 16 b8 03 00 00 00 0f 05 <48> 3d 00 f0 ff ff 77 3f f3 c3 0f 1f 44 00 00 53 89 fb 48 83 ec 10</div> <div>[ +0.000004] RSP: 002b:00007fff89083f58 EFLAGS: 00000246 ORIG_RAX: 0000000000000003</div> <div>[ +0.000004] RAX: 0000000000000000 RBX: 0000562815a3e6a0 RCX: 00007fb8e76e8511</div> <div>[ +0.000003] RDX: 00007fb8e76d1ca0 RSI: 0000562815f75100 RDI: 0000000000000003</div> <div>[ +0.000002] RBP: 0000562815a3e8a0 R08: 0000000000000000 R09: 0000000000000000</div> <div>[ +0.000002] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000</div> <div>[ +0.000002] R13: 0000000000000000 R14: 0000000000000000 R15: 0000562815a3e8a0</div> <div>[ +0.000005] </TASK></div> <div>[ +0.000002] ---[ end trace 7e6704984e7ed107 ]---</div> <div><span style="background-color: rgb(255, 147, 0);" class="">[ +0.000014] BUG: kernel NULL pointer dereference, address: 0000000000000070</span></div> <div><span style="background-color: rgb(255, 147, 0);" class="">[ +0.000053] #PF: supervisor read access in kernel mode</span></div> <div><span style="background-color: rgb(255, 147, 0);" class="">[ +0.000035] #PF: error_code(0x0000) - not-present page</span></div> <div><span style="background-color: rgb(255, 147, 0);" class="">[ +0.000033] PGD 0 P4D 0</span></div> <div><span style="background-color: rgb(255, 147, 0);" class="">[ +0.000023] Oops: 0000 [#1] PREEMPT SMP PTI</span></div> <div>[ +0.000030] CPU: 20 PID: 2834 Comm: amdgpu_test Tainted: G W 5.16.0+ #3</div> <div>[ +0.000050] Hardware name: Dell Inc. PowerEdge R730/0H21J3, BIOS 1.5.4 [FPGA Test BIOS] 10/002/2015</div> <div>[ +0.000054] RIP: 0010:kernfs_find_ns+0x19/0xc0</div> <div>[ +0.000033] Code: 0f 85 ac fe ff ff e9 3c fe ff ff 66 0f 1f 44 00 00 0f 1f 44 00 00 55 48 85 d2 0f 95 c1 48 89 e5 41 56 41 55 41 54 53 49 89 d5 <0f> b7 47 70 49 89 f6 66 83 e0 20 0f 95 c2 38 d1 75 53 48 8b 5f 48</div> <div>[ +0.000115] RSP: 0018:ffffafed0ed27cb0 EFLAGS: 00010246</div> <div>[ +0.000036] RAX: ffff9e0c56eab201 RBX: 0000000000000000 RCX: ffff9e0c56488000</div> <div>[ +0.000044] RDX: 0000000000000000 RSI: ffffffffc0e238c2 RDI: 0000000000000000</div> <div>[ +0.000044] RBP: ffffafed0ed27cd0 R08: ffffffffc0e4c820 R09: 0000000000000001</div> <div>[ +0.000044] R10: ffffafed0ed27d00 R11: ffffafed0ed27b00 R12: ffffffffc0e238c2</div> <div>[ +0.000044] R13: 0000000000000000 R14: dead000000000100 R15: ffff9e0c52b49660</div> <div>[ +0.000044] FS: 00007fb8e81390c0(0000) GS:ffff9e2b3fc80000(0000) knlGS:0000000000000000</div> <div>[ +0.000051] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033</div> <div>[ +0.000036] CR2: 0000000000000070 CR3: 000000010e764006 CR4: 00000000001706e0</div> <div>[ +0.000045] Call Trace:</div> <div>[ +0.000018] <TASK></div> <div>[ +0.000018] kernfs_find_and_get_ns+0x31/0x60</div> <div>[ +0.000034] sysfs_remove_file_from_group+0x25/0x60</div> <div>[ +0.000036] amdgpu_ras_sysfs_remove+0x3f/0xd0 [amdgpu]</div> <div>[ +0.000272] amdgpu_ras_fini+0x105/0x360 [amdgpu]</div> <div>[ +0.001157] ? kfree+0x29b/0x2c0</div> <div>[ +0.000915] ? kfree+0x29b/0x2c0</div> <div>[ +0.000900] amdgpu_device_fini_sw+0x153/0x320 [amdgpu]</div> <div>[ +0.001082] amdgpu_driver_release_kms+0x16/0x30 [amdgpu]</div> <div>[ +0.001058] drm_dev_release+0x28/0x40 [drm]</div> <div>[ +0.000911] drm_minor_release+0x30/0x40 [drm]</div> <div>[ +0.000924] drm_release+0xa1/0xe0 [drm]</div> <div>[ +0.000929] __fput+0x99/0x260</div> <div>[ +0.000908] ____fput+0xe/0x10</div> <div>[ +0.000913] task_work_run+0x6c/0xa0</div> <div>[ +0.000926] exit_to_user_mode_prepare+0x1af/0x1c0</div> <div>[ +0.000949] syscall_exit_to_user_mode+0x2a/0x40</div> <div>[ +0.000961] do_syscall_64+0x46/0xb0</div> <div>[ +0.000977] entry_SYSCALL_64_after_hwframe+0x44/0xae</div> <div>[ +0.000998] RIP: 0033:0x7fb8e76e8511</div> <div>[ +0.001006] Code: f7 d8 64 89 02 48 c7 c0 ff ff ff ff c3 66 2e 0f 1f 84 00 00 00 00 00 66 90 8b 05 fa ce 20 00 85 c0 75 16 b8 03 00 00 00 0f 05 <48> 3d 00 f0 ff ff 77 3f f3 c3 0f 1f 44 00 00 53 89 fb 48 83 ec 10</div> <div>[ +0.002212] RSP: 002b:00007fff89083f58 EFLAGS: 00000246 ORIG_RAX: 0000000000000003</div> <div>[ +0.001160] RAX: 0000000000000000 RBX: 0000562815a3e6a0 RCX: 00007fb8e76e8511</div> <div>[ +0.001183] RDX: 00007fb8e76d1ca0 RSI: 0000562815f75100 RDI: 0000000000000003</div> <div>[ +0.001200] RBP: 0000562815a3e8a0 R08: 0000000000000000 R09: 0000000000000000</div> <div>[ +0.001214] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000</div> <div>[ +0.001224] R13: 0000000000000000 R14: 0000000000000000 R15: 0000562815a3e8a0</div> <div>[ +0.001198] </TASK></div> <div>[ +0.001171] Modules linked in: nf_conntrack_netlink nfnetlink xfrm_user xt_addrtype br_netfilter xt_CHECKSUM iptable_mangle xt_MASQUERADE iptable_nat nf_nat xt_conntrack nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 ipt_REJECT nf_reject_ipv4 xt_tcpudp bridge stp llc ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter overlay esp6_offload esp6 esp4_offload esp4 xfrm_algo ipmi_ssif intel_rapl_msr snd_hda_codec_hdmi intel_rapl_common sb_edac x86_pkg_temp_thermal snd_hda_intel intel_powerclamp coretemp snd_intel_dspcfg kvm_intel snd_hda_codec snd_hda_core kvm snd_hwdep ftdi_sio snd_pcm snd_timer joydev input_leds usbserial snd irqbypass soundcore rapl iTCO_wdt iTCO_vendor_support ipmi_si mei_me intel_cstate acpi_power_meter ipmi_devintf lpc_ich mei ipmi_msghandler mac_hid sch_fq_codel ib_iser rdma_cm iw_cm ib_cm ib_core iscsi_tcp libiscsi_tcp libiscsi scsi_transport_iscsi ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy</div> <div>[ +0.000096] async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear amdgpu iommu_v2 gpu_sched drm_ttm_helper mgag200 ttm drm_shmem_helper crct10dif_pclmul drm_kms_helper crc32_pclmul syscopyarea sysfillrect hid_generic ghash_clmulni_intel sysimgblt fb_sys_fops uas aesni_intel usbhid ahci crypto_simd igb usb_storage libahci cryptd hid drm dca megaraid_sas i2c_algo_bit wmi</div> <div>[ +0.016580] CR2: 0000000000000070</div> <div>[ +0.001512] ---[ end trace 7e6704984e7ed108 ]---</div> <div>[ +0.013115] RIP: 0010:kernfs_find_ns+0x19/0xc0</div> <div>[ +0.001477] Code: 0f 85 ac fe ff ff e9 3c fe ff ff 66 0f 1f 44 00 00 0f 1f 44 00 00 55 48 85 d2 0f 95 c1 48 89 e5 41 56 41 55 41 54 53 49 89 d5 <0f> b7 47 70 49 89 f6 66 83 e0 20 0f 95 c2 38 d1 75 53 48 8b 5f 48</div> <div>[ +0.003030] RSP: 0018:ffffafed0ed27cb0 EFLAGS: 00010246</div> <div>[ +0.001534] RAX: ffff9e0c56eab201 RBX: 0000000000000000 RCX: ffff9e0c56488000</div> <div>[ +0.001550] RDX: 0000000000000000 RSI: ffffffffc0e238c2 RDI: 0000000000000000</div> <div>[ +0.001559] RBP: ffffafed0ed27cd0 R08: ffffffffc0e4c820 R09: 0000000000000001</div> <div>[ +0.001568] R10: ffffafed0ed27d00 R11: ffffafed0ed27b00 R12: ffffffffc0e238c2</div> <div>[ +0.001556] R13: 0000000000000000 R14: dead000000000100 R15: ffff9e0c52b49660</div> <div>[ +0.001579] FS: 00007fb8e81390c0(0000) GS:ffff9e2b3fc80000(0000) knlGS:0000000000000000</div> <div>[ +0.001586] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033</div> <div>[ +0.001602] CR2: 0000000000000070 CR3: 000000010e764006 CR4: 00000000001706e0</div> <div class=""><br class=""> </div> <div class=""><b style="background-color: rgb(255, 38, 0);" class="">MI100:</b></div> <div class=""><br class=""> </div> <div class=""> <div class="">[Apr20 18:16] amdgpu 0000:43:00.0: amdgpu: amdgpu: finishing device.</div> <div class="">[ +0.005980] [drm:amdgpu_fill_buffer [amdgpu]] *ERROR* Trying to clear memory with ring turned off.</div> <div class="">[ +0.000538] ------------[ cut here ]------------</div> <div class="">[ +0.000003] WARNING: CPU: 29 PID: 3800 at drivers/gpu/drm/amd/amdgpu/amdgpu_object.c:1313 amdgpu_bo_release_notify+0x164/0x170 [amdgpu]</div> <div class="">[ +0.000137] Modules linked in: amdgpu iommu_v2 gpu_sched nf_conntrack_netlink nfnetlink xt_addrtype br_netfilter xt_CHECKSUM iptable_mangle xt_MASQUERADE iptable_nat nf_nat xt_conntrack nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 ipt_REJECT nf_reject_ipv4 xt_tcpudp ip6table_filter ip6_tables iptable_filter fuse x86_pkg_temp_thermal acpi_pad ip_tables x_tables ast drm_vram_helper drm_ttm_helper ttm drm_kms_helper cfbfillrect syscopyarea cfbimgblt sysfillrect sysimgblt fb_sys_fops cfbcopyarea drm drm_panel_orientation_quirks</div> <div class="">[ +0.000082] CPU: 29 PID: 3800 Comm: amdgpu_test Not tainted 5.16.0-kfd+ #1</div> <div class="">[ +0.000004] Hardware name: Supermicro SYS-4029GP-TRT2/X11DPG-OT-CPU, BIOS 2.1 08/14/2018</div> <div class="">[ +0.000003] RIP: 0010:amdgpu_bo_release_notify+0x164/0x170 [amdgpu]</div> <div class="">[ +0.000114] Code: ff ff ff 48 39 c2 74 07 0f 0b e9 57 ff ff ff 48 89 ef e8 cf 14 15 00 e9 4a ff ff ff e8 f5 05 29 d1 eb c4 0f 0b e9 e7 fe ff ff <0f> 0b eb b9 e8 83 d7 7d d1 0f 1f 00 0f 1f 44 00 00 41 54 55 53 48</div> <div class="">[ +0.000004] RSP: 0018:ffffaa4c206dfc28 EFLAGS: 00010282</div> <div class="">[ +0.000005] RAX: 00000000ffffffea RBX: ffff9478d9c4cc58 RCX: 0000000000000001</div> <div class="">[ +0.000003] RDX: 0000000000000000 RSI: 0000000000000000 RDI: 00000000ffffffff</div> <div class="">[ +0.000002] RBP: ffff9478d9c4cc00 R08: 0000000000000000 R09: 0000000000000001</div> <div class="">[ +0.000003] R10: ffffaa4c206dfac8 R11: ffffaa4c206df8f8 R12: ffff9478d9c4cc58</div> <div class="">[ +0.000003] R13: ffff9478d9c4cd90 R14: ffff9479156c5e08 R15: ffff949857c55020</div> <div class="">[ +0.000002] FS: 00007f59f5b50180(0000) GS:ffff9497c0040000(0000) knlGS:0000000000000000</div> <div class="">[ +0.000003] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033</div> <div class="">[ +0.000003] CR2: 000056517f676b38 CR3: 0000000137bee001 CR4: 00000000007706e0</div> <div class="">[ +0.000003] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000</div> <div class="">[ +0.000002] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400</div> <div class="">[ +0.000003] PKRU: 55555554</div> <div class="">[ +0.000002] Call Trace:</div> <div class="">[ +0.000003] <TASK></div> <div class="">[ +0.000006] ttm_bo_release+0x305/0x390 [ttm]</div> <div class="">[ +0.000011] ? __mutex_unlock_slowpath+0x41/0x280</div> <div class="">[ +0.000014] amdgpu_bo_free_kernel+0xd1/0x120 [amdgpu]</div> <div class="">[ +0.000117] psp_ras_terminate+0x5b/0x70 [amdgpu]</div> <div class="">[ +0.000147] psp_hw_fini+0x23/0x100 [amdgpu]</div> <div class="">[ +0.000145] amdgpu_device_fini_hw+0x1d5/0x3a0 [amdgpu]</div> <div class="">[ +0.000109] amdgpu_pci_remove+0x41/0x60 [amdgpu]</div> <div class="">[ +0.000102] pci_device_remove+0x31/0xb0</div> <div class="">[ +0.000009] device_release_driver_internal+0xf4/0x1d0</div> <div class="">[ +0.000008] pci_stop_bus_device+0x64/0x90</div> <div class="">[ +0.000007] pci_stop_and_remove_bus_device_locked+0x16/0x30</div> <div class="">[ +0.000005] remove_store+0x75/0x90</div> <div class="">[ +0.000007] kernfs_fop_write_iter+0x132/0x1b0</div> <div class="">[ +0.000010] new_sync_write+0x11f/0x1b0</div> <div class="">[ +0.000015] vfs_write+0x35b/0x3b0</div> <div class="">[ +0.000008] ksys_write+0xa7/0xe0</div> <div class="">[ +0.000008] do_syscall_64+0x34/0x80</div> <div class="">[ +0.000007] entry_SYSCALL_64_after_hwframe+0x44/0xae</div> <div class="">[ +0.000005] RIP: 0033:0x7f59f5106371</div> <div class="">[ +0.000004] Code: c3 0f 1f 84 00 00 00 00 00 48 8b 05 69 8c 20 00 c3 0f 1f 84 00 00 00 00 00 8b 05 9a d0 20 00 85 c0 75 16 b8 01 00 00 00 0f 05 <48> 3d 00 f0 ff ff 77 57 f3 c3 0f 1f 44 00 00 41 54 55 49 89 d4 53</div> <div class="">[ +0.000003] RSP: 002b:00007ffff02c6bf8 EFLAGS: 00000246 ORIG_RAX: 0000000000000001</div> <div class="">[ +0.000006] RAX: ffffffffffffffda RBX: 0000000000000000 RCX: 00007f59f5106371</div> <div class="">[ +0.000003] RDX: 0000000000000001 RSI: 000056517d835316 RDI: 0000000000000005</div> <div class="">[ +0.000002] RBP: 0000000000000005 R08: 000056517f6742b0 R09: 0000000000000000</div> <div class="">[ +0.000002] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000</div> <div class="">[ +0.000003] R13: 0000000000000000 R14: 0000000000000000 R15: 000056517da3e8a0</div> <div class="">[ +0.000016] </TASK></div> <div class="">[ +0.000002] irq event stamp: 20653</div> <div class="">[ +0.000002] hardirqs last enabled at (20659): [<ffffffff91107d32>] __up_console_sem+0x52/0x60</div> <div class="">[ +0.000006] hardirqs last disabled at (20664): [<ffffffff91107d17>] __up_console_sem+0x37/0x60</div> <div class="">[ +0.000003] softirqs last enabled at (19878): [<ffffffff9220034b>] __do_softirq+0x34b/0x492</div> <div class="">[ +0.000005] softirqs last disabled at (19753): [<ffffffff91083167>] irq_exit_rcu+0xd7/0xf0</div> <div class="">[ +0.000005] ---[ end trace 90fbe3f286a48d6c ]---</div> <div class="">[ +0.000410] [drm] free PSP TMR buffer</div> <div class="">[ +0.000009] [drm:amdgpu_fill_buffer [amdgpu]] *ERROR* Trying to clear memory with ring turned off.</div> <div class="">[ +0.000209] ------------[ cut here ]------------</div> <div class="">[ +0.000002] WARNING: CPU: 29 PID: 3800 at drivers/gpu/drm/amd/amdgpu/amdgpu_object.c:1313 amdgpu_bo_release_notify+0x164/0x170 [amdgpu]</div> <div class="">[ +0.000115] Modules linked in: amdgpu iommu_v2 gpu_sched nf_conntrack_netlink nfnetlink xt_addrtype br_netfilter xt_CHECKSUM iptable_mangle xt_MASQUERADE iptable_nat nf_nat xt_conntrack nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 ipt_REJECT nf_reject_ipv4 xt_tcpudp ip6table_filter ip6_tables iptable_filter fuse x86_pkg_temp_thermal acpi_pad ip_tables x_tables ast drm_vram_helper drm_ttm_helper ttm drm_kms_helper cfbfillrect syscopyarea cfbimgblt sysfillrect sysimgblt fb_sys_fops cfbcopyarea drm drm_panel_orientation_quirks</div> <div class="">[ +0.000079] CPU: 29 PID: 3800 Comm: amdgpu_test Tainted: G W 5.16.0-kfd+ #1</div> <div class="">[ +0.000004] Hardware name: Supermicro SYS-4029GP-TRT2/X11DPG-OT-CPU, BIOS 2.1 08/14/2018</div> <div class="">[ +0.000003] RIP: 0010:amdgpu_bo_release_notify+0x164/0x170 [amdgpu]</div> <div class="">[ +0.000111] Code: ff ff ff 48 39 c2 74 07 0f 0b e9 57 ff ff ff 48 89 ef e8 cf 14 15 00 e9 4a ff ff ff e8 f5 05 29 d1 eb c4 0f 0b e9 e7 fe ff ff <0f> 0b eb b9 e8 83 d7 7d d1 0f 1f 00 0f 1f 44 00 00 41 54 55 53 48</div> <div class="">[ +0.000004] RSP: 0018:ffffaa4c206dfc18 EFLAGS: 00010282</div> <div class="">[ +0.000004] RAX: 00000000ffffffea RBX: ffff9478d9c4fc58 RCX: 0000000000000001</div> <div class="">[ +0.000003] RDX: 0000000000000000 RSI: 0000000000000000 RDI: 00000000ffffffff</div> <div class="">[ +0.000041] RBP: ffff9478d9c4fc00 R08: 0000000000000000 R09: 0000000000000001</div> <div class="">[ +0.000004] R10: ffffaa4c206dfab8 R11: ffffaa4c206df8e8 R12: ffff9478d9c4fc58</div> <div class="">[ +0.000002] R13: ffff9478d9c4fd90 R14: ffff9479156c5e08 R15: ffff949857c55020</div> <div class="">[ +0.000003] FS: 00007f59f5b50180(0000) GS:ffff9497c0040000(0000) knlGS:0000000000000000</div> <div class="">[ +0.000003] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033</div> <div class="">[ +0.000003] CR2: 000056517f676b38 CR3: 0000000137bee001 CR4: 00000000007706e0</div> <div class="">[ +0.000003] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000</div> <div class="">[ +0.000003] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400</div> <div class="">[ +0.000002] PKRU: 55555554</div> <div class="">[ +0.000003] Call Trace:</div> <div class="">[ +0.000002] <TASK></div> <div class="">[ +0.000006] ttm_bo_release+0x305/0x390 [ttm]</div> <div class="">[ +0.000010] ? __mutex_unlock_slowpath+0x41/0x280</div> <div class="">[ +0.000013] amdgpu_bo_free_kernel+0xd1/0x120 [amdgpu]</div> <div class="">[ +0.000117] psp_tmr_terminate+0x9b/0xc0 [amdgpu]</div> <div class="">[ +0.000149] psp_hw_fini+0x69/0x100 [amdgpu]</div> <div class="">[ +0.000145] amdgpu_device_fini_hw+0x1d5/0x3a0 [amdgpu]</div> <div class="">[ +0.000109] amdgpu_pci_remove+0x41/0x60 [amdgpu]</div> <div class="">[ +0.000103] pci_device_remove+0x31/0xb0</div> <div class="">[ +0.000007] device_release_driver_internal+0xf4/0x1d0</div> <div class="">[ +0.000008] pci_stop_bus_device+0x64/0x90</div> <div class="">[ +0.000007] pci_stop_and_remove_bus_device_locked+0x16/0x30</div> <div class="">[ +0.000005] remove_store+0x75/0x90</div> <div class="">[ +0.000007] kernfs_fop_write_iter+0x132/0x1b0</div> <div class="">[ +0.000009] new_sync_write+0x11f/0x1b0</div> <div class="">[ +0.000015] vfs_write+0x35b/0x3b0</div> <div class="">[ +0.000007] ksys_write+0xa7/0xe0</div> <div class="">[ +0.000009] do_syscall_64+0x34/0x80</div> <div class="">[ +0.000007] entry_SYSCALL_64_after_hwframe+0x44/0xae</div> <div class="">[ +0.000006] RIP: 0033:0x7f59f5106371</div> <div class="">[ +0.000003] Code: c3 0f 1f 84 00 00 00 00 00 48 8b 05 69 8c 20 00 c3 0f 1f 84 00 00 00 00 00 8b 05 9a d0 20 00 85 c0 75 16 b8 01 00 00 00 0f 05 <48> 3d 00 f0 ff ff 77 57 f3 c3 0f 1f 44 00 00 41 54 55 49 89 d4 53</div> <div class="">[ +0.000003] RSP: 002b:00007ffff02c6bf8 EFLAGS: 00000246 ORIG_RAX: 0000000000000001</div> <div class="">[ +0.000005] RAX: ffffffffffffffda RBX: 0000000000000000 RCX: 00007f59f5106371</div> <div class="">[ +0.000003] RDX: 0000000000000001 RSI: 000056517d835316 RDI: 0000000000000005</div> <div class="">[ +0.000002] RBP: 0000000000000005 R08: 000056517f6742b0 R09: 0000000000000000</div> <div class="">[ +0.000003] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000</div> <div class="">[ +0.000002] R13: 0000000000000000 R14: 0000000000000000 R15: 000056517da3e8a0</div> <div class="">[ +0.000016] </TASK></div> <div class="">[ +0.000002] irq event stamp: 21269</div> <div class="">[ +0.000003] hardirqs last enabled at (21275): [<ffffffff91107d32>] __up_console_sem+0x52/0x60</div> <div class="">[ +0.000004] hardirqs last disabled at (21280): [<ffffffff91107d17>] __up_console_sem+0x37/0x60</div> <div class="">[ +0.000003] softirqs last enabled at (21032): [<ffffffff9220034b>] __do_softirq+0x34b/0x492</div> <div class="">[ +0.000005] softirqs last disabled at (21027): [<ffffffff91083167>] irq_exit_rcu+0xd7/0xf0</div> <div class="">[ +0.000006] ---[ end trace 90fbe3f286a48d6d ]---</div> <div class="">[ +0.020204] [drm:amdgpu_fill_buffer [amdgpu]] *ERROR* Trying to clear memory with ring turned off.</div> <div class="">[ +0.000197] ------------[ cut here ]------------</div> <div class="">[ +0.000002] WARNING: CPU: 29 PID: 3800 at drivers/gpu/drm/amd/amdgpu/amdgpu_object.c:1313 amdgpu_bo_release_notify+0x164/0x170 [amdgpu]</div> <div class="">[ +0.000116] Modules linked in: amdgpu iommu_v2 gpu_sched nf_conntrack_netlink nfnetlink xt_addrtype br_netfilter xt_CHECKSUM iptable_mangle xt_MASQUERADE iptable_nat nf_nat xt_conntrack nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 ipt_REJECT nf_reject_ipv4 xt_tcpudp ip6table_filter ip6_tables iptable_filter fuse x86_pkg_temp_thermal acpi_pad ip_tables x_tables ast drm_vram_helper drm_ttm_helper ttm drm_kms_helper cfbfillrect syscopyarea cfbimgblt sysfillrect sysimgblt fb_sys_fops cfbcopyarea drm drm_panel_orientation_quirks</div> <div class="">[ +0.000076] CPU: 29 PID: 3800 Comm: amdgpu_test Tainted: G W 5.16.0-kfd+ #1</div> <div class="">[ +0.000004] Hardware name: Supermicro SYS-4029GP-TRT2/X11DPG-OT-CPU, BIOS 2.1 08/14/2018</div> <div class="">[ +0.000003] RIP: 0010:amdgpu_bo_release_notify+0x164/0x170 [amdgpu]</div> <div class="">[ +0.000112] Code: ff ff ff 48 39 c2 74 07 0f 0b e9 57 ff ff ff 48 89 ef e8 cf 14 15 00 e9 4a ff ff ff e8 f5 05 29 d1 eb c4 0f 0b e9 e7 fe ff ff <0f> 0b eb b9 e8 83 d7 7d d1 0f 1f 00 0f 1f 44 00 00 41 54 55 53 48</div> <div class="">[ +0.000003] RSP: 0018:ffffaa4c206dfc20 EFLAGS: 00010282</div> <div class="">[ +0.000005] RAX: 00000000ffffffea RBX: ffff9478d9c4f858 RCX: 0000000000000001</div> <div class="">[ +0.000003] RDX: 0000000000000000 RSI: 0000000000000000 RDI: 00000000ffffffff</div> <div class="">[ +0.000002] RBP: ffff9478d9c4f800 R08: 0000000000000000 R09: 0000000000000001</div> <div class="">[ +0.000003] R10: ffffaa4c206dfac0 R11: ffffaa4c206df8f0 R12: ffff9478d9c4f858</div> <div class="">[ +0.000002] R13: ffff9478d9c4f990 R14: ffff9479156c5e08 R15: ffff949857c55020</div> <div class="">[ +0.000003] FS: 00007f59f5b50180(0000) GS:ffff9497c0040000(0000) knlGS:0000000000000000</div> <div class="">[ +0.000003] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033</div> <div class="">[ +0.000003] CR2: 000056517f676b38 CR3: 0000000137bee001 CR4: 00000000007706e0</div> <div class="">[ +0.000002] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000</div> <div class="">[ +0.000003] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400</div> <div class="">[ +0.000002] PKRU: 55555554</div> <div class="">[ +0.000002] Call Trace:</div> <div class="">[ +0.000003] <TASK></div> <div class="">[ +0.000005] ttm_bo_release+0x305/0x390 [ttm]</div> <div class="">[ +0.000010] ? __mutex_unlock_slowpath+0x41/0x280</div> <div class="">[ +0.000010] amdgpu_bo_free_kernel+0xd1/0x120 [amdgpu]</div> <div class="">[ +0.000116] psp_v11_0_ring_destroy+0x3b/0x50 [amdgpu]</div> <div class="">[ +0.000148] psp_hw_fini+0x7b/0x100 [amdgpu]</div> <div class="">[ +0.000145] amdgpu_device_fini_hw+0x1d5/0x3a0 [amdgpu]</div> <div class="">[ +0.000109] amdgpu_pci_remove+0x41/0x60 [amdgpu]</div> <div class="">[ +0.000102] pci_device_remove+0x31/0xb0</div> <div class="">[ +0.000006] device_release_driver_internal+0xf4/0x1d0</div> <div class="">[ +0.000008] pci_stop_bus_device+0x64/0x90</div> <div class="">[ +0.000006] pci_stop_and_remove_bus_device_locked+0x16/0x30</div> <div class="">[ +0.000005] remove_store+0x75/0x90</div> <div class="">[ +0.000007] kernfs_fop_write_iter+0x132/0x1b0</div> <div class="">[ +0.000008] new_sync_write+0x11f/0x1b0</div> <div class="">[ +0.000015] vfs_write+0x35b/0x3b0</div> <div class="">[ +0.000007] ksys_write+0xa7/0xe0</div> <div class="">[ +0.000009] do_syscall_64+0x34/0x80</div> <div class="">[ +0.000006] entry_SYSCALL_64_after_hwframe+0x44/0xae</div> <div class="">[ +0.000004] RIP: 0033:0x7f59f5106371</div> <div class="">[ +0.000003] Code: c3 0f 1f 84 00 00 00 00 00 48 8b 05 69 8c 20 00 c3 0f 1f 84 00 00 00 00 00 8b 05 9a d0 20 00 85 c0 75 16 b8 01 00 00 00 0f 05 <48> 3d 00 f0 ff ff 77 57 f3 c3 0f 1f 44 00 00 41 54 55 49 89 d4 53</div> <div class="">[ +0.000003] RSP: 002b:00007ffff02c6bf8 EFLAGS: 00000246 ORIG_RAX: 0000000000000001</div> <div class="">[ +0.000005] RAX: ffffffffffffffda RBX: 0000000000000000 RCX: 00007f59f5106371</div> <div class="">[ +0.000002] RDX: 0000000000000001 RSI: 000056517d835316 RDI: 0000000000000005</div> <div class="">[ +0.000003] RBP: 0000000000000005 R08: 000056517f6742b0 R09: 0000000000000000</div> <div class="">[ +0.000002] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000</div> <div class="">[ +0.000002] R13: 0000000000000000 R14: 0000000000000000 R15: 000056517da3e8a0</div> <div class="">[ +0.000016] </TASK></div> <div class="">[ +0.000002] irq event stamp: 21937</div> <div class="">[ +0.000002] hardirqs last enabled at (21943): [<ffffffff91107d32>] __up_console_sem+0x52/0x60</div> <div class="">[ +0.000004] hardirqs last disabled at (21948): [<ffffffff91107d17>] __up_console_sem+0x37/0x60</div> <div class="">[ +0.000003] softirqs last enabled at (21366): [<ffffffff9220034b>] __do_softirq+0x34b/0x492</div> <div class="">[ +0.000005] softirqs last disabled at (21311): [<ffffffff91083167>] irq_exit_rcu+0xd7/0xf0</div> <div class="">[ +0.000005] ---[ end trace 90fbe3f286a48d6e ]---</div> <div class="">[ +0.000527] [drm:amdgpu_fill_buffer [amdgpu]] *ERROR* Trying to clear memory with ring turned off.</div> <div class="">[ +0.000195] ------------[ cut here ]------------</div> <div class="">[ +0.000003] WARNING: CPU: 29 PID: 3800 at drivers/gpu/drm/amd/amdgpu/amdgpu_object.c:1313 amdgpu_bo_release_notify+0x164/0x170 [amdgpu]</div> <div class="">[ +0.000115] Modules linked in: amdgpu iommu_v2 gpu_sched nf_conntrack_netlink nfnetlink xt_addrtype br_netfilter xt_CHECKSUM iptable_mangle xt_MASQUERADE iptable_nat nf_nat xt_conntrack nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 ipt_REJECT nf_reject_ipv4 xt_tcpudp ip6table_filter ip6_tables iptable_filter fuse x86_pkg_temp_thermal acpi_pad ip_tables x_tables ast drm_vram_helper drm_ttm_helper ttm drm_kms_helper cfbfillrect syscopyarea cfbimgblt sysfillrect sysimgblt fb_sys_fops cfbcopyarea drm drm_panel_orientation_quirks</div> <div class="">[ +0.000077] CPU: 29 PID: 3800 Comm: amdgpu_test Tainted: G W 5.16.0-kfd+ #1</div> <div class="">[ +0.000003] Hardware name: Supermicro SYS-4029GP-TRT2/X11DPG-OT-CPU, BIOS 2.1 08/14/2018</div> <div class="">[ +0.000003] RIP: 0010:amdgpu_bo_release_notify+0x164/0x170 [amdgpu]</div> <div class="">[ +0.000111] Code: ff ff ff 48 39 c2 74 07 0f 0b e9 57 ff ff ff 48 89 ef e8 cf 14 15 00 e9 4a ff ff ff e8 f5 05 29 d1 eb c4 0f 0b e9 e7 fe ff ff <0f> 0b eb b9 e8 83 d7 7d d1 0f 1f 00 0f 1f 44 00 00 41 54 55 53 48</div> <div class="">[ +0.000004] RSP: 0018:ffffaa4c206dfc40 EFLAGS: 00010282</div> <div class="">[ +0.000004] RAX: 00000000ffffffea RBX: ffff9478d9c4f058 RCX: 0000000000000001</div> <div class="">[ +0.000003] RDX: 0000000000000000 RSI: 0000000000000000 RDI: 00000000ffffffff</div> <div class="">[ +0.000002] RBP: ffff9478d9c4f000 R08: 0000000000000000 R09: 0000000000000001</div> <div class="">[ +0.000003] R10: ffffaa4c206dfae0 R11: ffffaa4c206df910 R12: ffff9478d9c4f058</div> <div class="">[ +0.000002] R13: ffff9478d9c4f190 R14: ffff9479156c5e08 R15: ffff949857c55020</div> <div class="">[ +0.000003] FS: 00007f59f5b50180(0000) GS:ffff9497c0040000(0000) knlGS:0000000000000000</div> <div class="">[ +0.000003] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033</div> <div class="">[ +0.000003] CR2: 000056517f676b38 CR3: 0000000137bee001 CR4: 00000000007706e0</div> <div class="">[ +0.000002] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000</div> <div class="">[ +0.000002] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400</div> <div class="">[ +0.000003] PKRU: 55555554</div> <div class="">[ +0.000002] Call Trace:</div> <div class="">[ +0.000003] <TASK></div> <div class="">[ +0.000005] ttm_bo_release+0x305/0x390 [ttm]</div> <div class="">[ +0.000009] ? __mutex_unlock_slowpath+0x41/0x280</div> <div class="">[ +0.000011] amdgpu_bo_free_kernel+0xd1/0x120 [amdgpu]</div> <div class="">[ +0.000115] psp_hw_fini+0xaf/0x100 [amdgpu]</div> <div class="">[ +0.000145] amdgpu_device_fini_hw+0x1d5/0x3a0 [amdgpu]</div> <div class="">[ +0.000109] amdgpu_pci_remove+0x41/0x60 [amdgpu]</div> <div class="">[ +0.000102] pci_device_remove+0x31/0xb0</div> <div class="">[ +0.000006] device_release_driver_internal+0xf4/0x1d0</div> <div class="">[ +0.000008] pci_stop_bus_device+0x64/0x90</div> <div class="">[ +0.000006] pci_stop_and_remove_bus_device_locked+0x16/0x30</div> <div class="">[ +0.000004] remove_store+0x75/0x90</div> <div class="">[ +0.000040] kernfs_fop_write_iter+0x132/0x1b0</div> <div class="">[ +0.000010] new_sync_write+0x11f/0x1b0</div> <div class="">[ +0.000014] vfs_write+0x35b/0x3b0</div> <div class="">[ +0.000008] ksys_write+0xa7/0xe0</div> <div class="">[ +0.000009] do_syscall_64+0x34/0x80</div> <div class="">[ +0.000008] entry_SYSCALL_64_after_hwframe+0x44/0xae</div> <div class="">[ +0.000004] RIP: 0033:0x7f59f5106371</div> <div class="">[ +0.000003] Code: c3 0f 1f 84 00 00 00 00 00 48 8b 05 69 8c 20 00 c3 0f 1f 84 00 00 00 00 00 8b 05 9a d0 20 00 85 c0 75 16 b8 01 00 00 00 0f 05 <48> 3d 00 f0 ff ff 77 57 f3 c3 0f 1f 44 00 00 41 54 55 49 89 d4 53</div> <div class="">[ +0.000003] RSP: 002b:00007ffff02c6bf8 EFLAGS: 00000246 ORIG_RAX: 0000000000000001</div> <div class="">[ +0.000005] RAX: ffffffffffffffda RBX: 0000000000000000 RCX: 00007f59f5106371</div> <div class="">[ +0.000003] RDX: 0000000000000001 RSI: 000056517d835316 RDI: 0000000000000005</div> <div class="">[ +0.000003] RBP: 0000000000000005 R08: 000056517f6742b0 R09: 0000000000000000</div> <div class="">[ +0.000002] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000</div> <div class="">[ +0.000003] R13: 0000000000000000 R14: 0000000000000000 R15: 000056517da3e8a0</div> <div class="">[ +0.000016] </TASK></div> <div class="">[ +0.000002] irq event stamp: 22539</div> <div class="">[ +0.000002] hardirqs last enabled at (22545): [<ffffffff91107d32>] __up_console_sem+0x52/0x60</div> <div class="">[ +0.000005] hardirqs last disabled at (22550): [<ffffffff91107d17>] __up_console_sem+0x37/0x60</div> <div class="">[ +0.000003] softirqs last enabled at (21366): [<ffffffff9220034b>] __do_softirq+0x34b/0x492</div> <div class="">[ +0.000005] softirqs last disabled at (21311): [<ffffffff91083167>] irq_exit_rcu+0xd7/0xf0</div> <div class="">[ +0.000004] ---[ end trace 90fbe3f286a48d6f ]---</div> <div class="">[ +0.000296] [drm:amdgpu_fill_buffer [amdgpu]] *ERROR* Trying to clear memory with ring turned off.</div> <div class="">[ +0.000194] ------------[ cut here ]------------</div> <div class="">[ +0.000002] WARNING: CPU: 29 PID: 3800 at drivers/gpu/drm/amd/amdgpu/amdgpu_object.c:1313 amdgpu_bo_release_notify+0x164/0x170 [amdgpu]</div> <div class="">[ +0.000114] Modules linked in: amdgpu iommu_v2 gpu_sched nf_conntrack_netlink nfnetlink xt_addrtype br_netfilter xt_CHECKSUM iptable_mangle xt_MASQUERADE iptable_nat nf_nat xt_conntrack nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 ipt_REJECT nf_reject_ipv4 xt_tcpudp ip6table_filter ip6_tables iptable_filter fuse x86_pkg_temp_thermal acpi_pad ip_tables x_tables ast drm_vram_helper drm_ttm_helper ttm drm_kms_helper cfbfillrect syscopyarea cfbimgblt sysfillrect sysimgblt fb_sys_fops cfbcopyarea drm drm_panel_orientation_quirks</div> <div class="">[ +0.000078] CPU: 29 PID: 3800 Comm: amdgpu_test Tainted: G W 5.16.0-kfd+ #1</div> <div class="">[ +0.000003] Hardware name: Supermicro SYS-4029GP-TRT2/X11DPG-OT-CPU, BIOS 2.1 08/14/2018</div> <div class="">[ +0.000003] RIP: 0010:amdgpu_bo_release_notify+0x164/0x170 [amdgpu]</div> <div class="">[ +0.000112] Code: ff ff ff 48 39 c2 74 07 0f 0b e9 57 ff ff ff 48 89 ef e8 cf 14 15 00 e9 4a ff ff ff e8 f5 05 29 d1 eb c4 0f 0b e9 e7 fe ff ff <0f> 0b eb b9 e8 83 d7 7d d1 0f 1f 00 0f 1f 44 00 00 41 54 55 53 48</div> <div class="">[ +0.000003] RSP: 0018:ffffaa4c206dfc40 EFLAGS: 00010282</div> <div class="">[ +0.000005] RAX: 00000000ffffffea RBX: ffff9478d9c4f458 RCX: 0000000000000001</div> <div class="">[ +0.000003] RDX: 0000000000000000 RSI: 0000000000000000 RDI: 00000000ffffffff</div> <div class="">[ +0.000002] RBP: ffff9478d9c4f400 R08: 0000000000000000 R09: 0000000000000001</div> <div class="">[ +0.000002] R10: ffffaa4c206dfae0 R11: ffffaa4c206df910 R12: ffff9478d9c4f458</div> <div class="">[ +0.000003] R13: ffff9478d9c4f590 R14: ffff9479156c5e08 R15: ffff949857c55020</div> <div class="">[ +0.000002] FS: 00007f59f5b50180(0000) GS:ffff9497c0040000(0000) knlGS:0000000000000000</div> <div class="">[ +0.000004] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033</div> <div class="">[ +0.000003] CR2: 000056517f676b38 CR3: 0000000137bee001 CR4: 00000000007706e0</div> <div class="">[ +0.000003] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000</div> <div class="">[ +0.000002] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400</div> <div class="">[ +0.000002] PKRU: 55555554</div> <div class="">[ +0.000002] Call Trace:</div> <div class="">[ +0.000003] <TASK></div> <div class="">[ +0.000005] ttm_bo_release+0x305/0x390 [ttm]</div> <div class="">[ +0.000009] ? __mutex_unlock_slowpath+0x41/0x280</div> <div class="">[ +0.000011] amdgpu_bo_free_kernel+0xd1/0x120 [amdgpu]</div> <div class="">[ +0.000115] psp_hw_fini+0xc9/0x100 [amdgpu]</div> <div class="">[ +0.000146] amdgpu_device_fini_hw+0x1d5/0x3a0 [amdgpu]</div> <div class="">[ +0.000110] amdgpu_pci_remove+0x41/0x60 [amdgpu]</div> <div class="">[ +0.000103] pci_device_remove+0x31/0xb0</div> <div class="">[ +0.000006] device_release_driver_internal+0xf4/0x1d0</div> <div class="">[ +0.000008] pci_stop_bus_device+0x64/0x90</div> <div class="">[ +0.000006] pci_stop_and_remove_bus_device_locked+0x16/0x30</div> <div class="">[ +0.000005] remove_store+0x75/0x90</div> <div class="">[ +0.000007] kernfs_fop_write_iter+0x132/0x1b0</div> <div class="">[ +0.000008] new_sync_write+0x11f/0x1b0</div> <div class="">[ +0.000015] vfs_write+0x35b/0x3b0</div> <div class="">[ +0.000007] ksys_write+0xa7/0xe0</div> <div class="">[ +0.000010] do_syscall_64+0x34/0x80</div> <div class="">[ +0.000007] entry_SYSCALL_64_after_hwframe+0x44/0xae</div> <div class="">[ +0.000004] RIP: 0033:0x7f59f5106371</div> <div class="">[ +0.000003] Code: c3 0f 1f 84 00 00 00 00 00 48 8b 05 69 8c 20 00 c3 0f 1f 84 00 00 00 00 00 8b 05 9a d0 20 00 85 c0 75 16 b8 01 00 00 00 0f 05 <48> 3d 00 f0 ff ff 77 57 f3 c3 0f 1f 44 00 00 41 54 55 49 89 d4 53</div> <div class="">[ +0.000003] RSP: 002b:00007ffff02c6bf8 EFLAGS: 00000246 ORIG_RAX: 0000000000000001</div> <div class="">[ +0.000005] RAX: ffffffffffffffda RBX: 0000000000000000 RCX: 00007f59f5106371</div> <div class="">[ +0.000003] RDX: 0000000000000001 RSI: 000056517d835316 RDI: 0000000000000005</div> <div class="">[ +0.000002] RBP: 0000000000000005 R08: 000056517f6742b0 R09: 0000000000000000</div> <div class="">[ +0.000003] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000</div> <div class="">[ +0.000002] R13: 0000000000000000 R14: 0000000000000000 R15: 000056517da3e8a0</div> <div class="">[ +0.000016] </TASK></div> <div class="">[ +0.000002] irq event stamp: 23135</div> <div class="">[ +0.000002] hardirqs last enabled at (23141): [<ffffffff91107d32>] __up_console_sem+0x52/0x60</div> <div class="">[ +0.000004] hardirqs last disabled at (23146): [<ffffffff91107d17>] __up_console_sem+0x37/0x60</div> <div class="">[ +0.000003] softirqs last enabled at (21366): [<ffffffff9220034b>] __do_softirq+0x34b/0x492</div> <div class="">[ +0.000004] softirqs last disabled at (21311): [<ffffffff91083167>] irq_exit_rcu+0xd7/0xf0</div> <div class="">[ +0.000005] ---[ end trace 90fbe3f286a48d70 ]---</div> <div class="">[ +2.511285] pci 0000:43:00.0: Removing from iommu group 73</div> <div class="">[ +0.001309] [drm:amdgpu_fill_buffer [amdgpu]] *ERROR* Trying to clear memory with ring turned off.</div> <div class="">[ +0.000472] ------------[ cut here ]------------</div> <div class="">[ +0.000003] WARNING: CPU: 29 PID: 3800 at drivers/gpu/drm/amd/amdgpu/amdgpu_object.c:1313 amdgpu_bo_release_notify+0x164/0x170 [amdgpu]</div> <div class="">[ +0.000119] Modules linked in: amdgpu iommu_v2 gpu_sched nf_conntrack_netlink nfnetlink xt_addrtype br_netfilter xt_CHECKSUM iptable_mangle xt_MASQUERADE iptable_nat nf_nat xt_conntrack nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 ipt_REJECT nf_reject_ipv4 xt_tcpudp ip6table_filter ip6_tables iptable_filter fuse x86_pkg_temp_thermal acpi_pad ip_tables x_tables ast drm_vram_helper drm_ttm_helper ttm drm_kms_helper cfbfillrect syscopyarea cfbimgblt sysfillrect sysimgblt fb_sys_fops cfbcopyarea drm drm_panel_orientation_quirks</div> <div class="">[ +0.000069] CPU: 29 PID: 3800 Comm: amdgpu_test Tainted: G W 5.16.0-kfd+ #1</div> <div class="">[ +0.000004] Hardware name: Supermicro SYS-4029GP-TRT2/X11DPG-OT-CPU, BIOS 2.1 08/14/2018</div> <div class="">[ +0.000002] RIP: 0010:amdgpu_bo_release_notify+0x164/0x170 [amdgpu]</div> <div class="">[ +0.000114] Code: ff ff ff 48 39 c2 74 07 0f 0b e9 57 ff ff ff 48 89 ef e8 cf 14 15 00 e9 4a ff ff ff e8 f5 05 29 d1 eb c4 0f 0b e9 e7 fe ff ff <0f> 0b eb b9 e8 83 d7 7d d1 0f 1f 00 0f 1f 44 00 00 41 54 55 53 48</div> <div class="">[ +0.000003] RSP: 0018:ffffaa4c206dfd50 EFLAGS: 00010282</div> <div class="">[ +0.000004] RAX: 00000000ffffffea RBX: ffff9479154e8058 RCX: 0000000000000001</div> <div class="">[ +0.000003] RDX: 0000000000000000 RSI: 0000000000000000 RDI: 00000000ffffffff</div> <div class="">[ +0.000002] RBP: ffff9479154e8000 R08: 0000000000000000 R09: 0000000000000001</div> <div class="">[ +0.000003] R10: ffffaa4c206dfbf0 R11: ffffaa4c206dfa20 R12: ffff9479154e8058</div> <div class="">[ +0.000002] R13: ffff9479154e8190 R14: ffff9479154e8190 R15: 0000000000008000</div> <div class="">[ +0.000003] FS: 00007f59f5b50180(0000) GS:ffff9497c0040000(0000) knlGS:0000000000000000</div> <div class="">[ +0.000003] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033</div> <div class="">[ +0.000002] CR2: 000056517f676b38 CR3: 0000000137bee001 CR4: 00000000007706e0</div> <div class="">[ +0.000003] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000</div> <div class="">[ +0.000002] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400</div> <div class="">[ +0.000002] PKRU: 55555554</div> <div class="">[ +0.000002] Call Trace:</div> <div class="">[ +0.000002] <TASK></div> <div class="">[ +0.000005] ttm_bo_release+0x305/0x390 [ttm]</div> <div class="">[ +0.000015] amdgpu_bo_unref+0x1a/0x30 [amdgpu]</div> <div class="">[ +0.000113] amdgpu_driver_postclose_kms+0x17b/0x320 [amdgpu]</div> <div class="">[ +0.000106] ? __mutex_unlock_slowpath+0x41/0x280</div> <div class="">[ +0.000010] drm_file_free.part.16+0x1e3/0x230 [drm]</div> <div class="">[ +0.000029] drm_release+0x6e/0xf0 [drm]</div> <div class="">[ +0.000020] __fput+0xa1/0x260</div> <div class="">[ +0.000007] task_work_run+0x6d/0xb0</div> <div class="">[ +0.000010] exit_to_user_mode_prepare+0x1d3/0x1e0</div> <div class="">[ +0.000005] syscall_exit_to_user_mode+0x19/0x50</div> <div class="">[ +0.000004] do_syscall_64+0x40/0x80</div> <div class="">[ +0.000005] entry_SYSCALL_64_after_hwframe+0x44/0xae</div> <div class="">[ +0.000004] RIP: 0033:0x7f59f5106511</div> <div class="">[ +0.000003] Code: f7 d8 64 89 02 48 c7 c0 ff ff ff ff c3 66 2e 0f 1f 84 00 00 00 00 00 66 90 8b 05 fa ce 20 00 85 c0 75 16 b8 03 00 00 00 0f 05 <48> 3d 00 f0 ff ff 77 3f f3 c3 0f 1f 44 00 00 53 89 fb 48 83 ec 10</div> <div class="">[ +0.000003] RSP: 002b:00007ffff02c6be8 EFLAGS: 00000246 ORIG_RAX: 0000000000000003</div> <div class="">[ +0.000005] RAX: 0000000000000000 RBX: 000056517da3e6a0 RCX: 00007f59f5106511</div> <div class="">[ +0.000002] RDX: 00007f59f50efca0 RSI: 000056517f676100 RDI: 0000000000000003</div> <div class="">[ +0.000003] RBP: 000056517da3e8a0 R08: 0000000000000000 R09: 0000000000000000</div> <div class="">[ +0.000002] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000</div> <div class="">[ +0.000002] R13: 0000000000000000 R14: 0000000000000000 R15: 000056517da3e8a0</div> <div class="">[ +0.000014] </TASK></div> <div class="">[ +0.000002] irq event stamp: 32575</div> <div class="">[ +0.000003] hardirqs last enabled at (32581): [<ffffffff91107d32>] __up_console_sem+0x52/0x60</div> <div class="">[ +0.000004] hardirqs last disabled at (32586): [<ffffffff91107d17>] __up_console_sem+0x37/0x60</div> <div class="">[ +0.000003] softirqs last enabled at (31702): [<ffffffff9220034b>] __do_softirq+0x34b/0x492</div> <div class="">[ +0.000004] softirqs last disabled at (31697): [<ffffffff91083167>] irq_exit_rcu+0xd7/0xf0</div> <div class="">[ +0.000004] ---[ end trace 90fbe3f286a48d71 ]---</div> <div class="">[ +0.002906] [drm:amdgpu_fill_buffer [amdgpu]] *ERROR* Trying to clear memory with ring turned off.</div> <div class="">[ +0.000426] ------------[ cut here ]------------</div> <div class="">[ +0.000002] WARNING: CPU: 29 PID: 3800 at drivers/gpu/drm/amd/amdgpu/amdgpu_object.c:1313 amdgpu_bo_release_notify+0x164/0x170 [amdgpu]</div> <div class="">[ +0.000119] Modules linked in: amdgpu iommu_v2 gpu_sched nf_conntrack_netlink nfnetlink xt_addrtype br_netfilter xt_CHECKSUM iptable_mangle xt_MASQUERADE iptable_nat nf_nat xt_conntrack nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 ipt_REJECT nf_reject_ipv4 xt_tcpudp ip6table_filter ip6_tables iptable_filter fuse x86_pkg_temp_thermal acpi_pad ip_tables x_tables ast drm_vram_helper drm_ttm_helper ttm drm_kms_helper cfbfillrect syscopyarea cfbimgblt sysfillrect sysimgblt fb_sys_fops cfbcopyarea drm drm_panel_orientation_quirks</div> <div class="">[ +0.000064] CPU: 29 PID: 3800 Comm: amdgpu_test Tainted: G W 5.16.0-kfd+ #1</div> <div class="">[ +0.000004] Hardware name: Supermicro SYS-4029GP-TRT2/X11DPG-OT-CPU, BIOS 2.1 08/14/2018</div> <div class="">[ +0.000002] RIP: 0010:amdgpu_bo_release_notify+0x164/0x170 [amdgpu]</div> <div class="">[ +0.000114] Code: ff ff ff 48 39 c2 74 07 0f 0b e9 57 ff ff ff 48 89 ef e8 cf 14 15 00 e9 4a ff ff ff e8 f5 05 29 d1 eb c4 0f 0b e9 e7 fe ff ff <0f> 0b eb b9 e8 83 d7 7d d1 0f 1f 00 0f 1f 44 00 00 41 54 55 53 48</div> <div class="">[ +0.000003] RSP: 0018:ffffaa4c206dfd18 EFLAGS: 00010282</div> <div class="">[ +0.000004] RAX: 00000000ffffffea RBX: ffff9478d615ec58 RCX: 0000000000000001</div> <div class="">[ +0.000003] RDX: 0000000000000000 RSI: 0000000000000000 RDI: 00000000ffffffff</div> <div class="">[ +0.000002] RBP: ffff9478d615ec00 R08: 0000000000000000 R09: 0000000000000001</div> <div class="">[ +0.000003] R10: 0000000000000000 R11: ffffaa4c206df9e8 R12: ffff9478d615ec58</div> <div class="">[ +0.000002] R13: ffff9478d615ed90 R14: ffff9479156c5e08 R15: ffffffff9345ea20</div> <div class="">[ +0.000002] FS: 00007f59f5b50180(0000) GS:ffff9497c0040000(0000) knlGS:0000000000000000</div> <div class="">[ +0.000003] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033</div> <div class="">[ +0.000003] CR2: 000056517f676b38 CR3: 0000000137bee001 CR4: 00000000007706e0</div> <div class="">[ +0.000002] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000</div> <div class="">[ +0.000002] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400</div> <div class="">[ +0.000002] PKRU: 55555554</div> <div class="">[ +0.000002] Call Trace:</div> <div class="">[ +0.000002] <TASK></div> <div class="">[ +0.000005] ttm_bo_release+0x305/0x390 [ttm]</div> <div class="">[ +0.000009] ? __mutex_unlock_slowpath+0x41/0x280</div> <div class="">[ +0.000010] amdgpu_bo_free_kernel+0xd1/0x120 [amdgpu]</div> <div class="">[ +0.000116] amdgpu_vcn_sw_fini+0x12b/0x130 [amdgpu]</div> <div class="">[ +0.000159] vcn_v2_5_sw_fini+0x97/0xc0 [amdgpu]</div> <div class="">[ +0.000157] amdgpu_device_fini_sw+0xbc/0x2e0 [amdgpu]</div> <div class="">[ +0.000108] amdgpu_driver_release_kms+0x12/0x30 [amdgpu]</div> <div class="">[ +0.000106] drm_dev_release+0x20/0x40 [drm]</div> <div class="">[ +0.000025] drm_release+0xa8/0xf0 [drm]</div> <div class="">[ +0.000020] __fput+0xa1/0x260</div> <div class="">[ +0.000007] task_work_run+0x6d/0xb0</div> <div class="">[ +0.000009] exit_to_user_mode_prepare+0x1d3/0x1e0</div> <div class="">[ +0.000005] syscall_exit_to_user_mode+0x19/0x50</div> <div class="">[ +0.000004] do_syscall_64+0x40/0x80</div> <div class="">[ +0.000005] entry_SYSCALL_64_after_hwframe+0x44/0xae</div> <div class="">[ +0.000004] RIP: 0033:0x7f59f5106511</div> <div class="">[ +0.000003] Code: f7 d8 64 89 02 48 c7 c0 ff ff ff ff c3 66 2e 0f 1f 84 00 00 00 00 00 66 90 8b 05 fa ce 20 00 85 c0 75 16 b8 03 00 00 00 0f 05 <48> 3d 00 f0 ff ff 77 3f f3 c3 0f 1f 44 00 00 53 89 fb 48 83 ec 10</div> <div class="">[ +0.000003] RSP: 002b:00007ffff02c6be8 EFLAGS: 00000246 ORIG_RAX: 0000000000000003</div> <div class="">[ +0.000005] RAX: 0000000000000000 RBX: 000056517da3e6a0 RCX: 00007f59f5106511</div> <div class="">[ +0.000002] RDX: 00007f59f50efca0 RSI: 000056517f676100 RDI: 0000000000000003</div> <div class="">[ +0.000002] RBP: 000056517da3e8a0 R08: 0000000000000000 R09: 0000000000000000</div> <div class="">[ +0.000003] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000</div> <div class="">[ +0.000002] R13: 0000000000000000 R14: 0000000000000000 R15: 000056517da3e8a0</div> <div class="">[ +0.000013] </TASK></div> <div class="">[ +0.000002] irq event stamp: 33801</div> <div class="">[ +0.000002] hardirqs last enabled at (33807): [<ffffffff91107d32>] __up_console_sem+0x52/0x60</div> <div class="">[ +0.000004] hardirqs last disabled at (33812): [<ffffffff91107d17>] __up_console_sem+0x37/0x60</div> <div class="">[ +0.000002] softirqs last enabled at (31702): [<ffffffff9220034b>] __do_softirq+0x34b/0x492</div> <div class="">[ +0.000004] softirqs last disabled at (31697): [<ffffffff91083167>] irq_exit_rcu+0xd7/0xf0</div> <div class="">[ +0.000004] ---[ end trace 90fbe3f286a48d72 ]---</div> <div class="">[ +0.000226] [drm:amdgpu_fill_buffer [amdgpu]] *ERROR* Trying to clear memory with ring turned off.</div> <div class="">[ +0.000205] ------------[ cut here ]------------</div> <div class="">[ +0.000002] WARNING: CPU: 1 PID: 3800 at drivers/gpu/drm/amd/amdgpu/amdgpu_object.c:1313 amdgpu_bo_release_notify+0x164/0x170 [amdgpu]</div> <div class="">[ +0.000117] Modules linked in: amdgpu iommu_v2 gpu_sched nf_conntrack_netlink nfnetlink xt_addrtype br_netfilter xt_CHECKSUM iptable_mangle xt_MASQUERADE iptable_nat nf_nat xt_conntrack nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 ipt_REJECT nf_reject_ipv4 xt_tcpudp ip6table_filter ip6_tables iptable_filter fuse x86_pkg_temp_thermal acpi_pad ip_tables x_tables ast drm_vram_helper drm_ttm_helper ttm drm_kms_helper cfbfillrect syscopyarea cfbimgblt sysfillrect sysimgblt fb_sys_fops cfbcopyarea drm drm_panel_orientation_quirks</div> <div class="">[ +0.000065] CPU: 1 PID: 3800 Comm: amdgpu_test Tainted: G W 5.16.0-kfd+ #1</div> <div class="">[ +0.000004] Hardware name: Supermicro SYS-4029GP-TRT2/X11DPG-OT-CPU, BIOS 2.1 08/14/2018</div> <div class="">[ +0.000002] RIP: 0010:amdgpu_bo_release_notify+0x164/0x170 [amdgpu]</div> <div class="">[ +0.000114] Code: ff ff ff 48 39 c2 74 07 0f 0b e9 57 ff ff ff 48 89 ef e8 cf 14 15 00 e9 4a ff ff ff e8 f5 05 29 d1 eb c4 0f 0b e9 e7 fe ff ff <0f> 0b eb b9 e8 83 d7 7d d1 0f 1f 00 0f 1f 44 00 00 41 54 55 53 48</div> <div class="">[ +0.000003] RSP: 0018:ffffaa4c206dfd18 EFLAGS: 00010282</div> <div class="">[ +0.000004] RAX: 00000000ffffffea RBX: ffff9478d615e858 RCX: 0000000000000001</div> <div class="">[ +0.000003] RDX: 0000000000000000 RSI: 0000000000000000 RDI: 00000000ffffffff</div> <div class="">[ +0.000002] RBP: ffff9478d615e800 R08: 0000000000000000 R09: 0000000000000001</div> <div class="">[ +0.000002] R10: 0000000000000000 R11: ffffaa4c206df9e8 R12: ffff9478d615e858</div> <div class="">[ +0.000002] R13: ffff9478d615e990 R14: ffff9479156c5e08 R15: ffffffff9345ea20</div> <div class="">[ +0.000003] FS: 00007f59f5b50180(0000) GS:ffff9497bfc40000(0000) knlGS:0000000000000000</div> <div class="">[ +0.000003] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033</div> <div class="">[ +0.000002] CR2: 000055881d667000 CR3: 0000000137bee003 CR4: 00000000007706e0</div> <div class="">[ +0.000002] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000</div> <div class="">[ +0.000003] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400</div> <div class="">[ +0.000002] PKRU: 55555554</div> <div class="">[ +0.000002] Call Trace:</div> <div class="">[ +0.000003] <TASK></div> <div class="">[ +0.000005] ttm_bo_release+0x305/0x390 [ttm]</div> <div class="">[ +0.000010] ? __mutex_unlock_slowpath+0x41/0x280</div> <div class="">[ +0.000010] amdgpu_bo_free_kernel+0xd1/0x120 [amdgpu]</div> <div class="">[ +0.000115] amdgpu_vcn_sw_fini+0x7f/0x130 [amdgpu]</div> <div class="">[ +0.000159] vcn_v2_5_sw_fini+0x97/0xc0 [amdgpu]</div> <div class="">[ +0.000157] amdgpu_device_fini_sw+0xbc/0x2e0 [amdgpu]</div> <div class="">[ +0.000108] amdgpu_driver_release_kms+0x12/0x30 [amdgpu]</div> <div class="">[ +0.000105] drm_dev_release+0x20/0x40 [drm]</div> <div class="">[ +0.000026] drm_release+0xa8/0xf0 [drm]</div> <div class="">[ +0.000021] __fput+0xa1/0x260</div> <div class="">[ +0.000008] task_work_run+0x6d/0xb0</div> <div class="">[ +0.000008] exit_to_user_mode_prepare+0x1d3/0x1e0</div> <div class="">[ +0.000005] syscall_exit_to_user_mode+0x19/0x50</div> <div class="">[ +0.000004] do_syscall_64+0x40/0x80</div> <div class="">[ +0.000005] entry_SYSCALL_64_after_hwframe+0x44/0xae</div> <div class="">[ +0.000004] RIP: 0033:0x7f59f5106511</div> <div class="">[ +0.000003] Code: f7 d8 64 89 02 48 c7 c0 ff ff ff ff c3 66 2e 0f 1f 84 00 00 00 00 00 66 90 8b 05 fa ce 20 00 85 c0 75 16 b8 03 00 00 00 0f 05 <48> 3d 00 f0 ff ff 77 3f f3 c3 0f 1f 44 00 00 53 89 fb 48 83 ec 10</div> <div class="">[ +0.000003] RSP: 002b:00007ffff02c6be8 EFLAGS: 00000246 ORIG_RAX: 0000000000000003</div> <div class="">[ +0.000005] RAX: 0000000000000000 RBX: 000056517da3e6a0 RCX: 00007f59f5106511</div> <div class="">[ +0.000002] RDX: 00007f59f50efca0 RSI: 000056517f676100 RDI: 0000000000000003</div> <div class="">[ +0.000002] RBP: 000056517da3e8a0 R08: 0000000000000000 R09: 0000000000000000</div> <div class="">[ +0.000002] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000</div> <div class="">[ +0.000002] R13: 0000000000000000 R14: 0000000000000000 R15: 000056517da3e8a0</div> <div class="">[ +0.000013] </TASK></div> <div class="">[ +0.000002] irq event stamp: 34393</div> <div class="">[ +0.000002] hardirqs last enabled at (34399): [<ffffffff91107d32>] __up_console_sem+0x52/0x60</div> <div class="">[ +0.000004] hardirqs last disabled at (34404): [<ffffffff91107d17>] __up_console_sem+0x37/0x60</div> <div class="">[ +0.000003] softirqs last enabled at (31702): [<ffffffff9220034b>] __do_softirq+0x34b/0x492</div> <div class="">[ +0.000004] softirqs last disabled at (31697): [<ffffffff91083167>] irq_exit_rcu+0xd7/0xf0</div> <div class="">[ +0.000004] ---[ end trace 90fbe3f286a48d73 ]---</div> <div class="">[ +0.000319] [drm:amdgpu_fill_buffer [amdgpu]] *ERROR* Trying to clear memory with ring turned off.</div> <div class="">[ +0.000188] ------------[ cut here ]------------</div> <div class="">[ +0.000002] WARNING: CPU: 1 PID: 3800 at drivers/gpu/drm/amd/amdgpu/amdgpu_object.c:1313 amdgpu_bo_release_notify+0x164/0x170 [amdgpu]</div> <div class="">[ +0.000115] Modules linked in: amdgpu iommu_v2 gpu_sched nf_conntrack_netlink nfnetlink xt_addrtype br_netfilter xt_CHECKSUM iptable_mangle xt_MASQUERADE iptable_nat nf_nat xt_conntrack nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 ipt_REJECT nf_reject_ipv4 xt_tcpudp ip6table_filter ip6_tables iptable_filter fuse x86_pkg_temp_thermal acpi_pad ip_tables x_tables ast drm_vram_helper drm_ttm_helper ttm drm_kms_helper cfbfillrect syscopyarea cfbimgblt sysfillrect sysimgblt fb_sys_fops cfbcopyarea drm drm_panel_orientation_quirks</div> <div class="">[ +0.000063] CPU: 1 PID: 3800 Comm: amdgpu_test Tainted: G W 5.16.0-kfd+ #1</div> <div class="">[ +0.000004] Hardware name: Supermicro SYS-4029GP-TRT2/X11DPG-OT-CPU, BIOS 2.1 08/14/2018</div> <div class="">[ +0.000002] RIP: 0010:amdgpu_bo_release_notify+0x164/0x170 [amdgpu]</div> <div class="">[ +0.000113] Code: ff ff ff 48 39 c2 74 07 0f 0b e9 57 ff ff ff 48 89 ef e8 cf 14 15 00 e9 4a ff ff ff e8 f5 05 29 d1 eb c4 0f 0b e9 e7 fe ff ff <0f> 0b eb b9 e8 83 d7 7d d1 0f 1f 00 0f 1f 44 00 00 41 54 55 53 48</div> <div class="">[ +0.000003] RSP: 0018:ffffaa4c206dfd18 EFLAGS: 00010282</div> <div class="">[ +0.000004] RAX: 00000000ffffffea RBX: ffff9478d615f458 RCX: 0000000000000001</div> <div class="">[ +0.000002] RDX: 0000000000000000 RSI: 0000000000000000 RDI: 00000000ffffffff</div> <div class="">[ +0.000002] RBP: ffff9478d615f400 R08: 0000000000000000 R09: 0000000000000001</div> <div class="">[ +0.000003] R10: 0000000000000000 R11: ffffaa4c206df9e8 R12: ffff9478d615f458</div> <div class="">[ +0.000002] R13: ffff9478d615f590 R14: ffff9479156c5e08 R15: 0000000000000002</div> <div class="">[ +0.000002] FS: 00007f59f5b50180(0000) GS:ffff9497bfc40000(0000) knlGS:0000000000000000</div> <div class="">[ +0.000003] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033</div> <div class="">[ +0.000002] CR2: 000055881d667000 CR3: 0000000137bee003 CR4: 00000000007706e0</div> <div class="">[ +0.000002] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000</div> <div class="">[ +0.000002] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400</div> <div class="">[ +0.000002] PKRU: 55555554</div> <div class="">[ +0.000002] Call Trace:</div> <div class="">[ +0.000002] <TASK></div> <div class="">[ +0.000005] ttm_bo_release+0x305/0x390 [ttm]</div> <div class="">[ +0.000009] ? __mutex_unlock_slowpath+0x41/0x280</div> <div class="">[ +0.000009] amdgpu_bo_free_kernel+0xd1/0x120 [amdgpu]</div> <div class="">[ +0.000115] amdgpu_vcn_sw_fini+0x12b/0x130 [amdgpu]</div> <div class="">[ +0.000158] vcn_v2_5_sw_fini+0x97/0xc0 [amdgpu]</div> <div class="">[ +0.000156] amdgpu_device_fini_sw+0xbc/0x2e0 [amdgpu]</div> <div class="">[ +0.000107] amdgpu_driver_release_kms+0x12/0x30 [amdgpu]</div> <div class="">[ +0.000106] drm_dev_release+0x20/0x40 [drm]</div> <div class="">[ +0.000023] drm_release+0xa8/0xf0 [drm]</div> <div class="">[ +0.000021] __fput+0xa1/0x260</div> <div class="">[ +0.000007] task_work_run+0x6d/0xb0</div> <div class="">[ +0.000008] exit_to_user_mode_prepare+0x1d3/0x1e0</div> <div class="">[ +0.000004] syscall_exit_to_user_mode+0x19/0x50</div> <div class="">[ +0.000004] do_syscall_64+0x40/0x80</div> <div class="">[ +0.000005] entry_SYSCALL_64_after_hwframe+0x44/0xae</div> <div class="">[ +0.000004] RIP: 0033:0x7f59f5106511</div> <div class="">[ +0.000003] Code: f7 d8 64 89 02 48 c7 c0 ff ff ff ff c3 66 2e 0f 1f 84 00 00 00 00 00 66 90 8b 05 fa ce 20 00 85 c0 75 16 b8 03 00 00 00 0f 05 <48> 3d 00 f0 ff ff 77 3f f3 c3 0f 1f 44 00 00 53 89 fb 48 83 ec 10</div> <div class="">[ +0.000003] RSP: 002b:00007ffff02c6be8 EFLAGS: 00000246 ORIG_RAX: 0000000000000003</div> <div class="">[ +0.000004] RAX: 0000000000000000 RBX: 000056517da3e6a0 RCX: 00007f59f5106511</div> <div class="">[ +0.000002] RDX: 00007f59f50efca0 RSI: 000056517f676100 RDI: 0000000000000003</div> <div class="">[ +0.000002] RBP: 000056517da3e8a0 R08: 0000000000000000 R09: 0000000000000000</div> <div class="">[ +0.000002] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000</div> <div class="">[ +0.000002] R13: 0000000000000000 R14: 0000000000000000 R15: 000056517da3e8a0</div> <div class="">[ +0.000013] </TASK></div> <div class="">[ +0.000002] irq event stamp: 34989</div> <div class="">[ +0.000002] hardirqs last enabled at (34995): [<ffffffff91107d32>] __up_console_sem+0x52/0x60</div> <div class="">[ +0.000003] hardirqs last disabled at (35000): [<ffffffff91107d17>] __up_console_sem+0x37/0x60</div> <div class="">[ +0.000003] softirqs last enabled at (31702): [<ffffffff9220034b>] __do_softirq+0x34b/0x492</div> <div class="">[ +0.000004] softirqs last disabled at (31697): [<ffffffff91083167>] irq_exit_rcu+0xd7/0xf0</div> <div class="">[ +0.000003] ---[ end trace 90fbe3f286a48d74 ]---</div> <div class="">[ +0.000299] [drm:amdgpu_fill_buffer [amdgpu]] *ERROR* Trying to clear memory with ring turned off.</div> <div class="">[ +0.000186] ------------[ cut here ]------------</div> <div class="">[ +0.000002] WARNING: CPU: 1 PID: 3800 at drivers/gpu/drm/amd/amdgpu/amdgpu_object.c:1313 amdgpu_bo_release_notify+0x164/0x170 [amdgpu]</div> <div class="">[ +0.000114] Modules linked in: amdgpu iommu_v2 gpu_sched nf_conntrack_netlink nfnetlink xt_addrtype br_netfilter xt_CHECKSUM iptable_mangle xt_MASQUERADE iptable_nat nf_nat xt_conntrack nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 ipt_REJECT nf_reject_ipv4 xt_tcpudp ip6table_filter ip6_tables iptable_filter fuse x86_pkg_temp_thermal acpi_pad ip_tables x_tables ast drm_vram_helper drm_ttm_helper ttm drm_kms_helper cfbfillrect syscopyarea cfbimgblt sysfillrect sysimgblt fb_sys_fops cfbcopyarea drm drm_panel_orientation_quirks</div> <div class="">[ +0.000064] CPU: 1 PID: 3800 Comm: amdgpu_test Tainted: G W 5.16.0-kfd+ #1</div> <div class="">[ +0.000003] Hardware name: Supermicro SYS-4029GP-TRT2/X11DPG-OT-CPU, BIOS 2.1 08/14/2018</div> <div class="">[ +0.000002] RIP: 0010:amdgpu_bo_release_notify+0x164/0x170 [amdgpu]</div> <div class="">[ +0.000111] Code: ff ff ff 48 39 c2 74 07 0f 0b e9 57 ff ff ff 48 89 ef e8 cf 14 15 00 e9 4a ff ff ff e8 f5 05 29 d1 eb c4 0f 0b e9 e7 fe ff ff <0f> 0b eb b9 e8 83 d7 7d d1 0f 1f 00 0f 1f 44 00 00 41 54 55 53 48</div> <div class="">[ +0.000003] RSP: 0018:ffffaa4c206dfd18 EFLAGS: 00010282</div> <div class="">[ +0.000004] RAX: 00000000ffffffea RBX: ffff9478d615f058 RCX: 0000000000000001</div> <div class="">[ +0.000002] RDX: 0000000000000000 RSI: 0000000000000000 RDI: 00000000ffffffff</div> <div class="">[ +0.000002] RBP: ffff9478d615f000 R08: 0000000000000000 R09: 0000000000000001</div> <div class="">[ +0.000003] R10: 0000000000000000 R11: ffffaa4c206df9e8 R12: ffff9478d615f058</div> <div class="">[ +0.000002] R13: ffff9478d615f190 R14: ffff9479156c5e08 R15: 0000000000000002</div> <div class="">[ +0.000002] FS: 00007f59f5b50180(0000) GS:ffff9497bfc40000(0000) knlGS:0000000000000000</div> <div class="">[ +0.000002] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033</div> <div class="">[ +0.000003] CR2: 000055881d667000 CR3: 0000000137bee003 CR4: 00000000007706e0</div> <div class="">[ +0.000002] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000</div> <div class="">[ +0.000002] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400</div> <div class="">[ +0.000002] PKRU: 55555554</div> <div class="">[ +0.000002] Call Trace:</div> <div class="">[ +0.000002] <TASK></div> <div class="">[ +0.000004] ttm_bo_release+0x305/0x390 [ttm]</div> <div class="">[ +0.000008] ? __mutex_unlock_slowpath+0x41/0x280</div> <div class="">[ +0.000010] amdgpu_bo_free_kernel+0xd1/0x120 [amdgpu]</div> <div class="">[ +0.000114] amdgpu_vcn_sw_fini+0x7f/0x130 [amdgpu]</div> <div class="">[ +0.000195] vcn_v2_5_sw_fini+0x97/0xc0 [amdgpu]</div> <div class="">[ +0.000159] amdgpu_device_fini_sw+0xbc/0x2e0 [amdgpu]</div> <div class="">[ +0.000108] amdgpu_driver_release_kms+0x12/0x30 [amdgpu]</div> <div class="">[ +0.000106] drm_dev_release+0x20/0x40 [drm]</div> <div class="">[ +0.000023] drm_release+0xa8/0xf0 [drm]</div> <div class="">[ +0.000021] __fput+0xa1/0x260</div> <div class="">[ +0.000007] task_work_run+0x6d/0xb0</div> <div class="">[ +0.000008] exit_to_user_mode_prepare+0x1d3/0x1e0</div> <div class="">[ +0.000004] syscall_exit_to_user_mode+0x19/0x50</div> <div class="">[ +0.000003] do_syscall_64+0x40/0x80</div> <div class="">[ +0.000005] entry_SYSCALL_64_after_hwframe+0x44/0xae</div> <div class="">[ +0.000004] RIP: 0033:0x7f59f5106511</div> <div class="">[ +0.000003] Code: f7 d8 64 89 02 48 c7 c0 ff ff ff ff c3 66 2e 0f 1f 84 00 00 00 00 00 66 90 8b 05 fa ce 20 00 85 c0 75 16 b8 03 00 00 00 0f 05 <48> 3d 00 f0 ff ff 77 3f f3 c3 0f 1f 44 00 00 53 89 fb 48 83 ec 10</div> <div class="">[ +0.000002] RSP: 002b:00007ffff02c6be8 EFLAGS: 00000246 ORIG_RAX: 0000000000000003</div> <div class="">[ +0.000005] RAX: 0000000000000000 RBX: 000056517da3e6a0 RCX: 00007f59f5106511</div> <div class="">[ +0.000002] RDX: 00007f59f50efca0 RSI: 000056517f676100 RDI: 0000000000000003</div> <div class="">[ +0.000002] RBP: 000056517da3e8a0 R08: 0000000000000000 R09: 0000000000000000</div> <div class="">[ +0.000002] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000</div> <div class="">[ +0.000002] R13: 0000000000000000 R14: 0000000000000000 R15: 000056517da3e8a0</div> <div class="">[ +0.000013] </TASK></div> <div class="">[ +0.000002] irq event stamp: 35591</div> <div class="">[ +0.000002] hardirqs last enabled at (35597): [<ffffffff91107d32>] __up_console_sem+0x52/0x60</div> <div class="">[ +0.000003] hardirqs last disabled at (35602): [<ffffffff91107d17>] __up_console_sem+0x37/0x60</div> <div class="">[ +0.000003] softirqs last enabled at (35460): [<ffffffff9220034b>] __do_softirq+0x34b/0x492</div> <div class="">[ +0.000004] softirqs last disabled at (35449): [<ffffffff91083167>] irq_exit_rcu+0xd7/0xf0</div> <div class="">[ +0.000003] ---[ end trace 90fbe3f286a48d75 ]---</div> <div class="">[ +0.000536] [drm:amdgpu_fill_buffer [amdgpu]] *ERROR* Trying to clear memory with ring turned off.</div> <div class="">[ +0.000189] ------------[ cut here ]------------</div> <div class="">[ +0.000002] WARNING: CPU: 1 PID: 3800 at drivers/gpu/drm/amd/amdgpu/amdgpu_object.c:1313 amdgpu_bo_release_notify+0x164/0x170 [amdgpu]</div> <div class="">[ +0.000115] Modules linked in: amdgpu iommu_v2 gpu_sched nf_conntrack_netlink nfnetlink xt_addrtype br_netfilter xt_CHECKSUM iptable_mangle xt_MASQUERADE iptable_nat nf_nat xt_conntrack nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 ipt_REJECT nf_reject_ipv4 xt_tcpudp ip6table_filter ip6_tables iptable_filter fuse x86_pkg_temp_thermal acpi_pad ip_tables x_tables ast drm_vram_helper drm_ttm_helper ttm drm_kms_helper cfbfillrect syscopyarea cfbimgblt sysfillrect sysimgblt fb_sys_fops cfbcopyarea drm drm_panel_orientation_quirks</div> <div class="">[ +0.000064] CPU: 1 PID: 3800 Comm: amdgpu_test Tainted: G W 5.16.0-kfd+ #1</div> <div class="">[ +0.000003] Hardware name: Supermicro SYS-4029GP-TRT2/X11DPG-OT-CPU, BIOS 2.1 08/14/2018</div> <div class="">[ +0.000002] RIP: 0010:amdgpu_bo_release_notify+0x164/0x170 [amdgpu]</div> <div class="">[ +0.000113] Code: ff ff ff 48 39 c2 74 07 0f 0b e9 57 ff ff ff 48 89 ef e8 cf 14 15 00 e9 4a ff ff ff e8 f5 05 29 d1 eb c4 0f 0b e9 e7 fe ff ff <0f> 0b eb b9 e8 83 d7 7d d1 0f 1f 00 0f 1f 44 00 00 41 54 55 53 48</div> <div class="">[ +0.000003] RSP: 0018:ffffaa4c206dfd58 EFLAGS: 00010282</div> <div class="">[ +0.000004] RAX: 00000000ffffffea RBX: ffff9478d5ce7c58 RCX: 0000000000000001</div> <div class="">[ +0.000002] RDX: 0000000000000000 RSI: 0000000000000000 RDI: 00000000ffffffff</div> <div class="">[ +0.000002] RBP: ffff9478d5ce7c00 R08: 0000000000000000 R09: 0000000000000001</div> <div class="">[ +0.000003] R10: 0000000000000000 R11: ffffaa4c206dfa28 R12: ffff9478d5ce7c58</div> <div class="">[ +0.000002] R13: ffff9478d5ce7d90 R14: ffff9479156c5e08 R15: ffffffff9345ea20</div> <div class="">[ +0.000002] FS: 00007f59f5b50180(0000) GS:ffff9497bfc40000(0000) knlGS:0000000000000000</div> <div class="">[ +0.000002] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033</div> <div class="">[ +0.000003] CR2: 000055881d667000 CR3: 0000000137bee003 CR4: 00000000007706e0</div> <div class="">[ +0.000002] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000</div> <div class="">[ +0.000002] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400</div> <div class="">[ +0.000002] PKRU: 55555554</div> <div class="">[ +0.000002] Call Trace:</div> <div class="">[ +0.000002] <TASK></div> <div class="">[ +0.000005] ttm_bo_release+0x305/0x390 [ttm]</div> <div class="">[ +0.000008] ? __mutex_unlock_slowpath+0x41/0x280</div> <div class="">[ +0.000010] amdgpu_bo_free_kernel+0xd1/0x120 [amdgpu]</div> <div class="">[ +0.000115] gfx_v9_0_sw_fini+0x6e/0x170 [amdgpu]</div> <div class="">[ +0.000150] amdgpu_device_fini_sw+0xbc/0x2e0 [amdgpu]</div> <div class="">[ +0.000107] amdgpu_driver_release_kms+0x12/0x30 [amdgpu]</div> <div class="">[ +0.000106] drm_dev_release+0x20/0x40 [drm]</div> <div class="">[ +0.000023] drm_release+0xa8/0xf0 [drm]</div> <div class="">[ +0.000020] __fput+0xa1/0x260</div> <div class="">[ +0.000007] task_work_run+0x6d/0xb0</div> <div class="">[ +0.000008] exit_to_user_mode_prepare+0x1d3/0x1e0</div> <div class="">[ +0.000004] syscall_exit_to_user_mode+0x19/0x50</div> <div class="">[ +0.000004] do_syscall_64+0x40/0x80</div> <div class="">[ +0.000005] entry_SYSCALL_64_after_hwframe+0x44/0xae</div> <div class="">[ +0.000003] RIP: 0033:0x7f59f5106511</div> <div class="">[ +0.000003] Code: f7 d8 64 89 02 48 c7 c0 ff ff ff ff c3 66 2e 0f 1f 84 00 00 00 00 00 66 90 8b 05 fa ce 20 00 85 c0 75 16 b8 03 00 00 00 0f 05 <48> 3d 00 f0 ff ff 77 3f f3 c3 0f 1f 44 00 00 53 89 fb 48 83 ec 10</div> <div class="">[ +0.000003] RSP: 002b:00007ffff02c6be8 EFLAGS: 00000246 ORIG_RAX: 0000000000000003</div> <div class="">[ +0.000004] RAX: 0000000000000000 RBX: 000056517da3e6a0 RCX: 00007f59f5106511</div> <div class="">[ +0.000002] RDX: 00007f59f50efca0 RSI: 000056517f676100 RDI: 0000000000000003</div> <div class="">[ +0.000003] RBP: 000056517da3e8a0 R08: 0000000000000000 R09: 0000000000000000</div> <div class="">[ +0.000002] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000</div> <div class="">[ +0.000002] R13: 0000000000000000 R14: 0000000000000000 R15: 000056517da3e8a0</div> <div class="">[ +0.000013] </TASK></div> <div class="">[ +0.000002] irq event stamp: 36503</div> <div class="">[ +0.000002] hardirqs last enabled at (36509): [<ffffffff91107d32>] __up_console_sem+0x52/0x60</div> <div class="">[ +0.000003] hardirqs last disabled at (36514): [<ffffffff91107d17>] __up_console_sem+0x37/0x60</div> <div class="">[ +0.000003] softirqs last enabled at (35460): [<ffffffff9220034b>] __do_softirq+0x34b/0x492</div> <div class="">[ +0.000004] softirqs last disabled at (35449): [<ffffffff91083167>] irq_exit_rcu+0xd7/0xf0</div> <div class="">[ +0.000003] ---[ end trace 90fbe3f286a48d76 ]---</div> <div class="">[ +0.000335] [drm:amdgpu_fill_buffer [amdgpu]] *ERROR* Trying to clear memory with ring turned off.</div> <div class="">[ +0.000188] ------------[ cut here ]------------</div> <div class="">[ +0.000002] WARNING: CPU: 1 PID: 3800 at drivers/gpu/drm/amd/amdgpu/amdgpu_object.c:1313 amdgpu_bo_release_notify+0x164/0x170 [amdgpu]</div> <div class="">[ +0.000115] Modules linked in: amdgpu iommu_v2 gpu_sched nf_conntrack_netlink nfnetlink xt_addrtype br_netfilter xt_CHECKSUM iptable_mangle xt_MASQUERADE iptable_nat nf_nat xt_conntrack nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 ipt_REJECT nf_reject_ipv4 xt_tcpudp ip6table_filter ip6_tables iptable_filter fuse x86_pkg_temp_thermal acpi_pad ip_tables x_tables ast drm_vram_helper drm_ttm_helper ttm drm_kms_helper cfbfillrect syscopyarea cfbimgblt sysfillrect sysimgblt fb_sys_fops cfbcopyarea drm drm_panel_orientation_quirks</div> <div class="">[ +0.000062] CPU: 1 PID: 3800 Comm: amdgpu_test Tainted: G W 5.16.0-kfd+ #1</div> <div class="">[ +0.000004] Hardware name: Supermicro SYS-4029GP-TRT2/X11DPG-OT-CPU, BIOS 2.1 08/14/2018</div> <div class="">[ +0.000002] RIP: 0010:amdgpu_bo_release_notify+0x164/0x170 [amdgpu]</div> <div class="">[ +0.000112] Code: ff ff ff 48 39 c2 74 07 0f 0b e9 57 ff ff ff 48 89 ef e8 cf 14 15 00 e9 4a ff ff ff e8 f5 05 29 d1 eb c4 0f 0b e9 e7 fe ff ff <0f> 0b eb b9 e8 83 d7 7d d1 0f 1f 00 0f 1f 44 00 00 41 54 55 53 48</div> <div class="">[ +0.000003] RSP: 0018:ffffaa4c206dfd48 EFLAGS: 00010282</div> <div class="">[ +0.000004] RAX: 00000000ffffffea RBX: ffff9478d5ce4c58 RCX: 0000000000000001</div> <div class="">[ +0.000002] RDX: 0000000000000000 RSI: 0000000000000000 RDI: 00000000ffffffff</div> <div class="">[ +0.000003] RBP: ffff9478d5ce4c00 R08: 0000000000000000 R09: 0000000000000001</div> <div class="">[ +0.000002] R10: 0000000000000000 R11: ffffaa4c206dfa18 R12: ffff9478d5ce4c58</div> <div class="">[ +0.000002] R13: ffff9478d5ce4d90 R14: ffff9479156c5e08 R15: ffffffff9345ea20</div> <div class="">[ +0.000002] FS: 00007f59f5b50180(0000) GS:ffff9497bfc40000(0000) knlGS:0000000000000000</div> <div class="">[ +0.000003] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033</div> <div class="">[ +0.000002] CR2: 000055881d667000 CR3: 0000000137bee003 CR4: 00000000007706e0</div> <div class="">[ +0.000002] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000</div> <div class="">[ +0.000002] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400</div> <div class="">[ +0.000002] PKRU: 55555554</div> <div class="">[ +0.000002] Call Trace:</div> <div class="">[ +0.000002] <TASK></div> <div class="">[ +0.000004] ttm_bo_release+0x305/0x390 [ttm]</div> <div class="">[ +0.000009] ? __mutex_unlock_slowpath+0x41/0x280</div> <div class="">[ +0.000009] amdgpu_bo_free_kernel+0xd1/0x120 [amdgpu]</div> <div class="">[ +0.000115] gfx_v9_0_mec_fini+0x19/0x30 [amdgpu]</div> <div class="">[ +0.000149] gfx_v9_0_sw_fini+0x8a/0x170 [amdgpu]</div> <div class="">[ +0.000148] amdgpu_device_fini_sw+0xbc/0x2e0 [amdgpu]</div> <div class="">[ +0.000108] amdgpu_driver_release_kms+0x12/0x30 [amdgpu]</div> <div class="">[ +0.000106] drm_dev_release+0x20/0x40 [drm]</div> <div class="">[ +0.000023] drm_release+0xa8/0xf0 [drm]</div> <div class="">[ +0.000021] __fput+0xa1/0x260</div> <div class="">[ +0.000007] task_work_run+0x6d/0xb0</div> <div class="">[ +0.000007] exit_to_user_mode_prepare+0x1d3/0x1e0</div> <div class="">[ +0.000004] syscall_exit_to_user_mode+0x19/0x50</div> <div class="">[ +0.000004] do_syscall_64+0x40/0x80</div> <div class="">[ +0.000005] entry_SYSCALL_64_after_hwframe+0x44/0xae</div> <div class="">[ +0.000004] RIP: 0033:0x7f59f5106511</div> <div class="">[ +0.000002] Code: f7 d8 64 89 02 48 c7 c0 ff ff ff ff c3 66 2e 0f 1f 84 00 00 00 00 00 66 90 8b 05 fa ce 20 00 85 c0 75 16 b8 03 00 00 00 0f 05 <48> 3d 00 f0 ff ff 77 3f f3 c3 0f 1f 44 00 00 53 89 fb 48 83 ec 10</div> <div class="">[ +0.000003] RSP: 002b:00007ffff02c6be8 EFLAGS: 00000246 ORIG_RAX: 0000000000000003</div> <div class="">[ +0.000004] RAX: 0000000000000000 RBX: 000056517da3e6a0 RCX: 00007f59f5106511</div> <div class="">[ +0.000002] RDX: 00007f59f50efca0 RSI: 000056517f676100 RDI: 0000000000000003</div> <div class="">[ +0.000002] RBP: 000056517da3e8a0 R08: 0000000000000000 R09: 0000000000000000</div> <div class="">[ +0.000002] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000</div> <div class="">[ +0.000002] R13: 0000000000000000 R14: 0000000000000000 R15: 000056517da3e8a0</div> <div class="">[ +0.000014] </TASK></div> <div class="">[ +0.000002] irq event stamp: 37097</div> <div class="">[ +0.000001] hardirqs last enabled at (37103): [<ffffffff91107d32>] __up_console_sem+0x52/0x60</div> <div class="">[ +0.000004] hardirqs last disabled at (37108): [<ffffffff91107d17>] __up_console_sem+0x37/0x60</div> <div class="">[ +0.000003] softirqs last enabled at (35460): [<ffffffff9220034b>] __do_softirq+0x34b/0x492</div> <div class="">[ +0.000004] softirqs last disabled at (35449): [<ffffffff91083167>] irq_exit_rcu+0xd7/0xf0</div> <div class="">[ +0.000003] ---[ end trace 90fbe3f286a48d77 ]---</div> <div class="">[ +0.000314] [drm:amdgpu_fill_buffer [amdgpu]] *ERROR* Trying to clear memory with ring turned off.</div> <div class="">[ +0.000187] ------------[ cut here ]------------</div> <div class="">[ +0.000002] WARNING: CPU: 1 PID: 3800 at drivers/gpu/drm/amd/amdgpu/amdgpu_object.c:1313 amdgpu_bo_release_notify+0x164/0x170 [amdgpu]</div> <div class="">[ +0.000115] Modules linked in: amdgpu iommu_v2 gpu_sched nf_conntrack_netlink nfnetlink xt_addrtype br_netfilter xt_CHECKSUM iptable_mangle xt_MASQUERADE iptable_nat nf_nat xt_conntrack nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 ipt_REJECT nf_reject_ipv4 xt_tcpudp ip6table_filter ip6_tables iptable_filter fuse x86_pkg_temp_thermal acpi_pad ip_tables x_tables ast drm_vram_helper drm_ttm_helper ttm drm_kms_helper cfbfillrect syscopyarea cfbimgblt sysfillrect sysimgblt fb_sys_fops cfbcopyarea drm drm_panel_orientation_quirks</div> <div class="">[ +0.000063] CPU: 1 PID: 3800 Comm: amdgpu_test Tainted: G W 5.16.0-kfd+ #1</div> <div class="">[ +0.000003] Hardware name: Supermicro SYS-4029GP-TRT2/X11DPG-OT-CPU, BIOS 2.1 08/14/2018</div> <div class="">[ +0.000002] RIP: 0010:amdgpu_bo_release_notify+0x164/0x170 [amdgpu]</div> <div class="">[ +0.000112] Code: ff ff ff 48 39 c2 74 07 0f 0b e9 57 ff ff ff 48 89 ef e8 cf 14 15 00 e9 4a ff ff ff e8 f5 05 29 d1 eb c4 0f 0b e9 e7 fe ff ff <0f> 0b eb b9 e8 83 d7 7d d1 0f 1f 00 0f 1f 44 00 00 41 54 55 53 48</div> <div class="">[ +0.000003] RSP: 0018:ffffaa4c206dfd58 EFLAGS: 00010282</div> <div class="">[ +0.000004] RAX: 00000000ffffffea RBX: ffff9478d5ce4858 RCX: 0000000000000001</div> <div class="">[ +0.000003] RDX: 0000000000000000 RSI: 0000000000000000 RDI: 00000000ffffffff</div> <div class="">[ +0.000002] RBP: ffff9478d5ce4800 R08: 0000000000000000 R09: 0000000000000001</div> <div class="">[ +0.000002] R10: 0000000000000000 R11: ffffaa4c206dfa28 R12: ffff9478d5ce4858</div> <div class="">[ +0.000002] R13: ffff9478d5ce4990 R14: ffff9479156c5e08 R15: ffffffff9345ea20</div> <div class="">[ +0.000002] FS: 00007f59f5b50180(0000) GS:ffff9497bfc40000(0000) knlGS:0000000000000000</div> <div class="">[ +0.000003] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033</div> <div class="">[ +0.000003] CR2: 000055881d667000 CR3: 0000000137bee003 CR4: 00000000007706e0</div> <div class="">[ +0.000002] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000</div> <div class="">[ +0.000002] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400</div> <div class="">[ +0.000002] PKRU: 55555554</div> <div class="">[ +0.000002] Call Trace:</div> <div class="">[ +0.000002] <TASK></div> <div class="">[ +0.000004] ttm_bo_release+0x305/0x390 [ttm]</div> <div class="">[ +0.000009] ? __mutex_unlock_slowpath+0x41/0x280</div> <div class="">[ +0.000009] amdgpu_bo_free_kernel+0xd1/0x120 [amdgpu]</div> <div class="">[ +0.000115] gfx_v9_0_sw_fini+0xa4/0x170 [amdgpu]</div> <div class="">[ +0.000150] amdgpu_device_fini_sw+0xbc/0x2e0 [amdgpu]</div> <div class="">[ +0.000108] amdgpu_driver_release_kms+0x12/0x30 [amdgpu]</div> <div class="">[ +0.000105] drm_dev_release+0x20/0x40 [drm]</div> <div class="">[ +0.000023] drm_release+0xa8/0xf0 [drm]</div> <div class="">[ +0.000021] __fput+0xa1/0x260</div> <div class="">[ +0.000008] task_work_run+0x6d/0xb0</div> <div class="">[ +0.000007] exit_to_user_mode_prepare+0x1d3/0x1e0</div> <div class="">[ +0.000005] syscall_exit_to_user_mode+0x19/0x50</div> <div class="">[ +0.000003] do_syscall_64+0x40/0x80</div> <div class="">[ +0.000005] entry_SYSCALL_64_after_hwframe+0x44/0xae</div> <div class="">[ +0.000004] RIP: 0033:0x7f59f5106511</div> <div class="">[ +0.000002] Code: f7 d8 64 89 02 48 c7 c0 ff ff ff ff c3 66 2e 0f 1f 84 00 00 00 00 00 66 90 8b 05 fa ce 20 00 85 c0 75 16 b8 03 00 00 00 0f 05 <48> 3d 00 f0 ff ff 77 3f f3 c3 0f 1f 44 00 00 53 89 fb 48 83 ec 10</div> <div class="">[ +0.000003] RSP: 002b:00007ffff02c6be8 EFLAGS: 00000246 ORIG_RAX: 0000000000000003</div> <div class="">[ +0.000005] RAX: 0000000000000000 RBX: 000056517da3e6a0 RCX: 00007f59f5106511</div> <div class="">[ +0.000002] RDX: 00007f59f50efca0 RSI: 000056517f676100 RDI: 0000000000000003</div> <div class="">[ +0.000002] RBP: 000056517da3e8a0 R08: 0000000000000000 R09: 0000000000000000</div> <div class="">[ +0.000002] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000</div> <div class="">[ +0.000002] R13: 0000000000000000 R14: 0000000000000000 R15: 000056517da3e8a0</div> <div class="">[ +0.000014] </TASK></div> <div class="">[ +0.000001] irq event stamp: 37679</div> <div class="">[ +0.000002] hardirqs last enabled at (37685): [<ffffffff91107d32>] __up_console_sem+0x52/0x60</div> <div class="">[ +0.000004] hardirqs last disabled at (37690): [<ffffffff91107d17>] __up_console_sem+0x37/0x60</div> <div class="">[ +0.000002] softirqs last enabled at (35460): [<ffffffff9220034b>] __do_softirq+0x34b/0x492</div> <div class="">[ +0.000004] softirqs last disabled at (35449): [<ffffffff91083167>] irq_exit_rcu+0xd7/0xf0</div> <div class="">[ +0.000004] ---[ end trace 90fbe3f286a48d78 ]---</div> <div class="">[ +0.000409] ------------[ cut here ]------------</div> <div class="">[ +0.000003] sysfs group 'power' not found for kobject 'i2c-2'</div> <div class="">[ +0.000007] WARNING: CPU: 1 PID: 3800 at fs/sysfs/group.c:280 sysfs_remove_group+0x76/0x80</div> <div class="">[ +0.000005] Modules linked in: amdgpu iommu_v2 gpu_sched nf_conntrack_netlink nfnetlink xt_addrtype br_netfilter xt_CHECKSUM iptable_mangle xt_MASQUERADE iptable_nat nf_nat xt_conntrack nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 ipt_REJECT nf_reject_ipv4 xt_tcpudp ip6table_filter ip6_tables iptable_filter fuse x86_pkg_temp_thermal acpi_pad ip_tables x_tables ast drm_vram_helper drm_ttm_helper ttm drm_kms_helper cfbfillrect syscopyarea cfbimgblt sysfillrect sysimgblt fb_sys_fops cfbcopyarea drm drm_panel_orientation_quirks</div> <div class="">[ +0.000057] CPU: 1 PID: 3800 Comm: amdgpu_test Tainted: G W 5.16.0-kfd+ #1</div> <div class="">[ +0.000003] Hardware name: Supermicro SYS-4029GP-TRT2/X11DPG-OT-CPU, BIOS 2.1 08/14/2018</div> <div class="">[ +0.000002] RIP: 0010:sysfs_remove_group+0x76/0x80</div> <div class="">[ +0.000003] Code: 48 89 df 5b 5d 41 5c e9 d8 b3 ff ff 48 89 df e8 60 ae ff ff eb cb 49 8b 14 24 48 8b 75 00 48 c7 c7 a8 8f 82 92 e8 7a 28 c8 ff <0f> 0b 5b 5d 41 5c c3 0f 1f 00 0f 1f 44 00 00 48 85 f6 74 31 41 54</div> <div class="">[ +0.000003] RSP: 0018:ffffaa4c206dfd28 EFLAGS: 00010286</div> <div class="">[ +0.000004] RAX: 0000000000000000 RBX: 0000000000000000 RCX: 0000000000000001</div> <div class="">[ +0.000002] RDX: 0000000080000001 RSI: ffffffff92800179 RDI: 00000000ffffffff</div> <div class="">[ +0.000002] RBP: ffffffff924c7f60 R08: 0000000000000000 R09: 0000000000000001</div> <div class="">[ +0.000002] R10: 0000000000000000 R11: ffffaa4c206dfb30 R12: ffff9479156c9e48</div> <div class="">[ +0.000002] R13: ffff9479156c9e48 R14: ffff9478f8fcfe28 R15: ffff9479156c9f48</div> <div class="">[ +0.000002] FS: 00007f59f5b50180(0000) GS:ffff9497bfc40000(0000) knlGS:0000000000000000</div> <div class="">[ +0.000003] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033</div> <div class="">[ +0.000002] CR2: 000055881d667000 CR3: 0000000137bee003 CR4: 00000000007706e0</div> <div class="">[ +0.000002] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000</div> <div class="">[ +0.000002] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400</div> <div class="">[ +0.000002] PKRU: 55555554</div> <div class="">[ +0.000001] Call Trace:</div> <div class="">[ +0.000002] <TASK></div> <div class="">[ +0.000003] device_del+0xc2/0x420</div> <div class="">[ +0.000005] ? __raw_spin_lock_init+0x3b/0x60</div> <div class="">[ +0.000003] ? lockdep_init_map_type+0x58/0x240</div> <div class="">[ +0.000010] device_unregister+0x13/0x60</div> <div class="">[ +0.000004] i2c_del_adapter+0x264/0x330</div> <div class="">[ +0.000007] ? lockdep_hardirqs_on+0x79/0x100</div> <div class="">[ +0.000008] arcturus_i2c_control_fini+0x15/0x40 [amdgpu]</div> <div class="">[ +0.000184] smu_sw_fini+0x31/0x210 [amdgpu]</div> <div class="">[ +0.000188] amdgpu_device_fini_sw+0xbc/0x2e0 [amdgpu]</div> <div class="">[ +0.000107] amdgpu_driver_release_kms+0x12/0x30 [amdgpu]</div> <div class="">[ +0.000105] drm_dev_release+0x20/0x40 [drm]</div> <div class="">[ +0.000023] drm_release+0xa8/0xf0 [drm]</div> <div class="">[ +0.000021] __fput+0xa1/0x260</div> <div class="">[ +0.000007] task_work_run+0x6d/0xb0</div> <div class="">[ +0.000008] exit_to_user_mode_prepare+0x1d3/0x1e0</div> <div class="">[ +0.000003] syscall_exit_to_user_mode+0x19/0x50</div> <div class="">[ +0.000004] do_syscall_64+0x40/0x80</div> <div class="">[ +0.000005] entry_SYSCALL_64_after_hwframe+0x44/0xae</div> <div class="">[ +0.000003] RIP: 0033:0x7f59f5106511</div> <div class="">[ +0.000003] Code: f7 d8 64 89 02 48 c7 c0 ff ff ff ff c3 66 2e 0f 1f 84 00 00 00 00 00 66 90 8b 05 fa ce 20 00 85 c0 75 16 b8 03 00 00 00 0f 05 <48> 3d 00 f0 ff ff 77 3f f3 c3 0f 1f 44 00 00 53 89 fb 48 83 ec 10</div> <div class="">[ +0.000002] RSP: 002b:00007ffff02c6be8 EFLAGS: 00000246 ORIG_RAX: 0000000000000003</div> <div class="">[ +0.000004] RAX: 0000000000000000 RBX: 000056517da3e6a0 RCX: 00007f59f5106511</div> <div class="">[ +0.000002] RDX: 00007f59f50efca0 RSI: 000056517f676100 RDI: 0000000000000003</div> <div class="">[ +0.000002] RBP: 000056517da3e8a0 R08: 0000000000000000 R09: 0000000000000000</div> <div class="">[ +0.000002] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000</div> <div class="">[ +0.000002] R13: 0000000000000000 R14: 0000000000000000 R15: 000056517da3e8a0</div> <div class="">[ +0.000013] </TASK></div> <div class="">[ +0.000002] irq event stamp: 38451</div> <div class="">[ +0.000002] hardirqs last enabled at (38457): [<ffffffff91107d32>] __up_console_sem+0x52/0x60</div> <div class="">[ +0.000003] hardirqs last disabled at (38462): [<ffffffff91107d17>] __up_console_sem+0x37/0x60</div> <div class="">[ +0.000002] softirqs last enabled at (35460): [<ffffffff9220034b>] __do_softirq+0x34b/0x492</div> <div class="">[ +0.000004] softirqs last disabled at (35449): [<ffffffff91083167>] irq_exit_rcu+0xd7/0xf0</div> <div class="">[ +0.000003] ---[ end trace 90fbe3f286a48d79 ]---</div> <div class="">[ +0.000223] ------------[ cut here ]------------</div> <div class="">[ +0.000002] sysfs group 'power' not found for kobject 'i2c-3'</div> <div class="">[ +0.000006] WARNING: CPU: 1 PID: 3800 at fs/sysfs/group.c:280 sysfs_remove_group+0x76/0x80</div> <div class="">[ +0.000005] Modules linked in: amdgpu iommu_v2 gpu_sched nf_conntrack_netlink nfnetlink xt_addrtype br_netfilter xt_CHECKSUM iptable_mangle xt_MASQUERADE iptable_nat nf_nat xt_conntrack nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 ipt_REJECT nf_reject_ipv4 xt_tcpudp ip6table_filter ip6_tables iptable_filter fuse x86_pkg_temp_thermal acpi_pad ip_tables x_tables ast drm_vram_helper drm_ttm_helper ttm drm_kms_helper cfbfillrect syscopyarea cfbimgblt sysfillrect sysimgblt fb_sys_fops cfbcopyarea drm drm_panel_orientation_quirks</div> <div class="">[ +0.000058] CPU: 1 PID: 3800 Comm: amdgpu_test Tainted: G W 5.16.0-kfd+ #1</div> <div class="">[ +0.000003] Hardware name: Supermicro SYS-4029GP-TRT2/X11DPG-OT-CPU, BIOS 2.1 08/14/2018</div> <div class="">[ +0.000003] RIP: 0010:sysfs_remove_group+0x76/0x80</div> <div class="">[ +0.000003] Code: 48 89 df 5b 5d 41 5c e9 d8 b3 ff ff 48 89 df e8 60 ae ff ff eb cb 49 8b 14 24 48 8b 75 00 48 c7 c7 a8 8f 82 92 e8 7a 28 c8 ff <0f> 0b 5b 5d 41 5c c3 0f 1f 00 0f 1f 44 00 00 48 85 f6 74 31 41 54</div> <div class="">[ +0.000003] RSP: 0018:ffffaa4c206dfd28 EFLAGS: 00010286</div> <div class="">[ +0.000004] RAX: 0000000000000000 RBX: 0000000000000000 RCX: 0000000000000001</div> <div class="">[ +0.000002] RDX: 0000000080000001 RSI: ffffffff92800179 RDI: 00000000ffffffff</div> <div class="">[ +0.000003] RBP: ffffffff924c7f60 R08: 0000000000000000 R09: 0000000000000001</div> <div class="">[ +0.000001] R10: 0000000000000000 R11: ffffaa4c206dfb30 R12: ffff9479156ca6a0</div> <div class="">[ +0.000002] R13: ffff9479156ca6a0 R14: ffff9478f8fcfe28 R15: ffff9479156ca7a0</div> <div class="">[ +0.000002] FS: 00007f59f5b50180(0000) GS:ffff9497bfc40000(0000) knlGS:0000000000000000</div> <div class="">[ +0.000003] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033</div> <div class="">[ +0.000002] CR2: 000055881d667000 CR3: 0000000137bee003 CR4: 00000000007706e0</div> <div class="">[ +0.000002] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000</div> <div class="">[ +0.000002] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400</div> <div class="">[ +0.000002] PKRU: 55555554</div> <div class="">[ +0.000002] Call Trace:</div> <div class="">[ +0.000001] <TASK></div> <div class="">[ +0.000004] device_del+0xc2/0x420</div> <div class="">[ +0.000003] ? __raw_spin_lock_init+0x3b/0x60</div> <div class="">[ +0.000004] ? lockdep_init_map_type+0x58/0x240</div> <div class="">[ +0.000010] device_unregister+0x13/0x60</div> <div class="">[ +0.000004] i2c_del_adapter+0x264/0x330</div> <div class="">[ +0.000007] ? lockdep_hardirqs_on+0x79/0x100</div> <div class="">[ +0.000008] arcturus_i2c_control_fini+0x21/0x40 [amdgpu]</div> <div class="">[ +0.000184] smu_sw_fini+0x31/0x210 [amdgpu]</div> <div class="">[ +0.000189] amdgpu_device_fini_sw+0xbc/0x2e0 [amdgpu]</div> <div class="">[ +0.000107] amdgpu_driver_release_kms+0x12/0x30 [amdgpu]</div> <div class="">[ +0.000105] drm_dev_release+0x20/0x40 [drm]</div> <div class="">[ +0.000023] drm_release+0xa8/0xf0 [drm]</div> <div class="">[ +0.000020] __fput+0xa1/0x260</div> <div class="">[ +0.000007] task_work_run+0x6d/0xb0</div> <div class="">[ +0.000007] exit_to_user_mode_prepare+0x1d3/0x1e0</div> <div class="">[ +0.000004] syscall_exit_to_user_mode+0x19/0x50</div> <div class="">[ +0.000003] do_syscall_64+0x40/0x80</div> <div class="">[ +0.000005] entry_SYSCALL_64_after_hwframe+0x44/0xae</div> <div class="">[ +0.000004] RIP: 0033:0x7f59f5106511</div> <div class="">[ +0.000002] Code: f7 d8 64 89 02 48 c7 c0 ff ff ff ff c3 66 2e 0f 1f 84 00 00 00 00 00 66 90 8b 05 fa ce 20 00 85 c0 75 16 b8 03 00 00 00 0f 05 <48> 3d 00 f0 ff ff 77 3f f3 c3 0f 1f 44 00 00 53 89 fb 48 83 ec 10</div> <div class="">[ +0.000003] RSP: 002b:00007ffff02c6be8 EFLAGS: 00000246 ORIG_RAX: 0000000000000003</div> <div class="">[ +0.000004] RAX: 0000000000000000 RBX: 000056517da3e6a0 RCX: 00007f59f5106511</div> <div class="">[ +0.000002] RDX: 00007f59f50efca0 RSI: 000056517f676100 RDI: 0000000000000003</div> <div class="">[ +0.000002] RBP: 000056517da3e8a0 R08: 0000000000000000 R09: 0000000000000000</div> <div class="">[ +0.000001] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000</div> <div class="">[ +0.000003] R13: 0000000000000000 R14: 0000000000000000 R15: 000056517da3e8a0</div> <div class="">[ +0.000012] </TASK></div> <div class="">[ +0.000001] irq event stamp: 39087</div> <div class="">[ +0.000002] hardirqs last enabled at (39093): [<ffffffff91107d32>] __up_console_sem+0x52/0x60</div> <div class="">[ +0.000003] hardirqs last disabled at (39098): [<ffffffff91107d17>] __up_console_sem+0x37/0x60</div> <div class="">[ +0.000003] softirqs last enabled at (35460): [<ffffffff9220034b>] __do_softirq+0x34b/0x492</div> <div class="">[ +0.000004] softirqs last disabled at (35449): [<ffffffff91083167>] irq_exit_rcu+0xd7/0xf0</div> <div class="">[ +0.000003] ---[ end trace 90fbe3f286a48d7a ]---</div> <div class="">[ +0.000046] [drm:amdgpu_fill_buffer [amdgpu]] *ERROR* Trying to clear memory with ring turned off.</div> <div class="">[ +0.000190] ------------[ cut here ]------------</div> <div class="">[ +0.000002] WARNING: CPU: 1 PID: 3800 at drivers/gpu/drm/amd/amdgpu/amdgpu_object.c:1313 amdgpu_bo_release_notify+0x164/0x170 [amdgpu]</div> <div class="">[ +0.000163] Modules linked in: amdgpu iommu_v2 gpu_sched nf_conntrack_netlink nfnetlink xt_addrtype br_netfilter xt_CHECKSUM iptable_mangle xt_MASQUERADE iptable_nat nf_nat xt_conntrack nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 ipt_REJECT nf_reject_ipv4 xt_tcpudp ip6table_filter ip6_tables iptable_filter fuse x86_pkg_temp_thermal acpi_pad ip_tables x_tables ast drm_vram_helper drm_ttm_helper ttm drm_kms_helper cfbfillrect syscopyarea cfbimgblt sysfillrect sysimgblt fb_sys_fops cfbcopyarea drm drm_panel_orientation_quirks</div> <div class="">[ +0.000067] CPU: 1 PID: 3800 Comm: amdgpu_test Tainted: G W 5.16.0-kfd+ #1</div> <div class="">[ +0.000004] Hardware name: Supermicro SYS-4029GP-TRT2/X11DPG-OT-CPU, BIOS 2.1 08/14/2018</div> <div class="">[ +0.000002] RIP: 0010:amdgpu_bo_release_notify+0x164/0x170 [amdgpu]</div> <div class="">[ +0.000114] Code: ff ff ff 48 39 c2 74 07 0f 0b e9 57 ff ff ff 48 89 ef e8 cf 14 15 00 e9 4a ff ff ff e8 f5 05 29 d1 eb c4 0f 0b e9 e7 fe ff ff <0f> 0b eb b9 e8 83 d7 7d d1 0f 1f 00 0f 1f 44 00 00 41 54 55 53 48</div> <div class="">[ +0.000003] RSP: 0018:ffffaa4c206dfd48 EFLAGS: 00010282</div> <div class="">[ +0.000004] RAX: 00000000ffffffea RBX: ffff9478d5ce3858 RCX: 0000000000000001</div> <div class="">[ +0.000002] RDX: 0000000000000000 RSI: 0000000000000000 RDI: 00000000ffffffff</div> <div class="">[ +0.000002] RBP: ffff9478d5ce3800 R08: 0000000000000000 R09: 0000000000000001</div> <div class="">[ +0.000002] R10: 0000000000000000 R11: ffffaa4c206dfa18 R12: ffff9478d5ce3858</div> <div class="">[ +0.000003] R13: ffff9478d5ce3990 R14: ffff9479156c5e08 R15: ffffffff9345ea20</div> <div class="">[ +0.000002] FS: 00007f59f5b50180(0000) GS:ffff9497bfc40000(0000) knlGS:0000000000000000</div> <div class="">[ +0.000003] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033</div> <div class="">[ +0.000002] CR2: 000055881d667000 CR3: 0000000137bee003 CR4: 00000000007706e0</div> <div class="">[ +0.000002] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000</div> <div class="">[ +0.000002] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400</div> <div class="">[ +0.000002] PKRU: 55555554</div> <div class="">[ +0.000002] Call Trace:</div> <div class="">[ +0.000002] <TASK></div> <div class="">[ +0.000005] ttm_bo_release+0x305/0x390 [ttm]</div> <div class="">[ +0.000009] ? __mutex_unlock_slowpath+0x41/0x280</div> <div class="">[ +0.000010] amdgpu_bo_free_kernel+0xd1/0x120 [amdgpu]</div> <div class="">[ +0.000115] smu_sw_fini+0x4b/0x210 [amdgpu]</div> <div class="">[ +0.000188] amdgpu_device_fini_sw+0xbc/0x2e0 [amdgpu]</div> <div class="">[ +0.000108] amdgpu_driver_release_kms+0x12/0x30 [amdgpu]</div> <div class="">[ +0.000106] drm_dev_release+0x20/0x40 [drm]</div> <div class="">[ +0.000023] drm_release+0xa8/0xf0 [drm]</div> <div class="">[ +0.000020] __fput+0xa1/0x260</div> <div class="">[ +0.000008] task_work_run+0x6d/0xb0</div> <div class="">[ +0.000007] exit_to_user_mode_prepare+0x1d3/0x1e0</div> <div class="">[ +0.000005] syscall_exit_to_user_mode+0x19/0x50</div> <div class="">[ +0.000003] do_syscall_64+0x40/0x80</div> <div class="">[ +0.000006] entry_SYSCALL_64_after_hwframe+0x44/0xae</div> <div class="">[ +0.000003] RIP: 0033:0x7f59f5106511</div> <div class="">[ +0.000003] Code: f7 d8 64 89 02 48 c7 c0 ff ff ff ff c3 66 2e 0f 1f 84 00 00 00 00 00 66 90 8b 05 fa ce 20 00 85 c0 75 16 b8 03 00 00 00 0f 05 <48> 3d 00 f0 ff ff 77 3f f3 c3 0f 1f 44 00 00 53 89 fb 48 83 ec 10</div> <div class="">[ +0.000002] RSP: 002b:00007ffff02c6be8 EFLAGS: 00000246 ORIG_RAX: 0000000000000003</div> <div class="">[ +0.000005] RAX: 0000000000000000 RBX: 000056517da3e6a0 RCX: 00007f59f5106511</div> <div class="">[ +0.000002] RDX: 00007f59f50efca0 RSI: 000056517f676100 RDI: 0000000000000003</div> <div class="">[ +0.000002] RBP: 000056517da3e8a0 R08: 0000000000000000 R09: 0000000000000000</div> <div class="">[ +0.000002] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000</div> <div class="">[ +0.000002] R13: 0000000000000000 R14: 0000000000000000 R15: 000056517da3e8a0</div> <div class="">[ +0.000014] </TASK></div> <div class="">[ +0.000002] irq event stamp: 39789</div> <div class="">[ +0.000002] hardirqs last enabled at (39795): [<ffffffff91107d32>] __up_console_sem+0x52/0x60</div> <div class="">[ +0.000003] hardirqs last disabled at (39800): [<ffffffff91107d17>] __up_console_sem+0x37/0x60</div> <div class="">[ +0.000002] softirqs last enabled at (39268): [<ffffffff9220034b>] __do_softirq+0x34b/0x492</div> <div class="">[ +0.000004] softirqs last disabled at (39163): [<ffffffff91083167>] irq_exit_rcu+0xd7/0xf0</div> <div class="">[ +0.000004] ---[ end trace 90fbe3f286a48d7b ]---</div> <div class="">[ +0.000296] [drm:amdgpu_fill_buffer [amdgpu]] *ERROR* Trying to clear memory with ring turned off.</div> <div class="">[ +0.000187] ------------[ cut here ]------------</div> <div class="">[ +0.000002] WARNING: CPU: 1 PID: 3800 at drivers/gpu/drm/amd/amdgpu/amdgpu_object.c:1313 amdgpu_bo_release_notify+0x164/0x170 [amdgpu]</div> <div class="">[ +0.000114] Modules linked in: amdgpu iommu_v2 gpu_sched nf_conntrack_netlink nfnetlink xt_addrtype br_netfilter xt_CHECKSUM iptable_mangle xt_MASQUERADE iptable_nat nf_nat xt_conntrack nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 ipt_REJECT nf_reject_ipv4 xt_tcpudp ip6table_filter ip6_tables iptable_filter fuse x86_pkg_temp_thermal acpi_pad ip_tables x_tables ast drm_vram_helper drm_ttm_helper ttm drm_kms_helper cfbfillrect syscopyarea cfbimgblt sysfillrect sysimgblt fb_sys_fops cfbcopyarea drm drm_panel_orientation_quirks</div> <div class="">[ +0.000062] CPU: 1 PID: 3800 Comm: amdgpu_test Tainted: G W 5.16.0-kfd+ #1</div> <div class="">[ +0.000003] Hardware name: Supermicro SYS-4029GP-TRT2/X11DPG-OT-CPU, BIOS 2.1 08/14/2018</div> <div class="">[ +0.000002] RIP: 0010:amdgpu_bo_release_notify+0x164/0x170 [amdgpu]</div> <div class="">[ +0.000112] Code: ff ff ff 48 39 c2 74 07 0f 0b e9 57 ff ff ff 48 89 ef e8 cf 14 15 00 e9 4a ff ff ff e8 f5 05 29 d1 eb c4 0f 0b e9 e7 fe ff ff <0f> 0b eb b9 e8 83 d7 7d d1 0f 1f 00 0f 1f 44 00 00 41 54 55 53 48</div> <div class="">[ +0.000003] RSP: 0018:ffffaa4c206dfd48 EFLAGS: 00010282</div> <div class="">[ +0.000004] RAX: 00000000ffffffea RBX: ffff9478d5ce3058 RCX: 0000000000000001</div> <div class="">[ +0.000002] RDX: 0000000000000000 RSI: 0000000000000000 RDI: 00000000ffffffff</div> <div class="">[ +0.000002] RBP: ffff9478d5ce3000 R08: 0000000000000000 R09: 0000000000000001</div> <div class="">[ +0.000003] R10: 0000000000000000 R11: ffffaa4c206dfa18 R12: ffff9478d5ce3058</div> <div class="">[ +0.000002] R13: ffff9478d5ce3190 R14: ffff9479156c5e08 R15: ffffffff9345ea20</div> <div class="">[ +0.000002] FS: 00007f59f5b50180(0000) GS:ffff9497bfc40000(0000) knlGS:0000000000000000</div> <div class="">[ +0.000004] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033</div> <div class="">[ +0.000002] CR2: 000055881d667000 CR3: 0000000137bee003 CR4: 00000000007706e0</div> <div class="">[ +0.000002] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000</div> <div class="">[ +0.000002] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400</div> <div class="">[ +0.000002] PKRU: 55555554</div> <div class="">[ +0.000002] Call Trace:</div> <div class="">[ +0.000002] <TASK></div> <div class="">[ +0.000004] ttm_bo_release+0x305/0x390 [ttm]</div> <div class="">[ +0.000009] ? __mutex_unlock_slowpath+0x41/0x280</div> <div class="">[ +0.000009] amdgpu_bo_free_kernel+0xd1/0x120 [amdgpu]</div> <div class="">[ +0.000115] smu_sw_fini+0x188/0x210 [amdgpu]</div> <div class="">[ +0.000189] amdgpu_device_fini_sw+0xbc/0x2e0 [amdgpu]</div> <div class="">[ +0.000107] amdgpu_driver_release_kms+0x12/0x30 [amdgpu]</div> <div class="">[ +0.000106] drm_dev_release+0x20/0x40 [drm]</div> <div class="">[ +0.000023] drm_release+0xa8/0xf0 [drm]</div> <div class="">[ +0.000021] __fput+0xa1/0x260</div> <div class="">[ +0.000007] task_work_run+0x6d/0xb0</div> <div class="">[ +0.000008] exit_to_user_mode_prepare+0x1d3/0x1e0</div> <div class="">[ +0.000004] syscall_exit_to_user_mode+0x19/0x50</div> <div class="">[ +0.000003] do_syscall_64+0x40/0x80</div> <div class="">[ +0.000005] entry_SYSCALL_64_after_hwframe+0x44/0xae</div> <div class="">[ +0.000004] RIP: 0033:0x7f59f5106511</div> <div class="">[ +0.000002] Code: f7 d8 64 89 02 48 c7 c0 ff ff ff ff c3 66 2e 0f 1f 84 00 00 00 00 00 66 90 8b 05 fa ce 20 00 85 c0 75 16 b8 03 00 00 00 0f 05 <48> 3d 00 f0 ff ff 77 3f f3 c3 0f 1f 44 00 00 53 89 fb 48 83 ec 10</div> <div class="">[ +0.000003] RSP: 002b:00007ffff02c6be8 EFLAGS: 00000246 ORIG_RAX: 0000000000000003</div> <div class="">[ +0.000004] RAX: 0000000000000000 RBX: 000056517da3e6a0 RCX: 00007f59f5106511</div> <div class="">[ +0.000003] RDX: 00007f59f50efca0 RSI: 000056517f676100 RDI: 0000000000000003</div> <div class="">[ +0.000002] RBP: 000056517da3e8a0 R08: 0000000000000000 R09: 0000000000000000</div> <div class="">[ +0.000002] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000</div> <div class="">[ +0.000002] R13: 0000000000000000 R14: 0000000000000000 R15: 000056517da3e8a0</div> <div class="">[ +0.000013] </TASK></div> <div class="">[ +0.000002] irq event stamp: 40367</div> <div class="">[ +0.000002] hardirqs last enabled at (40373): [<ffffffff91107d32>] __up_console_sem+0x52/0x60</div> <div class="">[ +0.000003] hardirqs last disabled at (40378): [<ffffffff91107d17>] __up_console_sem+0x37/0x60</div> <div class="">[ +0.000003] softirqs last enabled at (39268): [<ffffffff9220034b>] __do_softirq+0x34b/0x492</div> <div class="">[ +0.000003] softirqs last disabled at (39163): [<ffffffff91083167>] irq_exit_rcu+0xd7/0xf0</div> <div class="">[ +0.000004] ---[ end trace 90fbe3f286a48d7c ]---</div> <div class="">[ +0.000086] [drm:amdgpu_fill_buffer [amdgpu]] *ERROR* Trying to clear memory with ring turned off.</div> <div class="">[ +0.000197] ------------[ cut here ]------------</div> <div class="">[ +0.000003] WARNING: CPU: 26 PID: 3800 at drivers/gpu/drm/amd/amdgpu/amdgpu_object.c:1313 amdgpu_bo_release_notify+0x164/0x170 [amdgpu]</div> <div class="">[ +0.000117] Modules linked in: amdgpu iommu_v2 gpu_sched nf_conntrack_netlink nfnetlink xt_addrtype br_netfilter xt_CHECKSUM iptable_mangle xt_MASQUERADE iptable_nat nf_nat xt_conntrack nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 ipt_REJECT nf_reject_ipv4 xt_tcpudp ip6table_filter ip6_tables iptable_filter fuse x86_pkg_temp_thermal acpi_pad ip_tables x_tables ast drm_vram_helper drm_ttm_helper ttm drm_kms_helper cfbfillrect syscopyarea cfbimgblt sysfillrect sysimgblt fb_sys_fops cfbcopyarea drm drm_panel_orientation_quirks</div> <div class="">[ +0.000065] CPU: 26 PID: 3800 Comm: amdgpu_test Tainted: G W 5.16.0-kfd+ #1</div> <div class="">[ +0.000004] Hardware name: Supermicro SYS-4029GP-TRT2/X11DPG-OT-CPU, BIOS 2.1 08/14/2018</div> <div class="">[ +0.000002] RIP: 0010:amdgpu_bo_release_notify+0x164/0x170 [amdgpu]</div> <div class="">[ +0.000114] Code: ff ff ff 48 39 c2 74 07 0f 0b e9 57 ff ff ff 48 89 ef e8 cf 14 15 00 e9 4a ff ff ff e8 f5 05 29 d1 eb c4 0f 0b e9 e7 fe ff ff <0f> 0b eb b9 e8 83 d7 7d d1 0f 1f 00 0f 1f 44 00 00 41 54 55 53 48</div> <div class="">[ +0.000003] RSP: 0018:ffffaa4c206dfd48 EFLAGS: 00010282</div> <div class="">[ +0.000004] RAX: 00000000ffffffea RBX: ffff9478d5ce3458 RCX: 0000000000000001</div> <div class="">[ +0.000003] RDX: 0000000000000000 RSI: 0000000000000000 RDI: 00000000ffffffff</div> <div class="">[ +0.000002] RBP: ffff9478d5ce3400 R08: 0000000000000000 R09: 0000000000000001</div> <div class="">[ +0.000003] R10: 0000000000000000 R11: ffffaa4c206dfa18 R12: ffff9478d5ce3458</div> <div class="">[ +0.000002] R13: ffff9478d5ce3590 R14: ffff9479156c5e08 R15: ffffffff9345ea20</div> <div class="">[ +0.000002] FS: 00007f59f5b50180(0000) GS:ffff9497bff80000(0000) knlGS:0000000000000000</div> <div class="">[ +0.000003] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033</div> <div class="">[ +0.000003] CR2: 0000558d8cbed6f0 CR3: 0000000137bee005 CR4: 00000000007706e0</div> <div class="">[ +0.000002] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000</div> <div class="">[ +0.000002] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400</div> <div class="">[ +0.000002] PKRU: 55555554</div> <div class="">[ +0.000002] Call Trace:</div> <div class="">[ +0.000003] <TASK></div> <div class="">[ +0.000005] ttm_bo_release+0x305/0x390 [ttm]</div> <div class="">[ +0.000009] ? __mutex_unlock_slowpath+0x41/0x280</div> <div class="">[ +0.000010] amdgpu_bo_free_kernel+0xd1/0x120 [amdgpu]</div> <div class="">[ +0.000115] smu_sw_fini+0x105/0x210 [amdgpu]</div> <div class="">[ +0.000191] amdgpu_device_fini_sw+0xbc/0x2e0 [amdgpu]</div> <div class="">[ +0.000109] amdgpu_driver_release_kms+0x12/0x30 [amdgpu]</div> <div class="">[ +0.000106] drm_dev_release+0x20/0x40 [drm]</div> <div class="">[ +0.000024] drm_release+0xa8/0xf0 [drm]</div> <div class="">[ +0.000020] __fput+0xa1/0x260</div> <div class="">[ +0.000007] task_work_run+0x6d/0xb0</div> <div class="">[ +0.000008] exit_to_user_mode_prepare+0x1d3/0x1e0</div> <div class="">[ +0.000005] syscall_exit_to_user_mode+0x19/0x50</div> <div class="">[ +0.000003] do_syscall_64+0x40/0x80</div> <div class="">[ +0.000006] entry_SYSCALL_64_after_hwframe+0x44/0xae</div> <div class="">[ +0.000004] RIP: 0033:0x7f59f5106511</div> <div class="">[ +0.000002] Code: f7 d8 64 89 02 48 c7 c0 ff ff ff ff c3 66 2e 0f 1f 84 00 00 00 00 00 66 90 8b 05 fa ce 20 00 85 c0 75 16 b8 03 00 00 00 0f 05 <48> 3d 00 f0 ff ff 77 3f f3 c3 0f 1f 44 00 00 53 89 fb 48 83 ec 10</div> <div class="">[ +0.000003] RSP: 002b:00007ffff02c6be8 EFLAGS: 00000246 ORIG_RAX: 0000000000000003</div> <div class="">[ +0.000005] RAX: 0000000000000000 RBX: 000056517da3e6a0 RCX: 00007f59f5106511</div> <div class="">[ +0.000002] RDX: 00007f59f50efca0 RSI: 000056517f676100 RDI: 0000000000000003</div> <div class="">[ +0.000003] RBP: 000056517da3e8a0 R08: 0000000000000000 R09: 0000000000000000</div> <div class="">[ +0.000002] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000</div> <div class="">[ +0.000002] R13: 0000000000000000 R14: 0000000000000000 R15: 000056517da3e8a0</div> <div class="">[ +0.000014] </TASK></div> <div class="">[ +0.000001] irq event stamp: 40947</div> <div class="">[ +0.000002] hardirqs last enabled at (40953): [<ffffffff91107d32>] __up_console_sem+0x52/0x60</div> <div class="">[ +0.000004] hardirqs last disabled at (40958): [<ffffffff91107d17>] __up_console_sem+0x37/0x60</div> <div class="">[ +0.000003] softirqs last enabled at (39268): [<ffffffff9220034b>] __do_softirq+0x34b/0x492</div> <div class="">[ +0.000004] softirqs last disabled at (39163): [<ffffffff91083167>] irq_exit_rcu+0xd7/0xf0</div> <div class="">[ +0.000004] ---[ end trace 90fbe3f286a48d7d ]---</div> <div class="">[ +0.000195] [drm:amdgpu_fill_buffer [amdgpu]] *ERROR* Trying to clear memory with ring turned off.</div> <div class="">[ +0.000244] ------------[ cut here ]------------</div> <div class="">[ +0.000002] WARNING: CPU: 26 PID: 3800 at drivers/gpu/drm/amd/amdgpu/amdgpu_object.c:1313 amdgpu_bo_release_notify+0x164/0x170 [amdgpu]</div> <div class="">[ +0.000117] Modules linked in: amdgpu iommu_v2 gpu_sched nf_conntrack_netlink nfnetlink xt_addrtype br_netfilter xt_CHECKSUM iptable_mangle xt_MASQUERADE iptable_nat nf_nat xt_conntrack nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 ipt_REJECT nf_reject_ipv4 xt_tcpudp ip6table_filter ip6_tables iptable_filter fuse x86_pkg_temp_thermal acpi_pad ip_tables x_tables ast drm_vram_helper drm_ttm_helper ttm drm_kms_helper cfbfillrect syscopyarea cfbimgblt sysfillrect sysimgblt fb_sys_fops cfbcopyarea drm drm_panel_orientation_quirks</div> <div class="">[ +0.000063] CPU: 26 PID: 3800 Comm: amdgpu_test Tainted: G W 5.16.0-kfd+ #1</div> <div class="">[ +0.000004] Hardware name: Supermicro SYS-4029GP-TRT2/X11DPG-OT-CPU, BIOS 2.1 08/14/2018</div> <div class="">[ +0.000003] RIP: 0010:amdgpu_bo_release_notify+0x164/0x170 [amdgpu]</div> <div class="">[ +0.000114] Code: ff ff ff 48 39 c2 74 07 0f 0b e9 57 ff ff ff 48 89 ef e8 cf 14 15 00 e9 4a ff ff ff e8 f5 05 29 d1 eb c4 0f 0b e9 e7 fe ff ff <0f> 0b eb b9 e8 83 d7 7d d1 0f 1f 00 0f 1f 44 00 00 41 54 55 53 48</div> <div class="">[ +0.000003] RSP: 0018:ffffaa4c206dfd70 EFLAGS: 00010282</div> <div class="">[ +0.000004] RAX: 00000000ffffffea RBX: ffff949847be5058 RCX: 0000000000000001</div> <div class="">[ +0.000002] RDX: 0000000000000000 RSI: 0000000000000000 RDI: 00000000ffffffff</div> <div class="">[ +0.000003] RBP: ffff949847be5000 R08: 0000000000000000 R09: 0000000000000001</div> <div class="">[ +0.000002] R10: 0000000000000000 R11: ffffaa4c206dfa40 R12: ffff949847be5058</div> <div class="">[ +0.000002] R13: ffff949847be5190 R14: ffff9479156c5e08 R15: ffffffff9345ea20</div> <div class="">[ +0.000002] FS: 00007f59f5b50180(0000) GS:ffff9497bff80000(0000) knlGS:0000000000000000</div> <div class="">[ +0.000003] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033</div> <div class="">[ +0.000002] CR2: 0000558d8cbed6f0 CR3: 0000000137bee005 CR4: 00000000007706e0</div> <div class="">[ +0.000002] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000</div> <div class="">[ +0.000002] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400</div> <div class="">[ +0.000002] PKRU: 55555554</div> <div class="">[ +0.000002] Call Trace:</div> <div class="">[ +0.000003] <TASK></div> <div class="">[ +0.000005] ttm_bo_release+0x305/0x390 [ttm]</div> <div class="">[ +0.000009] ? __mutex_unlock_slowpath+0x41/0x280</div> <div class="">[ +0.000009] amdgpu_bo_free_kernel+0xd1/0x120 [amdgpu]</div> <div class="">[ +0.000115] amdgpu_device_fini_sw+0x259/0x2e0 [amdgpu]</div> <div class="">[ +0.000107] amdgpu_driver_release_kms+0x12/0x30 [amdgpu]</div> <div class="">[ +0.000105] drm_dev_release+0x20/0x40 [drm]</div> <div class="">[ +0.000023] drm_release+0xa8/0xf0 [drm]</div> <div class="">[ +0.000021] __fput+0xa1/0x260</div> <div class="">[ +0.000007] task_work_run+0x6d/0xb0</div> <div class="">[ +0.000007] exit_to_user_mode_prepare+0x1d3/0x1e0</div> <div class="">[ +0.000005] syscall_exit_to_user_mode+0x19/0x50</div> <div class="">[ +0.000003] do_syscall_64+0x40/0x80</div> <div class="">[ +0.000006] entry_SYSCALL_64_after_hwframe+0x44/0xae</div> <div class="">[ +0.000004] RIP: 0033:0x7f59f5106511</div> <div class="">[ +0.000003] Code: f7 d8 64 89 02 48 c7 c0 ff ff ff ff c3 66 2e 0f 1f 84 00 00 00 00 00 66 90 8b 05 fa ce 20 00 85 c0 75 16 b8 03 00 00 00 0f 05 <48> 3d 00 f0 ff ff 77 3f f3 c3 0f 1f 44 00 00 53 89 fb 48 83 ec 10</div> <div class="">[ +0.000002] RSP: 002b:00007ffff02c6be8 EFLAGS: 00000246 ORIG_RAX: 0000000000000003</div> <div class="">[ +0.000005] RAX: 0000000000000000 RBX: 000056517da3e6a0 RCX: 00007f59f5106511</div> <div class="">[ +0.000002] RDX: 00007f59f50efca0 RSI: 000056517f676100 RDI: 0000000000000003</div> <div class="">[ +0.000002] RBP: 000056517da3e8a0 R08: 0000000000000000 R09: 0000000000000000</div> <div class="">[ +0.000002] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000</div> <div class="">[ +0.000002] R13: 0000000000000000 R14: 0000000000000000 R15: 000056517da3e8a0</div> <div class="">[ +0.000013] </TASK></div> <div class="">[ +0.000002] irq event stamp: 41913</div> <div class="">[ +0.000002] hardirqs last enabled at (41919): [<ffffffff91107d32>] __up_console_sem+0x52/0x60</div> <div class="">[ +0.000004] hardirqs last disabled at (41924): [<ffffffff91107d17>] __up_console_sem+0x37/0x60</div> <div class="">[ +0.000002] softirqs last enabled at (41384): [<ffffffff9220034b>] __do_softirq+0x34b/0x492</div> <div class="">[ +0.000004] softirqs last disabled at (41377): [<ffffffff91083167>] irq_exit_rcu+0xd7/0xf0</div> <div class="">[ +0.000004] ---[ end trace 90fbe3f286a48d7e ]---</div> <div class="">[ +0.000383] [drm:amdgpu_fill_buffer [amdgpu]] *ERROR* Trying to clear memory with ring turned off.</div> <div class="">[ +0.000187] ------------[ cut here ]------------</div> <div class="">[ +0.000002] WARNING: CPU: 26 PID: 3800 at drivers/gpu/drm/amd/amdgpu/amdgpu_object.c:1313 amdgpu_bo_release_notify+0x164/0x170 [amdgpu]</div> <div class="">[ +0.000114] Modules linked in: amdgpu iommu_v2 gpu_sched nf_conntrack_netlink nfnetlink xt_addrtype br_netfilter xt_CHECKSUM iptable_mangle xt_MASQUERADE iptable_nat nf_nat xt_conntrack nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 ipt_REJECT nf_reject_ipv4 xt_tcpudp ip6table_filter ip6_tables iptable_filter fuse x86_pkg_temp_thermal acpi_pad ip_tables x_tables ast drm_vram_helper drm_ttm_helper ttm drm_kms_helper cfbfillrect syscopyarea cfbimgblt sysfillrect sysimgblt fb_sys_fops cfbcopyarea drm drm_panel_orientation_quirks</div> <div class="">[ +0.000062] CPU: 26 PID: 3800 Comm: amdgpu_test Tainted: G W 5.16.0-kfd+ #1</div> <div class="">[ +0.000004] Hardware name: Supermicro SYS-4029GP-TRT2/X11DPG-OT-CPU, BIOS 2.1 08/14/2018</div> <div class="">[ +0.000003] RIP: 0010:amdgpu_bo_release_notify+0x164/0x170 [amdgpu]</div> <div class="">[ +0.000112] Code: ff ff ff 48 39 c2 74 07 0f 0b e9 57 ff ff ff 48 89 ef e8 cf 14 15 00 e9 4a ff ff ff e8 f5 05 29 d1 eb c4 0f 0b e9 e7 fe ff ff <0f> 0b eb b9 e8 83 d7 7d d1 0f 1f 00 0f 1f 44 00 00 41 54 55 53 48</div> <div class="">[ +0.000003] RSP: 0018:ffffaa4c206dfd60 EFLAGS: 00010282</div> <div class="">[ +0.000004] RAX: 00000000ffffffea RBX: ffff949847be3858 RCX: 0000000000000001</div> <div class="">[ +0.000002] RDX: 0000000000000000 RSI: 0000000000000000 RDI: 00000000ffffffff</div> <div class="">[ +0.000002] RBP: ffff949847be3800 R08: 0000000000000000 R09: 0000000000000001</div> <div class="">[ +0.000002] R10: 0000000000000000 R11: ffffaa4c206dfa30 R12: ffff949847be3858</div> <div class="">[ +0.000002] R13: ffff949847be3990 R14: ffff9479156c5e08 R15: ffffffff9345ea20</div> <div class="">[ +0.000002] FS: 00007f59f5b50180(0000) GS:ffff9497bff80000(0000) knlGS:0000000000000000</div> <div class="">[ +0.000003] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033</div> <div class="">[ +0.000002] CR2: 0000558d8cbed6f0 CR3: 0000000137bee005 CR4: 00000000007706e0</div> <div class="">[ +0.000003] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000</div> <div class="">[ +0.000002] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400</div> <div class="">[ +0.000002] PKRU: 55555554</div> <div class="">[ +0.000002] Call Trace:</div> <div class="">[ +0.000002] <TASK></div> <div class="">[ +0.000005] ttm_bo_release+0x305/0x390 [ttm]</div> <div class="">[ +0.000008] ? __mutex_unlock_slowpath+0x41/0x280</div> <div class="">[ +0.000009] amdgpu_bo_free_kernel+0xd1/0x120 [amdgpu]</div> <div class="">[ +0.000115] gmc_v9_0_sw_fini+0x26/0x40 [amdgpu]</div> <div class="">[ +0.000143] amdgpu_device_fini_sw+0xbc/0x2e0 [amdgpu]</div> <div class="">[ +0.000108] amdgpu_driver_release_kms+0x12/0x30 [amdgpu]</div> <div class="">[ +0.000105] drm_dev_release+0x20/0x40 [drm]</div> <div class="">[ +0.000024] drm_release+0xa8/0xf0 [drm]</div> <div class="">[ +0.000020] __fput+0xa1/0x260</div> <div class="">[ +0.000007] task_work_run+0x6d/0xb0</div> <div class="">[ +0.000008] exit_to_user_mode_prepare+0x1d3/0x1e0</div> <div class="">[ +0.000005] syscall_exit_to_user_mode+0x19/0x50</div> <div class="">[ +0.000003] do_syscall_64+0x40/0x80</div> <div class="">[ +0.000006] entry_SYSCALL_64_after_hwframe+0x44/0xae</div> <div class="">[ +0.000003] RIP: 0033:0x7f59f5106511</div> <div class="">[ +0.000003] Code: f7 d8 64 89 02 48 c7 c0 ff ff ff ff c3 66 2e 0f 1f 84 00 00 00 00 00 66 90 8b 05 fa ce 20 00 85 c0 75 16 b8 03 00 00 00 0f 05 <48> 3d 00 f0 ff ff 77 3f f3 c3 0f 1f 44 00 00 53 89 fb 48 83 ec 10</div> <div class="">[ +0.000002] RSP: 002b:00007ffff02c6be8 EFLAGS: 00000246 ORIG_RAX: 0000000000000003</div> <div class="">[ +0.000004] RAX: 0000000000000000 RBX: 000056517da3e6a0 RCX: 00007f59f5106511</div> <div class="">[ +0.000003] RDX: 00007f59f50efca0 RSI: 000056517f676100 RDI: 0000000000000003</div> <div class="">[ +0.000002] RBP: 000056517da3e8a0 R08: 0000000000000000 R09: 0000000000000000</div> <div class="">[ +0.000002] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000</div> <div class="">[ +0.000002] R13: 0000000000000000 R14: 0000000000000000 R15: 000056517da3e8a0</div> <div class="">[ +0.000013] </TASK></div> <div class="">[ +0.000002] irq event stamp: 42555</div> <div class="">[ +0.000002] hardirqs last enabled at (42561): [<ffffffff91107d32>] __up_console_sem+0x52/0x60</div> <div class="">[ +0.000003] hardirqs last disabled at (42566): [<ffffffff91107d17>] __up_console_sem+0x37/0x60</div> <div class="">[ +0.000003] softirqs last enabled at (41384): [<ffffffff9220034b>] __do_softirq+0x34b/0x492</div> <div class="">[ +0.000004] softirqs last disabled at (41377): [<ffffffff91083167>] irq_exit_rcu+0xd7/0xf0</div> <div class="">[ +0.000004] ---[ end trace 90fbe3f286a48d7f ]---</div> <div class="">[ +0.000304] ------------[ cut here ]------------</div> <div class="">[ +0.000003] kernfs: can not remove 'mem_info_preempt_used', no directory</div> <div class="">[ +0.000006] WARNING: CPU: 26 PID: 3800 at fs/kernfs/dir.c:1536 kernfs_remove_by_name_ns+0x73/0x80</div> <div class="">[ +0.000005] Modules linked in: amdgpu iommu_v2 gpu_sched nf_conntrack_netlink nfnetlink xt_addrtype br_netfilter xt_CHECKSUM iptable_mangle xt_MASQUERADE iptable_nat nf_nat xt_conntrack nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 ipt_REJECT nf_reject_ipv4 xt_tcpudp ip6table_filter ip6_tables iptable_filter fuse x86_pkg_temp_thermal acpi_pad ip_tables x_tables ast drm_vram_helper drm_ttm_helper ttm drm_kms_helper cfbfillrect syscopyarea cfbimgblt sysfillrect sysimgblt fb_sys_fops cfbcopyarea drm drm_panel_orientation_quirks</div> <div class="">[ +0.000057] CPU: 26 PID: 3800 Comm: amdgpu_test Tainted: G W 5.16.0-kfd+ #1</div> <div class="">[ +0.000003] Hardware name: Supermicro SYS-4029GP-TRT2/X11DPG-OT-CPU, BIOS 2.1 08/14/2018</div> <div class="">[ +0.000002] RIP: 0010:kernfs_remove_by_name_ns+0x73/0x80</div> <div class="">[ +0.000003] Code: ff 31 c0 5b 5d 41 5c c3 48 c7 c7 00 81 bb 92 e8 b3 a6 cf ff b8 fe ff ff ff 5b 5d 41 5c c3 48 c7 c7 e0 8c 82 92 e8 ed 5c c8 ff <0f> 0b b8 fe ff ff ff eb d0 0f 1f 40 00 0f 1f 44 00 00 41 57 41 56</div> <div class="">[ +0.000002] RSP: 0018:ffffaa4c206dfda8 EFLAGS: 00010282</div> <div class="">[ +0.000004] RAX: 0000000000000000 RBX: ffff9479156c0000 RCX: 0000000000000001</div> <div class="">[ +0.000002] RDX: 0000000080000001 RSI: ffffffff92800179 RDI: 00000000ffffffff</div> <div class="">[ +0.000003] RBP: ffffffffc0b6904d R08: 0000000000000000 R09: 0000000000000001</div> <div class="">[ +0.000002] R10: 0000000000000000 R11: ffffaa4c206dfbb0 R12: ffff9479156defe8</div> <div class="">[ +0.000002] R13: ffff9479156e0008 R14: ffff9478f8fcfe28 R15: ffffffff9345ea20</div> <div class="">[ +0.000002] FS: 00007f59f5b50180(0000) GS:ffff9497bff80000(0000) knlGS:0000000000000000</div> <div class="">[ +0.000002] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033</div> <div class="">[ +0.000002] CR2: 0000558d8cbed6f0 CR3: 0000000137bee005 CR4: 00000000007706e0</div> <div class="">[ +0.000002] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000</div> <div class="">[ +0.000002] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400</div> <div class="">[ +0.000002] PKRU: 55555554</div> <div class="">[ +0.000002] Call Trace:</div> <div class="">[ +0.000002] <TASK></div> <div class="">[ +0.000003] amdgpu_preempt_mgr_fini+0x67/0xc0 [amdgpu]</div> <div class="">[ +0.000130] amdgpu_ttm_fini+0x125/0x190 [amdgpu]</div> <div class="">[ +0.000113] amdgpu_bo_fini+0x22/0x90 [amdgpu]</div> <div class="">[ +0.000113] gmc_v9_0_sw_fini+0x3a/0x40 [amdgpu]</div> <div class="">[ +0.000141] amdgpu_device_fini_sw+0xbc/0x2e0 [amdgpu]</div> <div class="">[ +0.000107] amdgpu_driver_release_kms+0x12/0x30 [amdgpu]</div> <div class="">[ +0.000105] drm_dev_release+0x20/0x40 [drm]</div> <div class="">[ +0.000023] drm_release+0xa8/0xf0 [drm]</div> <div class="">[ +0.000020] __fput+0xa1/0x260</div> <div class="">[ +0.000007] task_work_run+0x6d/0xb0</div> <div class="">[ +0.000007] exit_to_user_mode_prepare+0x1d3/0x1e0</div> <div class="">[ +0.000004] syscall_exit_to_user_mode+0x19/0x50</div> <div class="">[ +0.000004] do_syscall_64+0x40/0x80</div> <div class="">[ +0.000005] entry_SYSCALL_64_after_hwframe+0x44/0xae</div> <div class="">[ +0.000003] RIP: 0033:0x7f59f5106511</div> <div class="">[ +0.000003] Code: f7 d8 64 89 02 48 c7 c0 ff ff ff ff c3 66 2e 0f 1f 84 00 00 00 00 00 66 90 8b 05 fa ce 20 00 85 c0 75 16 b8 03 00 00 00 0f 05 <48> 3d 00 f0 ff ff 77 3f f3 c3 0f 1f 44 00 00 53 89 fb 48 83 ec 10</div> <div class="">[ +0.000003] RSP: 002b:00007ffff02c6be8 EFLAGS: 00000246 ORIG_RAX: 0000000000000003</div> <div class="">[ +0.000003] RAX: 0000000000000000 RBX: 000056517da3e6a0 RCX: 00007f59f5106511</div> <div class="">[ +0.000003] RDX: 00007f59f50efca0 RSI: 000056517f676100 RDI: 0000000000000003</div> <div class="">[ +0.000002] RBP: 000056517da3e8a0 R08: 0000000000000000 R09: 0000000000000000</div> <div class="">[ +0.000002] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000</div> <div class="">[ +0.000002] R13: 0000000000000000 R14: 0000000000000000 R15: 000056517da3e8a0</div> <div class="">[ +0.000013] </TASK></div> <div class="">[ +0.000001] irq event stamp: 43135</div> <div class="">[ +0.000002] hardirqs last enabled at (43141): [<ffffffff91107d32>] __up_console_sem+0x52/0x60</div> <div class="">[ +0.000003] hardirqs last disabled at (43146): [<ffffffff91107d17>] __up_console_sem+0x37/0x60</div> <div class="">[ +0.000002] softirqs last enabled at (41384): [<ffffffff9220034b>] __do_softirq+0x34b/0x492</div> <div class="">[ +0.000004] softirqs last disabled at (41377): [<ffffffff91083167>] irq_exit_rcu+0xd7/0xf0</div> <div class="">[ +0.000004] ---[ end trace 90fbe3f286a48d80 ]---</div> <div class=""><span style="background-color: rgb(255, 147, 0);" class="">[ +0.000131] BUG: unable to handle page fault for address: ffffd3b803fc89b4</span></div> <div class=""><span style="background-color: rgb(255, 147, 0);" class="">[ +0.000031] #PF: supervisor write access in kernel mode</span></div> <div class=""><span style="background-color: rgb(255, 147, 0);" class="">[ +0.000021] #PF: error_code(0x0002) - not-present page</span></div> <div class=""><span style="background-color: rgb(255, 147, 0);" class="">[ +0.000020] PGD 207ffea067 P4D 207ffea067 PUD 207ffe9067 PMD 0</span></div> <div class=""><span style="background-color: rgb(255, 147, 0);" class="">[ +0.000026] Oops: 0002 [#1] PREEMPT SMP PTI</span></div> <div class="">[ +0.000018] CPU: 26 PID: 3800 Comm: amdgpu_test Tainted: G W 5.16.0-kfd+ #1</div> <div class="">[ +0.000030] Hardware name: Supermicro SYS-4029GP-TRT2/X11DPG-OT-CPU, BIOS 2.1 08/14/2018</div> <div class="">[ +0.000029] RIP: 0010:__free_pages+0xe/0x90</div> <div class="">[ +0.000020] Code: 0c e9 76 fd ff ff 31 f6 e9 6f fd ff ff 31 d2 e9 c8 cd ff ff 0f 1f 84 00 00 00 00 00 0f 1f 44 00 00 41 54 49 89 fc 55 53 89 f3 <f0> ff 4f 34 74 50 48 8b 07 bd 01 00 00 00 a9 00 00 01 00 75 31 83</div> <div class="">[ +0.000064] RSP: 0018:ffffaa4c206dfd30 EFLAGS: 00010246</div> <div class="">[ +0.000021] RAX: 00000000ffffffff RBX: 0000000000000000 RCX: 00000000000ff226</div> <div class="">[ +0.000544] RDX: ffff9478dfc5c000 RSI: 0000000000000000 RDI: ffffd3b803fc8980</div> <div class="">[ +0.000533] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000246</div> <div class="">[ +0.000536] R10: 0000000000000000 R11: 0000000000000000 R12: ffffd3b803fc8980</div> <div class="">[ +0.000523] R13: ffff9479156c5e20 R14: ffff9479156c6d88 R15: ffffffffc0501398</div> <div class="">[ +0.000524] FS: 00007f59f5b50180(0000) GS:ffff9497bff80000(0000) knlGS:0000000000000000</div> <div class="">[ +0.000529] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033</div> <div class="">[ +0.000522] CR2: ffffd3b803fc89b4 CR3: 0000000137bee005 CR4: 00000000007706e0</div> <div class="">[ +0.000532] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000</div> <div class="">[ +0.000528] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400</div> <div class="">[ +0.000518] PKRU: 55555554</div> <div class="">[ +0.000521] Call Trace:</div> <div class="">[ +0.000500] <TASK></div> <div class="">[ +0.000494] ttm_pool_free_page+0x68/0x90 [ttm]</div> <div class="">[ +0.000506] ttm_pool_type_fini+0x59/0x70 [ttm]</div> <div class="">[ +0.000504] ttm_pool_fini+0x2d/0x50 [ttm]</div> <div class="">[ +0.000499] ttm_device_fini+0xfc/0x1c0 [ttm]</div> <div class="">[ +0.000496] amdgpu_ttm_fini+0x154/0x190 [amdgpu]</div> <div class="">[ +0.000595] amdgpu_bo_fini+0x22/0x90 [amdgpu]</div> <div class="">[ +0.000583] gmc_v9_0_sw_fini+0x3a/0x40 [amdgpu]</div> <div class="">[ +0.000613] amdgpu_device_fini_sw+0xbc/0x2e0 [amdgpu]</div> <div class="">[ +0.000592] amdgpu_driver_release_kms+0x12/0x30 [amdgpu]</div> <div class="">[ +0.000602] drm_dev_release+0x20/0x40 [drm]</div> <div class="">[ +0.000516] drm_release+0xa8/0xf0 [drm]</div> <div class="">[ +0.000522] __fput+0xa1/0x260</div> <div class="">[ +0.000506] task_work_run+0x6d/0xb0</div> <div class="">[ +0.000516] exit_to_user_mode_prepare+0x1d3/0x1e0</div> <div class="">[ +0.000529] syscall_exit_to_user_mode+0x19/0x50</div> <div class="">[ +0.000537] do_syscall_64+0x40/0x80</div> <div class="">[ +0.000542] entry_SYSCALL_64_after_hwframe+0x44/0xae</div> <div class="">[ +0.000563] RIP: 0033:0x7f59f5106511</div> <div class="">[ +0.000552] Code: f7 d8 64 89 02 48 c7 c0 ff ff ff ff c3 66 2e 0f 1f 84 00 00 00 00 00 66 90 8b 05 fa ce 20 00 85 c0 75 16 b8 03 00 00 00 0f 05 <48> 3d 00 f0 ff ff 77 3f f3 c3 0f 1f 44 00 00 53 89 fb 48 83 ec 10</div> <div class="">[ +0.001237] RSP: 002b:00007ffff02c6be8 EFLAGS: 00000246 ORIG_RAX: 0000000000000003</div> <div class="">[ +0.000641] RAX: 0000000000000000 RBX: 000056517da3e6a0 RCX: 00007f59f5106511</div> <div class="">[ +0.000656] RDX: 00007f59f50efca0 RSI: 000056517f676100 RDI: 0000000000000003</div> <div class="">[ +0.000657] RBP: 000056517da3e8a0 R08: 0000000000000000 R09: 0000000000000000</div> <div class="">[ +0.000661] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000</div> <div class="">[ +0.000643] R13: 0000000000000000 R14: 0000000000000000 R15: 000056517da3e8a0</div> <div class="">[ +0.000642] </TASK></div> <div class="">[ +0.000627] Modules linked in: amdgpu iommu_v2 gpu_sched nf_conntrack_netlink nfnetlink xt_addrtype br_netfilter xt_CHECKSUM iptable_mangle xt_MASQUERADE iptable_nat nf_nat xt_conntrack nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 ipt_REJECT nf_reject_ipv4 xt_tcpudp ip6table_filter ip6_tables iptable_filter fuse x86_pkg_temp_thermal acpi_pad ip_tables x_tables ast drm_vram_helper drm_ttm_helper ttm drm_kms_helper cfbfillrect syscopyarea cfbimgblt sysfillrect sysimgblt fb_sys_fops cfbcopyarea drm drm_panel_orientation_quirks</div> <div class="">[ +0.003478] CR2: ffffd3b803fc89b4</div> <div class="">[ +0.000671] ---[ end trace 90fbe3f286a48d81 ]---</div> <div class="">[ +0.007599] RIP: 0010:__free_pages+0xe/0x90</div> <div class="">[ +0.000667] Code: 0c e9 76 fd ff ff 31 f6 e9 6f fd ff ff 31 d2 e9 c8 cd ff ff 0f 1f 84 00 00 00 00 00 0f 1f 44 00 00 41 54 49 89 fc 55 53 89 f3 <f0> ff 4f 34 74 50 48 8b 07 bd 01 00 00 00 a9 00 00 01 00 75 31 83</div> <div class="">[ +0.001401] RSP: 0018:ffffaa4c206dfd30 EFLAGS: 00010246</div> <div class="">[ +0.000708] RAX: 00000000ffffffff RBX: 0000000000000000 RCX: 00000000000ff226</div> <div class="">[ +0.000711] RDX: ffff9478dfc5c000 RSI: 0000000000000000 RDI: ffffd3b803fc8980</div> <div class="">[ +0.000707] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000246</div> <div class="">[ +0.000697] R10: 0000000000000000 R11: 0000000000000000 R12: ffffd3b803fc8980</div> <div class="">[ +0.000687] R13: ffff9479156c5e20 R14: ffff9479156c6d88 R15: ffffffffc0501398</div> <div class="">[ +0.000699] FS: 00007f59f5b50180(0000) GS:ffff9497bff80000(0000) knlGS:0000000000000000</div> <div class="">[ +0.000709] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033</div> <div class="">[ +0.000700] CR2: ffffd3b803fc89b4 CR3: 0000000137bee005 CR4: 00000000007706e0</div> <div class="">[ +0.000716] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000</div> <div class="">[ +0.000727] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400</div> <div class="">[ +0.000723] PKRU: 55555554</div> </div> <div class=""><br class=""> </div> </div> <div> <blockquote type="cite" class=""> <div class=""> <div class=""> <p class=""></p> <p class=""><br class=""> </p> <blockquote type="cite" cite="mid:0FD33B90-BD27-4F32-9735-CA525735B5FA@microsoft.com" class=""> <div class=""> <div class="">p.s. I cloned and build libdrm from source (<a href="https://nam06.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgitlab.freedesktop.org%2Fmesa%2Fdrm&data=05%7C01%7Cshuotaoxu%40microsoft.com%7C1ce273d333a04fde7dcf08da221de5f7%7C72f988bf86f141af91ab2d7cd011db47%7C1%7C0%7C637859809165356475%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=FZ4PkLIElDTsj5nwDdYT9VIdjbc7zm0F78ALFjZRYdY%3D&reserved=0" originalsrc="https://gitlab.freedesktop.org/mesa/drm" shash="K49tEoBLPRMZicjy5DsYov3FH1bQIKA4t6i4cUVR91nUPOmgFmKlGazT0lN0ldBc1ugmxfMub5GrAiBZ6l9aaYTMVlB2vMrjHuKY5LF8lJJDf7b0ZB2fMPKb/GAb9Zdo3e9nQ+aVyvLSvIvp5IK9BiS9SUa6y/wGxuqdmgIN7oA=" class="" moz-do-not-send="true">https://gitlab.freedesktop.org/mesa/drm</a>)</div> <div class=""><br class=""> </div> <div class="">Thank you so much!</div> <div class=""><br class=""> </div> <blockquote type="cite" class=""> <div class=""> <div class=""> <p class="">Andrey</p> <p class=""><br class=""> </p> <blockquote type="cite" cite="mid:7825EEC6-BAF8-4B71-B01C-FE246D360779@microsoft.com" class=""> <div class=""> <div class="">+<span class="Apple-tab-span" style="white-space:pre"> </span>}</div> <div class="">+<span class="Apple-tab-span" style="white-space:pre"> </span>}</div> <div class="">+<span class="Apple-tab-span" style="white-space:pre"> </span>srcu_read_unlock(&kfd_processes_srcu, idx);</div> <div class="">+<span class="Apple-tab-span" style="white-space:pre"> </span>}</div> <div class="">+</div> <div class=""> <span class="Apple-tab-span" style="white-space:pre"> </span>kfd->dqm->ops.stop(kfd->dqm);</div> <div class=""> <span class="Apple-tab-span" style="white-space:pre"> </span>kfd_iommu_suspend(kfd);</div> <div class=""> }</div> <div class="">diff --git a/drivers/gpu/drm/amd/amdkfd/kfd_topology.c b/drivers/gpu/drm/amd/amdkfd/kfd_topology.c</div> <div class="">index 600ba2a728ea..7e3d1848eccc 100644</div> <div class="">--- a/drivers/gpu/drm/amd/amdkfd/kfd_topology.c</div> <div class="">+++ b/drivers/gpu/drm/amd/amdkfd/kfd_topology.c</div> <div class="">@@ -669,11 +669,12 @@ static void kfd_remove_sysfs_node_entry(struct kfd_topology_device *dev)</div> <div class=""> #ifdef HAVE_AMD_IOMMU_PC_SUPPORTED</div> <div class=""> <span class="Apple-tab-span" style="white-space:pre"> </span>if (dev->kobj_perf) {</div> <div class=""> <span class="Apple-tab-span" style="white-space:pre"> </span>list_for_each_entry(perf, &dev->perf_props, list) {</div> <div class="">+<span class="Apple-tab-span" style="white-space:pre"> </span>sysfs_remove_group(dev->kobj_perf, perf->attr_group);</div> <div class=""> <span class="Apple-tab-span" style="white-space:pre"> </span>kfree(perf->attr_group);</div> <div class=""> <span class="Apple-tab-span" style="white-space:pre"> </span>perf->attr_group = NULL;</div> <div class=""> <span class="Apple-tab-span" style="white-space:pre"> </span>}</div> <div class=""> <span class="Apple-tab-span" style="white-space:pre"> </span>kobject_del(dev->kobj_perf);</div> <div class="">-<span class="Apple-tab-span" style="white-space:pre"> </span>kobject_put(dev->kobj_perf);</div> <div class="">+<span class="Apple-tab-span" style="white-space:pre"> </span>/* kobject_put(dev->kobj_perf); */</div> <div class=""> <span class="Apple-tab-span" style="white-space:pre"> </span>dev->kobj_perf = NULL;</div> <div class=""> <span class="Apple-tab-span" style="white-space:pre"> </span>}</div> <div class=""> #endif</div> <div class=""><br class=""> </div> <div class="">Thank you so much! Looking forward to your comments!</div> <div class=""><br class=""> </div> <div class="">Regards,</div> <div class="">Shuotao</div> <blockquote type="cite" class=""> <div class=""> <div class=""> <p class="">Andrey</p> <p class=""><br class=""> </p> <blockquote type="cite" cite="mid:76C16B06-0539-48EE-AB11-80089490CE3A@microsoft.com" class=""> <div class=""> <div class=""> <div class=""> <div class=""><br class=""> </div> <div class="">Thank you so much!</div> <div class=""><br class=""> </div> <div class="">Best regards,</div> <div class="">Shuotao</div> </div> <blockquote type="cite" class=""> <div class=""> <p class="">Andrey</p> <p class=""><br class=""> </p> <blockquote type="cite" cite="mid:B7970589-ACF6-41F3-8622-1C0F705F3EE0@microsoft.com" class=""> <div class=""> <div class=""><br class=""> </div> <div class=""><br class=""> </div> <div class=""> <div class="">diff --git a/drivers/gpu/drm/amd/amdgpu/amdgpu_amdkfd.c b/drivers/gpu/drm/amd/amdgpu/amdgpu_amdkfd.c</div> <div class="">index 8fa9b86ac9d2..c0b27f722281 100644</div> <div class="">--- a/drivers/gpu/drm/amd/amdgpu/amdgpu_amdkfd.c</div> <div class="">+++ b/drivers/gpu/drm/amd/amdgpu/amdgpu_amdkfd.c</div> <div class="">@@ -188,6 +188,12 @@ void amdgpu_amdkfd_interrupt(struct amdgpu_device *adev,</div> <div class=""> <span class="Apple-tab-span" style="white-space:pre"> </span>kgd2kfd_interrupt(adev->kfd.dev, ih_ring_entry);</div> <div class=""> }</div> <div class=""> </div> <div class="">+void amdgpu_amdkfd_kill_all_processes(struct amdgpu_device *adev)</div> <div class="">+{</div> <div class="">+<span class="Apple-tab-span" style="white-space:pre"> </span>if (adev->kfd.dev)</div> <div class="">+<span class="Apple-tab-span" style="white-space:pre"> </span>kgd2kfd_kill_all_user_processes(adev->kfd.dev);</div> <div class="">+}</div> <div class="">+</div> <div class=""> void amdgpu_amdkfd_suspend(struct amdgpu_device *adev, bool run_pm)</div> <div class=""> {</div> <div class=""> <span class="Apple-tab-span" style="white-space:pre"> </span>if (adev->kfd.dev)</div> <div class="">diff --git a/drivers/gpu/drm/amd/amdgpu/amdgpu_amdkfd.h b/drivers/gpu/drm/amd/amdgpu/amdgpu_amdkfd.h</div> <div class="">index 27c74fcec455..f4e485d60442 100644</div> <div class="">--- a/drivers/gpu/drm/amd/amdgpu/amdgpu_amdkfd.h</div> <div class="">+++ b/drivers/gpu/drm/amd/amdgpu/amdgpu_amdkfd.h</div> <div class="">@@ -141,6 +141,7 @@ struct amdkfd_process_info {</div> <div class=""> int amdgpu_amdkfd_init(void);</div> <div class=""> void amdgpu_amdkfd_fini(void);</div> <div class=""> </div> <div class="">+void amdgpu_amdkfd_kill_all_processes(struct amdgpu_device *adev);</div> <div class=""> void amdgpu_amdkfd_suspend(struct amdgpu_device *adev, bool run_pm);</div> <div class=""> int amdgpu_amdkfd_resume_iommu(struct amdgpu_device *adev);</div> <div class=""> int amdgpu_amdkfd_resume(struct amdgpu_device *adev, bool run_pm, bool sync);</div> <div class="">@@ -405,6 +406,7 @@ bool kgd2kfd_device_init(struct kfd_dev *kfd,</div> <div class=""> <span class="Apple-tab-span" style="white-space:pre"> </span>const struct kgd2kfd_shared_resources *gpu_resources);</div> <div class=""> void kgd2kfd_device_exit(struct kfd_dev *kfd);</div> <div class=""> void kgd2kfd_suspend(struct kfd_dev *kfd, bool run_pm, bool force);</div> <div class="">+void kgd2kfd_kill_all_user_processes(struct kfd_dev *kfd);</div> <div class=""> int kgd2kfd_resume_iommu(struct kfd_dev *kfd);</div> <div class=""> int kgd2kfd_resume(struct kfd_dev *kfd, bool run_pm, bool sync);</div> <div class=""> int kgd2kfd_pre_reset(struct kfd_dev *kfd);</div> <div class="">@@ -443,6 +445,9 @@ static inline void kgd2kfd_suspend(struct kfd_dev *kfd, bool run_pm, bool force)</div> <div class=""> {</div> <div class=""> }</div> <div class=""> </div> <div class="">+void kgd2kfd_kill_all_user_processes(struct kfd_dev *kfd){</div> <div class="">+}</div> <div class="">+</div> <div class=""> static int __maybe_unused kgd2kfd_resume_iommu(struct kfd_dev *kfd)</div> <div class=""> {</div> <div class=""> <span class="Apple-tab-span" style="white-space:pre"> </span>return 0;</div> <div class="">diff --git a/drivers/gpu/drm/amd/amdgpu/amdgpu_drv.c b/drivers/gpu/drm/amd/amdgpu/amdgpu_drv.c</div> <div class="">index 3d5fc0751829..af6fe5080cfa 100644</div> <div class="">--- a/drivers/gpu/drm/amd/amdgpu/amdgpu_drv.c</div> <div class="">+++ b/drivers/gpu/drm/amd/amdgpu/amdgpu_drv.c</div> <div class="">@@ -2101,6 +2101,9 @@ amdgpu_pci_remove(struct pci_dev *pdev)</div> <div class=""> {</div> <div class=""> <span class="Apple-tab-span" style="white-space:pre"> </span>struct drm_device *dev = pci_get_drvdata(pdev);</div> <div class=""> </div> <div class="">+<span class="Apple-tab-span" style="white-space:pre"> </span>/* kill all kfd processes before drm_dev_unplug */</div> <div class="">+<span class="Apple-tab-span" style="white-space:pre"> </span>amdgpu_amdkfd_kill_all_processes(drm_to_adev(dev));</div> <div class="">+</div> <div class=""> #ifdef HAVE_DRM_DEV_UNPLUG</div> <div class=""> <span class="Apple-tab-span" style="white-space:pre"> </span>drm_dev_unplug(dev);</div> <div class=""> #else</div> <div class="">diff --git a/drivers/gpu/drm/amd/amdkfd/kfd_device.c b/drivers/gpu/drm/amd/amdkfd/kfd_device.c</div> <div class="">index 5504a18b5a45..480c23bef5e2 100644</div> <div class="">--- a/drivers/gpu/drm/amd/amdkfd/kfd_device.c</div> <div class="">+++ b/drivers/gpu/drm/amd/amdkfd/kfd_device.c</div> <div class="">@@ -691,6 +691,12 @@ bool kfd_is_locked(void)</div> <div class=""> <span class="Apple-tab-span" style="white-space:pre"> </span>return (atomic_read(&kfd_locked) > 0);</div> <div class=""> }</div> <div class=""> </div> <div class="">+inline void kgd2kfd_kill_all_user_processes(struct kfd_dev* dev)</div> <div class="">+{</div> <div class="">+<span class="Apple-tab-span" style="white-space:pre"> </span>kfd_kill_all_user_processes();</div> <div class="">+}</div> <div class="">+</div> <div class="">+</div> <div class=""> void kgd2kfd_suspend(struct kfd_dev *kfd, bool run_pm, bool force)</div> <div class=""> {</div> <div class=""> <span class="Apple-tab-span" style="white-space:pre"> </span>if (!kfd->init_complete)</div> <div class="">diff --git a/drivers/gpu/drm/amd/amdkfd/kfd_priv.h b/drivers/gpu/drm/amd/amdkfd/kfd_priv.h</div> <div class="">index 55c9e1922714..a35a2cb5bb9f 100644</div> <div class="">--- a/drivers/gpu/drm/amd/amdkfd/kfd_priv.h</div> <div class="">+++ b/drivers/gpu/drm/amd/amdkfd/kfd_priv.h</div> <div class="">@@ -1064,6 +1064,7 @@ static inline struct kfd_process_device *kfd_process_device_from_gpuidx(</div> <div class=""> void kfd_unref_process(struct kfd_process *p);</div> <div class=""> int kfd_process_evict_queues(struct kfd_process *p, bool force);</div> <div class=""> int kfd_process_restore_queues(struct kfd_process *p);</div> <div class="">+void kfd_kill_all_user_processes(void);</div> <div class=""> void kfd_suspend_all_processes(bool force);</div> <div class=""> /*</div> <div class=""> * kfd_resume_all_processes:</div> <div class="">diff --git a/drivers/gpu/drm/amd/amdkfd/kfd_process.c b/drivers/gpu/drm/amd/amdkfd/kfd_process.c</div> <div class="">index 6cdc855abb6d..17e769e6951d 100644</div> <div class="">--- a/drivers/gpu/drm/amd/amdkfd/kfd_process.c</div> <div class="">+++ b/drivers/gpu/drm/amd/amdkfd/kfd_process.c</div> <div class="">@@ -46,6 +46,9 @@ struct mm_struct;</div> <div class=""> #include "kfd_trace.h"</div> <div class=""> #include "kfd_debug.h"</div> <div class=""> </div> <div class="">+static atomic_t kfd_process_locked = ATOMIC_INIT(0);</div> <div class="">+static atomic_t kfd_inflight_kills = ATOMIC_INIT(0);</div> <div class="">+</div> <div class=""> /*</div> <div class=""> * List of struct kfd_process (field kfd_process).</div> <div class=""> * Unique/indexed by mm_struct*</div> <div class="">@@ -802,6 +805,9 @@ struct kfd_process *kfd_create_process(struct task_struct *thread)</div> <div class=""> <span class="Apple-tab-span" style="white-space:pre"> </span>struct kfd_process *process;</div> <div class=""> <span class="Apple-tab-span" style="white-space:pre"> </span>int ret;</div> <div class=""> </div> <div class="">+<span class="Apple-tab-span" style="white-space:pre"> </span>if ( atomic_read(&kfd_process_locked) > 0 )</div> <div class="">+<span class="Apple-tab-span" style="white-space:pre"> </span>return ERR_PTR(-EINVAL);</div> <div class="">+</div> <div class=""> <span class="Apple-tab-span" style="white-space:pre"> </span>if (!(thread->mm && mmget_not_zero(thread->mm)))</div> <div class=""> <span class="Apple-tab-span" style="white-space:pre"> </span>return ERR_PTR(-EINVAL);</div> <div class=""> </div> <div class="">@@ -1126,6 +1132,10 @@ static void kfd_process_wq_release(struct work_struct *work)</div> <div class=""> <span class="Apple-tab-span" style="white-space:pre"> </span>put_task_struct(p->lead_thread);</div> <div class=""> </div> <div class=""> <span class="Apple-tab-span" style="white-space:pre"> </span>kfree(p);</div> <div class="">+</div> <div class="">+<span class="Apple-tab-span" style="white-space:pre"> </span>if ( atomic_read(&kfd_process_locked) > 0 ){</div> <div class="">+<span class="Apple-tab-span" style="white-space:pre"> </span>atomic_dec(&kfd_inflight_kills);</div> <div class="">+<span class="Apple-tab-span" style="white-space:pre"> </span>}</div> <div class=""> }</div> <div class=""> </div> <div class=""> static void kfd_process_ref_release(struct kref *ref)</div> <div class="">@@ -2186,6 +2196,35 @@ static void restore_process_worker(struct work_struct *work)</div> <div class=""> <span class="Apple-tab-span" style="white-space:pre"> </span>pr_err("Failed to restore queues of pasid 0x%x\n", p->pasid);</div> <div class=""> }</div> <div class=""> </div> <div class="">+void kfd_kill_all_user_processes(void)</div> <div class="">+{</div> <div class="">+<span class="Apple-tab-span" style="white-space:pre"> </span>struct kfd_process *p;</div> <div class="">+<span class="Apple-tab-span" style="white-space:pre"> </span>/* struct amdkfd_process_info *p_info; */</div> <div class="">+<span class="Apple-tab-span" style="white-space:pre"> </span>unsigned int temp;</div> <div class="">+<span class="Apple-tab-span" style="white-space:pre"> </span>int idx;</div> <div class="">+<span class="Apple-tab-span" style="white-space:pre"> </span>atomic_inc(&kfd_process_locked);</div> <div class="">+</div> <div class="">+<span class="Apple-tab-span" style="white-space:pre"> </span>idx = srcu_read_lock(&kfd_processes_srcu);</div> <div class="">+<span class="Apple-tab-span" style="white-space:pre"> </span>pr_info("Killing all processes\n");</div> <div class="">+<span class="Apple-tab-span" style="white-space:pre"> </span>hash_for_each_rcu(kfd_processes_table, temp, p, kfd_processes) {</div> <div class="">+<span class="Apple-tab-span" style="white-space:pre"> </span>dev_warn(kfd_device,</div> <div class="">+<span class="Apple-tab-span" style="white-space:pre"> </span>"Sending SIGBUS to process %d (pasid 0x%x)",</div> <div class="">+<span class="Apple-tab-span" style="white-space:pre"> </span>p->lead_thread->pid, p->pasid);</div> <div class="">+<span class="Apple-tab-span" style="white-space:pre"> </span>send_sig(SIGBUS, p->lead_thread, 0);</div> <div class="">+<span class="Apple-tab-span" style="white-space:pre"> </span>atomic_inc(&kfd_inflight_kills);</div> <div class="">+<span class="Apple-tab-span" style="white-space:pre"> </span>}</div> <div class="">+<span class="Apple-tab-span" style="white-space:pre"> </span>srcu_read_unlock(&kfd_processes_srcu, idx);</div> <div class="">+</div> <div class="">+<span class="Apple-tab-span" style="white-space:pre"> </span>while ( atomic_read(&kfd_inflight_kills) > 0 ){</div> <div class="">+<span class="Apple-tab-span" style="white-space:pre"> </span>dev_warn(kfd_device,</div> <div class="">+<span class="Apple-tab-span" style="white-space:pre"> </span>"kfd_processes_table is not empty, going to sleep for 10ms\n");</div> <div class="">+<span class="Apple-tab-span" style="white-space:pre"> </span>msleep(10);</div> <div class="">+<span class="Apple-tab-span" style="white-space:pre"> </span>}</div> <div class="">+</div> <div class="">+<span class="Apple-tab-span" style="white-space:pre"> </span>atomic_dec(&kfd_process_locked);</div> <div class="">+<span class="Apple-tab-span" style="white-space:pre"> </span>pr_info("all processes has been fully released");</div> <div class="">+}</div> <div class="">+</div> <div class=""> void kfd_suspend_all_processes(bool force)</div> <div class=""> {</div> <div class=""> <span class="Apple-tab-span" style="white-space:pre"> </span>struct kfd_process *p;</div> <div class=""><br class=""> </div> <div class=""><br class=""> </div> </div> <div class=""><br class=""> </div> <div class="">Regards,</div> <div class="">Shuotao</div> <br class=""> <blockquote type="cite" class=""> <div class=""> <div class=""> <div class=""><span style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: 400; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none; float: none; display: inline !important;" class=""></span><br class="webkit-block-placeholder"> </div> <p class=""><span style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: 400; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none; float: none; display: inline !important;" class=""><font class="" size="4">Andrey</font><br class=""> <br class=""> </span></p> <blockquote type="cite" cite="mid:5A64FAEA-CCE8-4EB6-8E7B-852D4F384255@microsoft.com" class=""> <div class="">+ }</div> <div class="">+ srcu_read_unlock(&kfd_processes_srcu, idx);</div> <div class="">+}</div> <div class="">+</div> <div class="">+</div> <div class=""> int kfd_resume_all_processes(bool sync)</div> <div class=""> {</div> <div class=""> struct kfd_process *p;</div> <div class=""><br class=""> </div> <div class=""><br class=""> <blockquote type="cite" class=""> <div class=""><span style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: 400; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none; float: none; display: inline !important;" class="">Andrey</span><br style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: 400; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none;" class=""> <br style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: 400; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none;" class=""> <br style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: 400; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none;" class=""> <blockquote type="cite" style="font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: 400; letter-spacing: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-size-adjust: auto; -webkit-text-stroke-width: 0px; text-decoration: none;" class=""> <br class=""> Really appreciate your help!<br class=""> <br class=""> Best,<br class=""> Shuotao<br class=""> <br class=""> <blockquote type="cite" class=""> <blockquote type="cite" class="">2. Remove redudant p2p/io links in sysfs when device is hotplugged<br class=""> out.<br class=""> <br class=""> 3. New kfd node_id is not properly assigned after a new device is<br class=""> added after a gpu is hotplugged out in a system. libhsakmt will<br class=""> find this anomaly, (i.e. node_from != <dev node id> in iolinks),<br class=""> when taking a topology_snapshot, thus returns fault to the rocm<br class=""> stack.<br class=""> <br class=""> -- This patch fixes issue 1; another patch by Mukul fixes issues 2&3.<br class=""> -- Tested on a 4-GPU MI100 gpu nodes with kernel 5.13.0-kfd; kernel<br class=""> 5.16.0-kfd is unstable out of box for MI100.<br class=""> ---<br class=""> drivers/gpu/drm/amd/amdgpu/amdgpu_amdkfd.c | 5 +++++<br class=""> drivers/gpu/drm/amd/amdgpu/amdgpu_amdkfd.h | 7 +++++++<br class=""> drivers/gpu/drm/amd/amdgpu/amdgpu_device.c | 1 +<br class=""> drivers/gpu/drm/amd/amdkfd/kfd_device.c | 13 +++++++++++++<br class=""> 4 files changed, 26 insertions(+)<br class=""> <br class=""> diff --git a/drivers/gpu/drm/amd/amdgpu/amdgpu_amdkfd.c b/drivers/gpu/drm/amd/amdgpu/amdgpu_amdkfd.c<br class=""> index c18c4be1e4ac..d50011bdb5c4 100644<br class=""> --- a/drivers/gpu/drm/amd/amdgpu/amdgpu_amdkfd.c<br class=""> +++ b/drivers/gpu/drm/amd/amdgpu/amdgpu_amdkfd.c<br class=""> @@ -213,6 +213,11 @@ int amdgpu_amdkfd_resume(struct amdgpu_device *adev, bool run_pm)<br class=""> return r;<br class=""> }<br class=""> <br class=""> +int amdgpu_amdkfd_resume_processes(void)<br class=""> +{<br class=""> + return kgd2kfd_resume_processes();<br class=""> +}<br class=""> +<br class=""> int amdgpu_amdkfd_pre_reset(struct amdgpu_device *adev)<br class=""> {<br class=""> int r = 0;<br class=""> diff --git a/drivers/gpu/drm/amd/amdgpu/amdgpu_amdkfd.h b/drivers/gpu/drm/amd/amdgpu/amdgpu_amdkfd.h<br class=""> index f8b9f27adcf5..803306e011c3 100644<br class=""> --- a/drivers/gpu/drm/amd/amdgpu/amdgpu_amdkfd.h<br class=""> +++ b/drivers/gpu/drm/amd/amdgpu/amdgpu_amdkfd.h<br class=""> @@ -140,6 +140,7 @@ void amdgpu_amdkfd_fini(void);<br class=""> void amdgpu_amdkfd_suspend(struct amdgpu_device *adev, bool run_pm);<br class=""> int amdgpu_amdkfd_resume_iommu(struct amdgpu_device *adev);<br class=""> int amdgpu_amdkfd_resume(struct amdgpu_device *adev, bool run_pm);<br class=""> +int amdgpu_amdkfd_resume_processes(void);<br class=""> void amdgpu_amdkfd_interrupt(struct amdgpu_device *adev,<br class=""> const void *ih_ring_entry);<br class=""> void amdgpu_amdkfd_device_probe(struct amdgpu_device *adev);<br class=""> @@ -347,6 +348,7 @@ void kgd2kfd_device_exit(struct kfd_dev *kfd);<br class=""> void kgd2kfd_suspend(struct kfd_dev *kfd, bool run_pm);<br class=""> int kgd2kfd_resume_iommu(struct kfd_dev *kfd);<br class=""> int kgd2kfd_resume(struct kfd_dev *kfd, bool run_pm);<br class=""> +int kgd2kfd_resume_processes(void);<br class=""> int kgd2kfd_pre_reset(struct kfd_dev *kfd);<br class=""> int kgd2kfd_post_reset(struct kfd_dev *kfd);<br class=""> void kgd2kfd_interrupt(struct kfd_dev *kfd, const void *ih_ring_entry);<br class=""> @@ -393,6 +395,11 @@ static inline int kgd2kfd_resume(struct kfd_dev *kfd, bool run_pm)<br class=""> return 0;<br class=""> }<br class=""> <br class=""> +static inline int kgd2kfd_resume_processes(void)<br class=""> +{<br class=""> + return 0;<br class=""> +}<br class=""> +<br class=""> static inline int kgd2kfd_pre_reset(struct kfd_dev *kfd)<br class=""> {<br class=""> return 0;<br class=""> diff --git a/drivers/gpu/drm/amd/amdgpu/amdgpu_device.c b/drivers/gpu/drm/amd/amdgpu/amdgpu_device.c<br class=""> index fa4a9f13c922..5827b65b7489 100644<br class=""> --- a/drivers/gpu/drm/amd/amdgpu/amdgpu_device.c<br class=""> +++ b/drivers/gpu/drm/amd/amdgpu/amdgpu_device.c<br class=""> @@ -4004,6 +4004,7 @@ void amdgpu_device_fini_hw(struct amdgpu_device *adev)<br class=""> if (drm_dev_is_unplugged(adev_to_drm(adev)))<br class=""> amdgpu_device_unmap_mmio(adev);<br class=""> <br class=""> + amdgpu_amdkfd_resume_processes();<br class=""> }<br class=""> <br class=""> void amdgpu_device_fini_sw(struct amdgpu_device *adev)<br class=""> diff --git a/drivers/gpu/drm/amd/amdkfd/kfd_device.c b/drivers/gpu/drm/amd/amdkfd/kfd_device.c<br class=""> index 62aa6c9d5123..ef05aae9255e 100644<br class=""> --- a/drivers/gpu/drm/amd/amdkfd/kfd_device.c<br class=""> +++ b/drivers/gpu/drm/amd/amdkfd/kfd_device.c<br class=""> @@ -714,6 +714,19 @@ int kgd2kfd_resume(struct kfd_dev *kfd, bool run_pm)<br class=""> return ret;<br class=""> }<br class=""> <br class=""> +/* for non-runtime resume only */<br class=""> +int kgd2kfd_resume_processes(void)<br class=""> +{<br class=""> + int count;<br class=""> +<br class=""> + count = atomic_dec_return(&kfd_locked);<br class=""> + WARN_ONCE(count < 0, "KFD suspend / resume ref. error");<br class=""> + if (count == 0)<br class=""> + return kfd_resume_all_processes();<br class=""> +<br class=""> + return 0;<br class=""> +}<br class=""> </blockquote> <br class=""> It doesn't make sense to me to just increment kfd_locked in<br class=""> kgd2kfd_suspend to only decrement it again a few functions down the<br class=""> road.<br class=""> <br class=""> I suggest this instead - you only incrmemnt if not during PCI remove<br class=""> <br class=""> diff --git a/drivers/gpu/drm/amd/amdkfd/kfd_device.c<br class=""> b/drivers/gpu/drm/amd/amdkfd/kfd_device.c<br class=""> index 1c2cf3a33c1f..7754f77248a4 100644<br class=""> --- a/drivers/gpu/drm/amd/amdkfd/kfd_device.c<br class=""> +++ b/drivers/gpu/drm/amd/amdkfd/kfd_device.c<br class=""> @@ -952,11 +952,12 @@ bool kfd_is_locked(void)<br class=""> <br class=""> void kgd2kfd_suspend(struct kfd_dev *kfd, bool run_pm)<br class=""> {<br class=""> +<br class=""> if (!kfd->init_complete)<br class=""> return;<br class=""> <br class=""> /* for runtime suspend, skip locking kfd */<br class=""> - if (!run_pm) {<br class=""> + if (!run_pm && !drm_dev_is_unplugged(kfd->ddev)) {<br class=""> /* For first KFD device suspend all the KFD processes */<br class=""> if (atomic_inc_return(&kfd_locked) == 1)<br class=""> kfd_suspend_all_processes();<br class=""> <br class=""> <br class=""> Andrey<br class=""> <br class=""> <br class=""> <br class=""> <blockquote type="cite" class="">+<br class=""> int kgd2kfd_resume_iommu(struct kfd_dev *kfd)<br class=""> {<br class=""> int err = 0;</blockquote> </blockquote> </blockquote> </div> </blockquote> </div> <br class=""> </blockquote> </div> </div> </blockquote> </div> <br class=""> </blockquote> </div> </blockquote> </div> <br class=""> </div> </blockquote> </div> </div> </blockquote> </div> <br class=""> </blockquote> </div> </div> </blockquote> </div> <br class=""> </blockquote> </div> </div> </blockquote> </div> <br class=""> </body> </html>