<html> <head> <meta http-equiv="Content-Type" content="text/html; charset=iso-8859-1"> <style type="text/css" style="display:none;"></style> </head> <body dir="ltr"> <div id="divtagdefaultwrapper" style="font-size:12pt;color:#000000;font-family:Calibri,Arial,Helvetica,sans-serif;"> <p>Hi Christian,</p> <p><br> </p> <p>I agree with the crux of your argument but you can crash the system with carefully timed read/writes from the GFX registers, or MC, or ... That's why the entries are root only.</p> <p><br> </p> <p>The issue with locking excessively is you might change behaviour of something you're trying to debug because the kernel then has to wait on the lock (or you're waiting on the lock). For instance, suppose you want to read DCE registers and the kernel is doing some gfx/grbm related your DCE read will either block the GFX activity or you're waiting on it which means the behaviour of the system could be different than from the case where you're not probing the registers.</p> <p><br> </p> <p>The goal is to be as unobtrusive as possible. Heck I often mmap the BAR so I can read MMIO registers directly and not waste CPU cycles on syscalls.</p> <div><br> </div> The PM lock is because reading PGFSM registers during a powerup/down results in a GPU hang, and we only take the GRBM lock when users want to read from specific banks. For any other case we don't need a lock. In the kernel they should be mutually exclusive. The PM lock is only taken in PP when performing a transition (or initializing the core) and I have yet to see a place where PP/PM related code also grabs the grbm index lock. <div><br> </div> <div>I don't have strong feelings against your proposal but I do prefer not to take the locks when I don't need to. Ultimately I'll leave the decision up to you and Alex. I'd like to get the 2nd patch through though as it makes the write side of the mmio reg complimentary (e.g. bank selection/pm lock).<br> <div><br> </div> <div>Cheers,</div> <div>Tom<br> <br> <div style="color: rgb(0, 0, 0);"> <hr tabindex="-1" style="display:inline-block; width:98%"> <div id="divRplyFwdMsg" dir="ltr"><font face="Calibri, sans-serif" color="#000000" style="font-size:11pt"><b>From:</b> Christian König <deathsimple@vodafone.de><br> <b>Sent:</b> Tuesday, October 11, 2016 08:11<br> <b>To:</b> StDenis, Tom; amd-gfx@lists.freedesktop.org<br> <b>Subject:</b> Re: [PATCH] drm/amd/amdgpu: Make debugfs write compliment read</font> <div> </div> </div> <div> <div class="moz-cite-prefix"> <blockquote type="cite"> <p>The only downside to taking the locks all the time is for 99% of debug reads it's unnecessary and in theory could lead to performance/behaviour problems.</p> </blockquote> Yeah, but performance isn't critical here and taking two locks compared to the rest of what we (IOCTL etc...) do is completely negligibly. <br> <br> <blockquote type="cite"> <p>I've been using this on read for a while now and haven't noticed a problem.</p> </blockquote> My concern is rather that somebody tries to write to the PM regs on accident or purpose without taking the lock.<br> <br> See, the kernel is usually responsible to keep people from doing stupid things with the hardware, even if those people are root and could do stupid things anyway. Well, you know what I mean?<br> <br> Regards,<br> Christian.<br> <br> Am 10.10.2016 um 22:21 schrieb StDenis, Tom:<br> </div> <blockquote type="cite"> <div id="divtagdefaultwrapper" style="font-size:12pt; color:#000000; font-family:Calibri,Arial,Helvetica,sans-serif"> <p>The only downside to taking the locks all the time is for 99% of debug reads it's unnecessary and in theory could lead to performance/behaviour problems.</p> <p><br> </p> <p>I've been using this on read for a while now and haven't noticed a problem.</p> <p><br> </p> <p>Tom</p> <br> <br> <div style="color:rgb(0,0,0)"> <hr tabindex="-1" style="display:inline-block; width:98%"> <div id="divRplyFwdMsg" dir="ltr"><font color="#000000" face="Calibri, sans-serif" style="font-size:11pt"><b>From:</b> Christian König <a class="moz-txt-link-rfc2396E" href="mailto:deathsimple@vodafone.de"><deathsimple@vodafone.de></a><br> <b>Sent:</b> Monday, October 10, 2016 09:49<br> <b>To:</b> Tom St Denis; <a class="moz-txt-link-abbreviated" href="mailto:amd-gfx@lists.freedesktop.org"> amd-gfx@lists.freedesktop.org</a><br> <b>Cc:</b> StDenis, Tom<br> <b>Subject:</b> Re: [PATCH] drm/amd/amdgpu: Make debugfs write compliment read</font> <div> </div> </div> <div> <div class="moz-cite-prefix">Would it hurt us to always take the looks (both the pm as well as grbm idx lock)?<br> <br> I don't think that would be much of an issue and I would have a better feeling with that.<br> <br> Christian.<br> <br> Am 10.10.2016 um 15:38 schrieb Tom St Denis:<br> </div> <blockquote type="cite"> <p dir="ltr">that's kind of the point. Its for debugging only. Also reads can already lock</p> <br> <div class="gmail_quote"> <div dir="ltr">On Mon, Oct 10, 2016, 09:25 Christian König <<a href="mailto:deathsimple@vodafone.de">deathsimple@vodafone.de</a>> wrote:<br> </div> <blockquote class="gmail_quote" style="margin:0 0 0 .8ex; border-left:1px #ccc solid; padding-left:1ex"> Mhm, that userspace controls if the lock is taken or not is a bit<br class="gmail_msg"> problematic, on the other hand only root could access that.<br class="gmail_msg"> <br class="gmail_msg"> Christian.<br class="gmail_msg"> <br class="gmail_msg"> Am 10.10.2016 um 14:51 schrieb Tom St Denis:<br class="gmail_msg"> > Add PG lock support as well as bank selection to<br class="gmail_msg"> > the MMIO write function.<br class="gmail_msg"> ><br class="gmail_msg"> > Signed-off-by: Tom St Denis <<a href="mailto:tom.stdenis@amd.com" class="gmail_msg" target="_blank">tom.stdenis@amd.com</a>><br class="gmail_msg"> > ---<br class="gmail_msg"> > drivers/gpu/drm/amd/amdgpu/amdgpu_device.c | 43 ++++++++++++++++++++++++++++++<br class="gmail_msg"> > 1 file changed, 43 insertions(+)<br class="gmail_msg"> ><br class="gmail_msg"> > diff --git a/drivers/gpu/drm/amd/amdgpu/amdgpu_device.c b/drivers/gpu/drm/amd/amdgpu/amdgpu_device.c<br class="gmail_msg"> > index 04c4aee70452..a9d83c1d7a43 100644<br class="gmail_msg"> > --- a/drivers/gpu/drm/amd/amdgpu/amdgpu_device.c<br class="gmail_msg"> > +++ b/drivers/gpu/drm/amd/amdgpu/amdgpu_device.c<br class="gmail_msg"> > @@ -2637,10 +2637,45 @@ static ssize_t amdgpu_debugfs_regs_write(struct file *f, const char __user *buf,<br class="gmail_msg"> > struct amdgpu_device *adev = f->f_inode->i_private;<br class="gmail_msg"> > ssize_t result = 0;<br class="gmail_msg"> > int r;<br class="gmail_msg"> > + bool pm_pg_lock, use_bank;<br class="gmail_msg"> > + unsigned instance_bank, sh_bank, se_bank;<br class="gmail_msg"> ><br class="gmail_msg"> > if (size & 0x3 || *pos & 0x3)<br class="gmail_msg"> > return -EINVAL;<br class="gmail_msg"> ><br class="gmail_msg"> > + /* are we reading registers for which a PG lock is necessary? */<br class="gmail_msg"> > + pm_pg_lock = (*pos >> 23) & 1;<br class="gmail_msg"> > +<br class="gmail_msg"> > + if (*pos & (1ULL << 62)) {<br class="gmail_msg"> > + se_bank = (*pos >> 24) & 0x3FF;<br class="gmail_msg"> > + sh_bank = (*pos >> 34) & 0x3FF;<br class="gmail_msg"> > + instance_bank = (*pos >> 44) & 0x3FF;<br class="gmail_msg"> > +<br class="gmail_msg"> > + if (se_bank == 0x3FF)<br class="gmail_msg"> > + se_bank = 0xFFFFFFFF;<br class="gmail_msg"> > + if (sh_bank == 0x3FF)<br class="gmail_msg"> > + sh_bank = 0xFFFFFFFF;<br class="gmail_msg"> > + if (instance_bank == 0x3FF)<br class="gmail_msg"> > + instance_bank = 0xFFFFFFFF;<br class="gmail_msg"> > + use_bank = 1;<br class="gmail_msg"> > + } else {<br class="gmail_msg"> > + use_bank = 0;<br class="gmail_msg"> > + }<br class="gmail_msg"> > +<br class="gmail_msg"> > + *pos &= 0x3FFFF;<br class="gmail_msg"> > +<br class="gmail_msg"> > + if (use_bank) {<br class="gmail_msg"> > + if ((sh_bank != 0xFFFFFFFF && sh_bank >= adev->gfx.config.max_sh_per_se) ||<br class="gmail_msg"> > + (se_bank != 0xFFFFFFFF && se_bank >= adev->gfx.config.max_shader_engines))<br class="gmail_msg"> > + return -EINVAL;<br class="gmail_msg"> > + mutex_lock(&adev->grbm_idx_mutex);<br class="gmail_msg"> > + amdgpu_gfx_select_se_sh(adev, se_bank,<br class="gmail_msg"> > + sh_bank, instance_bank);<br class="gmail_msg"> > + }<br class="gmail_msg"> > +<br class="gmail_msg"> > + if (pm_pg_lock)<br class="gmail_msg"> > + mutex_lock(&adev->pm.mutex);<br class="gmail_msg"> > +<br class="gmail_msg"> > while (size) {<br class="gmail_msg"> > uint32_t value;<br class="gmail_msg"> ><br class="gmail_msg"> > @@ -2659,6 +2694,14 @@ static ssize_t amdgpu_debugfs_regs_write(struct file *f, const char __user *buf,<br class="gmail_msg"> > size -= 4;<br class="gmail_msg"> > }<br class="gmail_msg"> ><br class="gmail_msg"> > + if (use_bank) {<br class="gmail_msg"> > + amdgpu_gfx_select_se_sh(adev, 0xffffffff, 0xffffffff, 0xffffffff);<br class="gmail_msg"> > + mutex_unlock(&adev->grbm_idx_mutex);<br class="gmail_msg"> > + }<br class="gmail_msg"> > +<br class="gmail_msg"> > + if (pm_pg_lock)<br class="gmail_msg"> > + mutex_unlock(&adev->pm.mutex);<br class="gmail_msg"> > +<br class="gmail_msg"> > return result;<br class="gmail_msg"> > }<br class="gmail_msg"> ><br class="gmail_msg"> <br class="gmail_msg"> <br class="gmail_msg"> </blockquote> </div> </blockquote> <p><br> </p> </div> </div> </div> </blockquote> <p><br> </p> </div> </div> </div> </div> </div> </body> </html>