<html> <head> <base href="https://bugs.freedesktop.org/"> </head> <body> <div> <a class="bz_bug_link bz_status_NEW " title="NEW - segfault in radeonsi HEVC hardware decoding with yuv420p10le" href="https://bugs.freedesktop.org/show_bug.cgi?id=110702#c11">Comment # 11</a> on <a class="bz_bug_link bz_status_NEW " title="NEW - segfault in radeonsi HEVC hardware decoding with yuv420p10le" href="https://bugs.freedesktop.org/show_bug.cgi?id=110702">bug 110702</a> from <a class="email" href="mailto:pierre-eric.pelloux-prayer@amd.com" title="Pierre-Eric Pelloux-Prayer <pierre-eric.pelloux-prayer@amd.com>"> Pierre-Eric Pelloux-Prayer</a> <pre>(In reply to Christian König from <a href="show_bug.cgi?id=110702#c10">comment #10</a>) > (In reply to Pierre-Eric Pelloux-Prayer from <a href="show_bug.cgi?id=110702#c9">comment #9</a>) > > The driver fails when trying to allocate a buffer for this video with a > > ENOMEM error (the requested size is 3 GB). > > Well that strongly sounds like we miscalculated the necessary size somewhere. Indeed. The size is computed by the `calc_ctx_size_h265_main10()` function. I'm not familiar enough with hevc to fix it though (but the calculation seems to overflow because context_buffer_size_per_ctb_row is 1GB and is multiplied by max_references (= 23) and the result is stored in an unsigned int).</pre> </div> <hr> You are receiving this mail because: <ul> <li>You are the assignee for the bug.</li> </ul> </body> </html>