[Xcb] Bug#486507: libx11-6: Locking assertion failure with vmware-server-console

[Julien Cristau]

Hi XCB list,

it seems that there's a bad interaction between Xlib/XCB and vmware,
that leads to assertion failures inside xcb_lock.c, even with sloppy
locking enabled.  The backtrace below points to libXrender, but seems to
also happen using the system libXrender.
This is with libX11 1.1.4 and libxcb 1.1.

Thanks,
Julien

On Mon, Jun 16, 2008 at 10:24:20 -0400, Rick Gatewood wrote:

> Version libx11- 2:1.1.4-2 (unstable) gives following error with vmware-server-console:
> 
> Locking assertion failure.  Backtrace:
> #0 /usr/lib/libxcb-xlib.so.0 [0xb7018767]
> #1 /usr/lib/libxcb-xlib.so.0(xcb_xlib_unlock+0x31) [0xb70188b1]
> #2 /usr/lib/libX11.so.6(_XReply+0x244) [0xb7e8cc14]
> #3 /usr/lib/vmware/lib/libXrender.so.1/libXrender.so.1(XRenderQueryFormats+0x109) [0xb7d78969]
> #4 /usr/lib/vmware/lib/libXrender.so.1/libXrender.so.1(XRenderFindFormat+0x4c) [0xb7d78f4c]
> #5 /usr/lib/vmware/lib/libgdk-x11-2.0.so.0/libgdk-x11-2.0.so.0 [0xb7bbe180]
> #6 /usr/lib/vmware/lib/libgdk-x11-2.0.so.0/libgdk-x11-2.0.so.0 [0xb7bbed2c]
> #7 /usr/lib/vmware/lib/libgdk-x11-2.0.so.0/libgdk-x11-2.0.so.0(gdk_draw_pixbuf+0x270) [0xb7b8ec14]
> #8 /usr/lib/vmware/lib/libgdk-x11-2.0.so.0/libgdk-x11-2.0.so.0 [0xb7b9b24f]
> #9 /usr/lib/vmware/lib/libgdk-x11-2.0.so.0/libgdk-x11-2.0.so.0(gdk_draw_pixbuf+0x270) [0xb7b8ec14]
> #10 /usr/lib/vmware/lib/libgdk-x11-2.0.so.0/libgdk-x11-2.0.so.0(gdk_pixbuf_render_pixmap_and_mask_for_colormap+0x255) 
> [0xb7b9ab34]
> #11 /usr/lib/vmware/lib/libgtk-x11-2.0.so.0/libgtk-x11-2.0.so.0 [0xb7a9f298]
> #12 /usr/lib/vmware/lib/libgtk-x11-2.0.so.0/libgtk-x11-2.0.so.0 [0xb7a9f586]
> #13 /usr/lib/vmware/lib/libgtk-x11-2.0.so.0/libgtk-x11-2.0.so.0 [0xb7aa177e]
> #14 /usr/lib/vmware/lib/libgobject-2.0.so.0/libgobject-2.0.so.0(g_cclosure_marshal_VOID__VOID+0xd1) [0xb7cb4459]
> #15 /usr/lib/vmware/lib/libgobject-2.0.so.0/libgobject-2.0.so.0 [0xb7c9c3a1]
> #16 /usr/lib/vmware/lib/libgobject-2.0.so.0/libgobject-2.0.so.0(g_closure_invoke+0x1b1) [0xb7c9c076]
> #17 /usr/lib/vmware/lib/libgobject-2.0.so.0/libgobject-2.0.so.0 [0xb7cb36eb]
> #18 /usr/lib/vmware/lib/libgobject-2.0.so.0/libgobject-2.0.so.0(g_signal_emit_valist+0x91e) [0xb7cb2d46]
> #19 /usr/lib/vmware/lib/libgobject-2.0.so.0/libgobject-2.0.so.0(g_signal_emit+0x38) [0xb7cb30b8]
> Locking assertion failure.  Backtrace:
> #0 /usr/lib/libxcb-xlib.so.0 [0xb7018767]
> #1 /usr/lib/libxcb-xlib.so.0(xcb_xlib_lock+0x2e) [0xb701881e]
> #2 /usr/lib/libX11.so.6 [0xb7e8bdc9]
> #3 /usr/lib/libX11.so.6(XAddExtension+0x2c) [0xb7e6e23c]
> #4 /usr/lib/vmware/lib/libXft.so.2/libXft.so.2(_XftDisplayInfoGet+0x77) [0xb7d70ed7]
> #5 /usr/lib/vmware/lib/libXft.so.2/libXft.so.2 [0xb7d6f8b1]
> #6 /usr/lib/vmware/lib/libXft.so.2/libXft.so.2 [0xb7d6fd39]
> #7 /usr/lib/vmware/lib/libXft.so.2/libXft.so.2(XftDrawPicture+0x10) [0xb7d6fec0]
> #8 /usr/lib/vmware/lib/libgdk-x11-2.0.so.0/libgdk-x11-2.0.so.0 [0xb7bbc9b6]
> #9 /usr/lib/vmware/lib/libgdk-x11-2.0.so.0/libgdk-x11-2.0.so.0 [0xb7bbed75]
> #10 /usr/lib/vmware/lib/libgdk-x11-2.0.so.0/libgdk-x11-2.0.so.0(gdk_draw_pixbuf+0x270) [0xb7b8ec14]
> #11 /usr/lib/vmware/lib/libgdk-x11-2.0.so.0/libgdk-x11-2.0.so.0 [0xb7b9b24f]
> #12 /usr/lib/vmware/lib/libgdk-x11-2.0.so.0/libgdk-x11-2.0.so.0(gdk_draw_pixbuf+0x270) [0xb7b8ec14]
> #13 /usr/lib/vmware/lib/libgdk-x11-2.0.so.0/libgdk-x11-2.0.so.0(gdk_pixbuf_render_pixmap_and_mask_for_colormap+0x255) 
> [0xb7b9ab34]
> #14 /usr/lib/vmware/lib/libgtk-x11-2.0.so.0/libgtk-x11-2.0.so.0 [0xb7a9f298]
> #15 /usr/lib/vmware/lib/libgtk-x11-2.0.so.0/libgtk-x11-2.0.so.0 [0xb7a9f586]
> #16 /usr/lib/vmware/lib/libgtk-x11-2.0.so.0/libgtk-x11-2.0.so.0 [0xb7aa177e]
> #17 /usr/lib/vmware/lib/libgobject-2.0.so.0/libgobject-2.0.so.0(g_cclosure_marshal_VOID__VOID+0xd1) [0xb7cb4459]
> #18 /usr/lib/vmware/lib/libgobject-2.0.so.0/libgobject-2.0.so.0 [0xb7c9c3a1]
> #19 /usr/lib/vmware/lib/libgobject-2.0.so.0/libgobject-2.0.so.0(g_closure_invoke+0x1b1) [0xb7c9c076]
> vmware: ../../src/xcb_lock.c:77: _XGetXCBBuffer: assertion  `((int) ((xcb_req) - (dpy->request)) >= 0)' failed 
> 
> 
> Downgrade to 2:1.0.3-7 (testing) fixed the issue and application runs normally
> 
> -- no debconf information