[Mesa-dev] Segmentation fault with VTK OffScreenRendering

[Joshua Daniel Franklin (UW Seattle)]

Hello,

I'm working on a server-based VTK application that renders snapshots of 
3D (STL meshes). We're working on 64-bit Fedora 15 but I can try out 
another platform if necessary. The application works fine with an X11 
DISPLAY using hardware GL but crashes when we try to use Mesa only. I 
decided to go to the very basic VTK_OPENGL_HAS_OSMESA 
OffScreenRendering.cxx example:

http://www.vtk.org/pipermail/vtkusers/2010-February/106222.html

So I've compiled Mesa-7.11.2 and VTK 5.8.0 and get the following 
segfault, debug info from gdb:


Starting program: /home/machbuild/build/OffScreenRendering
[Thread debugging using libthread_db enabled]

Program received signal SIGSEGV, Segmentation fault.
vbo_exec_EvalCoord1fv (u=0x203) at vbo/vbo_exec_api.c:498
498	   vbo_exec_EvalCoord1f( u[0] );


A search for that "vbo_exec_EvalCoord1fv" error led me to this 2010 thread
between VTK and Mesa developers, which ends with "I'll try name mangling
when I get to work" so I wonder if it got forgotten about:
http://lists.freedesktop.org/archives/mesa-dev/2010-August/001993.html

In the meantime, I built Mesa-7.6.1 and the OffScreenRendering example 
works.

I'm building Mesa with just "make linux-x86-64" and VTK with the following:

     cd VTK_Build/
     cmake \
         -D 
OPENGL_INCLUDE_DIR:PATH=/home/machbuild/build/Mesa-7.11.2/include/ \
         -D 
OPENGL_gl_LIBRARY:FILEPATH=/home/machbuild/build/Mesa-7.11.2/lib64/libGL.so 
\
         -D 
OPENGL_glu_LIBRARY:FILEPATH=/home/machbuild/build/Mesa-7.11.2/lib64/libGLU.so 
\
         -D VTK_OPENGL_HAS_OSMESA:BOOL=ON \
         -D 
OSMESA_INCLUDE_DIR:PATH=/home/machbuild/build/Mesa-7.11.2/include/ \
         -D 
OSMESA_LIBRARY:FILEPATH=/home/machbuild/build/Mesa-7.11.2/lib64/libOSMesa.so 
\
         ../VTK


Any ideas?

Thanks,
Joshua