boot hang with vmwgfx on 4.5-rc6

[Thomas Hellstrom]

Hi!

Thanks for reporting. It appears that on hardware version 9, we get a
NULL pointer dereference
on kernel 4.5.

[   15.298499] BUG: unable to handle kernel NULL pointer dereference
at           (null)
[   15.301027] IP: [<          (null)>]           (null)
[   15.302590] PGD 0
[   15.303276] Oops: 0010 [#1] SMP
[   15.304385] Modules linked in: xt_conntrack ebtable_filter
ebtable_nat ebtable_broute bridge stp llc ebtables ip6table_security
ip6table_raw ip6table_mangle ip6table_nat nf_conntrack_ipv6
nf_defrag_ipv6 nf_nat_ipv6 ip6table_filter ip6_tables iptable_security
iptable_raw iptable_mangle iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4
nf_nat_ipv4 nf_nat nf_conntrack vmw_vsock_vmci_transport vsock
snd_seq_midi bnep snd_seq_midi_event btusb btrtl snd_ens1371 gameport
btbcm snd_ac97_codec btintel ppdev ac97_bus snd_seq coretemp
crct10dif_pclmul crc32_pclmul bluetooth snd_pcm crc32c_intel vmw_balloon
ghash_clmulni_intel snd_rawmidi snd_timer snd_seq_device snd rfkill
soundcore vmw_vmci shpchp i2c_piix4 nfit parport_pc parport acpi_cpufreq
nfsd auth_rpcgss nfs_acl lockd grace sunrpc vmwgfx serio_raw
drm_kms_helper vmw_pvscsi vmxnet3 ttm drm ata_generic pata_acpi
[   15.330004] CPU: 1 PID: 1075 Comm: gnome-shell Not tainted 4.5.0-rc6 #1
[   15.332000] Hardware name: VMware, Inc. VMware Virtual Platform/440BX
Desktop Reference Platform, BIOS 6.00 07/02/2015
[   15.335179] task: ffff880077394b00 ti: ffff8800773a8000 task.ti:
ffff8800773a8000
[   15.337411] RIP: 0010:[<0000000000000000>]  [<         
(null)>]           (null)
[   15.339729] RSP: 0018:ffff8800773abc50  EFLAGS: 00010246
[   15.341335] RAX: ffffffffa00ed640 RBX: ffff880036171000 RCX:
ffff880036173770
[   15.343470] RDX: 0000000000002000 RSI: 0000000000002000 RDI:
ffff8800361734b8
[   15.345605] RBP: ffff8800773abd18 R08: 0000000000000000 R09:
0000000000000000
[   15.347798] R10: 0000000000000000 R11: 0000000000000000 R12:
ffff8800361734e0
[   15.349929] R13: ffff880036171000 R14: ffff8800773abd60 R15:
00000000fffffffe
[   15.352096] FS:  00007fb347faca80(0000) GS:ffff88007c640000(0000)
knlGS:0000000000000000
[   15.354513] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[   15.356230] CR2: 0000000000000000 CR3: 000000007739f000 CR4:
00000000001406e0
[   15.358427] Stack:
[   15.359092]  ffffffffa0024535 ffff8800773abc68 ffffffff811196cd
ffff880036173764
[   15.361477]  ffff880036173770 0000000000000001 ffff880036171410
ffff880000000001
[   15.364091]  ffff880079f38000 0000000000000000 00000000812059bd
0000000000000000
[   15.366488] Call Trace:
[   15.367278]  [<ffffffffa0024535>] ? drm_mode_getconnector+0x375/0x400
[drm]
[   15.369515]  [<ffffffff811196cd>] ? debug_lockdep_rcu_enabled+0x1d/0x20
[   15.371537]  [<ffffffffa0015c72>] drm_ioctl+0x152/0x560 [drm]
[   15.373295]  [<ffffffffa00241c0>] ? drm_mode_getcrtc+0x150/0x150 [drm]
[   15.375268]  [<ffffffffa00cf56d>] vmw_generic_ioctl+0x17d/0x280 [vmwgfx]
[   15.377277]  [<ffffffffa0015b20>] ? drm_getmap+0xe0/0xe0 [drm]
[   15.379044]  [<ffffffffa00cf6a5>] vmw_unlocked_ioctl+0x15/0x20 [vmwgfx]
[   15.381043]  [<ffffffff8126e5a2>] do_vfs_ioctl+0xa2/0x690
[   15.382684]  [<ffffffff8127acbf>] ? __fget+0x11f/0x200
[   15.384249]  [<ffffffff8127aba5>] ? __fget+0x5/0x200
[   15.385760]  [<ffffffff8126ec09>] SyS_ioctl+0x79/0x90
[   15.387296]  [<ffffffff8182daf2>] entry_SYSCALL_64_fastpath+0x12/0x76
[   15.389246] Code:  Bad RIP value.
[   15.390375] RIP  [<          (null)>]           (null)
[   15.391992]  RSP <ffff8800773abc50>
[   15.393081] CR2: 0000000000000000
[   15.394174] ---[ end trace f9f3f138ca13da13 ]---

On 02/29/2016 10:38 PM, Sebastian Herbszt wrote:
> Hello,
>
> I get a boot hang with vmwgfx on 4.5-rc6 (4.5.0-rc6-1.gb239884-default from
> openSUSE). This happens on VMware Player 5.0.2.
> Same VM works fine with kernel 4.4 but on 4.5-rc6 it hangs with
>
> [drm] Initialized vmwgfx 2.9.0 20150810 for 0000:00:0f.0 on minor 0
>
> I am able to boot the system with "nomodeset".
>
> Sebastian
> _______________________________________________
> dri-devel mailing list
> dri-devel at lists.freedesktop.org
> https://lists.freedesktop.org/mailman/listinfo/dri-devel