https://bugs.freedesktop.org/show_bug.cgi?id=91197
--- Comment #11 from dennis.jansen@web.de --- I've found a workaround:
xrandr --newmode "3840x2160_30" 262.92 3840 3888 3920 4000 2160 2163 2168 2191 +hsync xrandr --addmode HDMI-0 "3840x2160_30" xrandr --output HDMI-0 --mode 3840x2160_30
I'm guessing the pixel clock might have been too high. Same problem with the Windows driver. The page (http://www.epanorama.net/faq/vga2rgb/calc.html) allowed me to convert the modeline with lower clock created with cru (http://www.monitortests.com/forum/Thread-Custom-Resolution-Utility-CRU) in Windows to Linux. I was pleasantly surprised to find even vdpau working well, of course only up to FullHD video, but smooth playback on 4k resolution.