Ok, so after some investigation, I found that the segfault is not caused by a video driver (it happens with binary nvidia driver too). Commenting out Files and ServerFlags sections (i.e. disabling font servers) removed the segfault. Could you please move the bug to a more appropriate package?