Installing the git version of the driver seems to solve the problem I had. I had a very similar problem but my display was not unrestorable only when I switched to VT but also on suspend-to-disk, -to-ram, logout, shutdown, reboot... Systematically my computer hard freeze.