That's something that I always wondered about but never got the time to debug,but:
If you have Nvidia and wants to use their driver on Ubuntu, it's pretty straightforward and a no-brainer using their (Ubuntu's) driver installation tool.
If you're using Debian, you very very likely will end up with a system who does not start any DE and is greeted but the terminal.
--
Samuel Henrique <samueloph>