You can pass the init=3 parameter to the kernel at boot time to start in runlevel 3 which should be console only, with networking. Now, in debian for some reason I don't undestand, runlevels 2, 3 and 5 have the same init scripts, so you have to fix that first.