I can disable nouveau-module and do a workaround by recompiling the kernel and copying the nvidia.ko module to /lib/module and do modprobe nvidia. And I am using proprietary NVIDIA driver for Linux on Debian flavours. I found this works for my machine.
Why can't both of them coexist with each other?