Just download the .diff.gz from kernel-source instead and run the included prune-non-free script. kernel-patch-debian is a useless package.