If I compile patched kernels and something unneeded can't build, I simply disable it by the configuration. I don't know if it's possible in your case, but I would test it.