I would talk more with the upstream. Does the patch break ispell? Is it not possible to incorporate it? Simply "it is not significant" makes no sense. Work with them, see how you can get it in. Otherwise, have the non Intel people start complaining to this person. If it is not a Debian specific problem I see no reason for them to turn down a patch.