I have had Debian up on my Xiamo smartphone. I believe it uses the existing kernel. Had a xwindows as well but did not like the interface. In the end, question was what to do with it.