There are no "deep source dependencies".There is really nothing wrong with sharing install-sh & friends. Lots of packages do it.
You can delete all the directories except libffi (and possibly config),and delete all the files at the top level and 'config' which are under the GPL, and you can still build libffi by the method Matthias noted.
Feel free.