I too would like to see xdvi in a different package than tetex-bin. LaTeX is a very useful system without X and I don't think the X libs and X Athena toolkit should be required for its installation. I think that moving xdvi and any other X tools into their own package would be a rational and clean thing to do.