apt-get remove <package> deletes the program but leaves config files, apt-get remove --purge <package> deletes everything.