Re: Removing duplicate text
I've tried uniq, but it didn't resolve the problem. I got the same file
back after trying it. So I took the LaTeX route (it's a LaTeX file).
I started up RefTeX to see which parts are identical, jumped with RefTeX
to that part and deleted it by hand. It's not full-proof, but I think
most (if not all) of the duplicate text is gone now.
I also saw this pointer:
http://www.ibm.com/developerworks/linux/library/l-tiptex6.html
I didn't try it.
Wilfred
Op zo, 24-05-2009 te 13:40 -0400, schreef Tony Baldwin:
> Nyizsnyik Ferenc wrote:
> > On Sun, 24 May 2009 12:54:42 -0400
> > Tony Baldwin <photodharma@gmail.com> wrote:
> >
> >> Wilfred Zegwaard wrote:
> >>> Dear users,
> >>>
> >>> I've got a textfile with a lot of duplicate text. How do I remove
> >>> it? I'm using Emacs 21.
> >>>
> >>> Wilfred
> >>>
> >>>
> >> That seems like a very general question, and one which has a broad
> >> plethora of answers.
> >
> > Exactly; here is a simple one:
> > uniq -u infile outfile
>
> Wow, that's cool. I never saw uniq before.
> I just read the man and tried it out.
> Wouldn't he just want
> uniq infile outfile
> since -u option will remove all instances
> of a repeated element, where as uniq f1 f2
> will leave one instance of said repeating element?
>
> I did
> for 1 in 1 2 3 4 5 6 7 8 9; do echo banana >> banana; done
> then echo "orange you glad I didn't say banana? " >> banana
> then
> uniq -u banana orange
> cat orange
> orange you glad I didn't say banana?
>
> then did
> uniq banana orange # no -u
> cat orange
> banana
> orange you glad I didn't say banana?
>
> so it kept one banana.
>
> /tony
>
>
> --
> http://www.photodharma.com
> art & photos | tony baldwin
>
>
Reply to: