Page 1 of 1
Removing duplicate
Posted: Fri Feb 15, 2002 2:22 pm
by Marteinn Sverrisson
1) Can I remove duplicated lines with Textpad?
2) Can I remove lines that have the first x characters the same as another line?
Re: Removing duplicate
Posted: Fri Feb 15, 2002 5:07 pm
by Andreas
1) can be done when sorting the file
2) ? (don't know of a way to do it)
Re: Removing duplicate
Posted: Fri Feb 15, 2002 11:29 pm
by Roy Beatty
You cannot do it through Sort.
How would you decide which of the two lines to keep?
Re: Removing duplicate
Posted: Mon Feb 18, 2002 3:02 pm
by Marteinn Sverrisson
>How would you decide which of the two lines to keep?
It would be the first instance
Re: Removing duplicate
Posted: Wed Feb 20, 2002 12:04 am
by Roy Beatty
It sounds like a database might serve your purpose better than a flat text file.
Re: Removing duplicate
Posted: Tue Feb 26, 2002 10:15 pm
by Geoff Houck
If you'd like, I can send you a simple command-line text-sorting utility which allows
you to sort and remove duplicates based on the sort keys or whole record (arbitrarily picking one or more of them to delete).
Or, you can find the utility at:
http://home.attbi.com/~hksys (go to the Download
page, and download FSORT).
Or, drop a line at the above address or
hksys@attbi.com.
Yours,
Geoff Houck