SUMMARIZE: Re: Sorting huge files

From: Thomas Chung (tchung@us.dhl.com)
Date: Tue Feb 01 2000 - 12:58:08 CST


I like to thank everyone who took the time to answer my inquiry. You know
who you are.

Here were the suggestions:

o Use Syncsort, which is a commercial product, and seem to be exactly what
   we're looking for; see http://www.syncsort.com/infosu.htm

o Break up your file into smaller chunk and do a merge-sort.

o Use the GNU version of sort.

o Use perl.

Thomas Chung wrote:
>
> We have a need of sorting huge files (approaching 2gig), and we're currently
> using the UNIX sort command to do so. As you can imagine this is not very
> efficient--at least to us. Are there any other sort ultility out there that
> sort extremely large, flat ascii file very fast?
>
> Will summarize.
>
> Thanks.



This archive was generated by hypermail 2.1.2 : Fri Sep 28 2001 - 23:14:02 CDT