Sort a huge file in UNIX

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

How to Modify a file content in UNIX and sort for only required fields ?

I have the below contents in a file after making the below curl call curl ... | grep -E "state|Rno" | paste -sd',\n' | grep "Disconnected" > test "state" : "Disconnected",, "Rno" : "5554f1d2" "state" : "Disconnected",, "Rno" : "10587563" "state" : "Disconnected",, "Rno" :...

2. Shell Programming and Scripting

How to print huge values in sqlplus variable in UNIX?

Hi, I ahve a unix code as below. sqlTxt=$* sqlReturn=`echo "set feedback off; set heading off; set term off; set verify off; set serveroutput on size unlimited set lin 1000; VARIABLE GV_return_val NUMBER; VARIABLE GV_script_error varchar2(4000); EXEC :GV_return_code := 0; EXEC...

3. UNIX for Dummies Questions & Answers

sort a unix file by 3rd column

Hi, Can anybody tell me how to sort a unix file by 3rd column and not by ltr? Please help Thanks in advance

4. Shell Programming and Scripting

Unix Scripting : Sort a Portion of a File and not the complete file

Need to sort a portion of a file in a Alphabetical Order. Example : The user adam is not sorted and the user should get sorted. I don't want the complete file to get sorted. Currently All_users.txt contains the following lines. ############## # ARS USERS ############## mike, Mike...

5. UNIX for Dummies Questions & Answers

Unable to sort file name in Unix

Hi, I'm unable to sort the files with the required names on Unix. Details have been enclosed:- Below are the fle name inside a folder, now i need to sort them in a way that they are group with the seconds occurance in the file name (E.g 01954,07947,06794) 01.01954.MXRS1.rcv...

6. UNIX for Advanced & Expert Users

Script to sort the files and append the extension .sort to the sorted version of the file

Hello all - I am to this forum and fairly new in learning unix and finding some difficulty in preparing a small shell script. I am trying to make script to sort all the files given by user as input (either the exact full name of the file or say the files matching the criteria like all files...

7. Shell Programming and Scripting

Comparision of two huge unix files - Reconcilation

Hi, I have two huge file; each one has approximately 150000 lines. I need to compare both of them and store the unmatched lines into a different file. I have searched for everything in google but did not get solution. Files are: File1 NRALBAMINDB20003726 NRALBAMINDB20003727...

8. UNIX for Dummies Questions & Answers

Mainframe to Unix. Huge file >5GB

Hi, The files are being zipped from mainframe to the UNIX server. I have to unzip huge files on AIX server which is too old. The UNZIP as well as gzip utility version is not able to handle it and if we have to install the latest version there is a lot of process which takes lot of process. Is...

9. Shell Programming and Scripting

UNix one-liner to sort a file

Hi everyone, I have a txt file as: >001.b1 GCTAGTGCTAGCTAGCTAGCATCGATCGAT >002.b1 CAGTCAGTCGTAGTGCTAGCTGATGCTCGT >003.b1 CGATCGTAGTCGTATCGATGCTGACGTAGG >002.g1 ATGCTGATCGACTAGCTAGTCGT >015.b1 CGATCTAGTAGTGCTAGTCGTTT >001.g1 ATGCTGATCGACTAGCTAGTCGT >003.g1 CGATGCTAGTCGATGCTGACGGG

10. Shell Programming and Scripting

File size limitation of unix sort command.

hi , iam trying to sort millions of records which is delimited and i cant able to use sort command more than 60 million..if i try to do so i got an message stating that "File size limit exceeded",Is there any file size limit for using sort command.. How can i solve this problem. thanks ...

LEARN ABOUT XFREE86

wrap-and-sort

WRAP-AND-SORT(1)					      General Commands Manual						  WRAP-AND-SORT(1)

NAME

       wrap-and-sort - wrap long lines and sort items in Debian packaging files

SYNOPSIS

       wrap-and-sort [options]

DESCRIPTION

       wrap-and-sort  wraps the package lists in Debian control files. By default the lists will only split into multiple lines if the entries are
       longer than 80 characters. wrap-and-sort sorts the package lists in Debian control files and all .install files. Beside that  wrap-and-sort
       removes trailing spaces in these files.

       This  script should be run in the root of a Debian package tree. It searches for control, control.in, copyright, copyright.in, install, and
       *.install in the debian directory.

OPTIONS

       -h, --help
	      Show this help message and exit.

       -a, --wrap-always
	      Wrap all package lists in the Debian control file even if the entries are shorter than 80 characters and could fit in one line line.

       -s, --short-indent
	      Only indent wrapped lines by one space (default is in-line with the field name).

       -b, --sort-binary-packages
	      Sort binary package paragraphs by name.

       -k, --keep-first
	      When sorting binary package paragraphs, leave the first one at the top.  Unqualified debhelper(7) configuration files are applied to
	      the first package.

       -n, --no-cleanup
	      Do not remove trailing whitespaces.

       -d path, --debian-directory=path
	      Location of the debian directory (default: ./debian).

       -f file, --file=file
	      Wrap  and sort only the specified file.  You can specify this parameter multiple times.  All supported files will be processed if no
	      files are specified.

       -v, --verbose
	      Print all files that are touched.

AUTHORS

       wrap-and-sort and this manpage have been written by Benjamin Drung <bdrung@debian.org>.

       Both are released under the ISC license.

DEBIAN
								 Debian Utilities						  WRAP-AND-SORT(1)

UNIX for Beginners Questions & Answers