Sponsored Content
Top Forums Shell Programming and Scripting sort a file which has 3.7 million records Post 302334411 by akrathi on Wednesday 15th of July 2009 12:59:42 PM
Old 07-15-2009
Sort

You may want to check the disk space where your /tmp is ?

Thanks
Ashok
 

10 More Discussions You Might Find Interesting

1. UNIX for Dummies Questions & Answers

How to Sort Records Uniquely?

I have a file containing many records separated by a % that I would like to sort uniquely (and if possible with a count of dupes) while maintaining the integrity of each record. File looks like this: % srcip: 5.6.7.8 srcburb: internal dstip: 1.2.3.4 dstport: 2000 dstburb: external... (12 Replies)
Discussion started by: earnstaf
12 Replies

2. Solaris

How to remove duplicate records with out sort

Can any one give me command How to delete duplicate records with out sort. Suppose if the records like below: 345,bcd,789 123,abc,456 234,abc,456 712,bcd,789 out tput should be 345,bcd,789 123,abc,456 Key for the records is 2nd and 3rd fields.fields are seperated by colon(,). (2 Replies)
Discussion started by: svenkatareddy
2 Replies

3. Shell Programming and Scripting

How to remove duplicate records with out sort

Can any one give me command How to delete duplicate records with out sort. Suppose if the records like below: 345,bcd,789 123,abc,456 234,abc,456 712,bcd,789 out tput should be 345,bcd,789 123,abc,456 Key for the records is 2nd and 3rd fields.fields are seperated by colon(,). (19 Replies)
Discussion started by: svenkatareddy
19 Replies

4. Shell Programming and Scripting

Sort & Split records in a file

Hi, I am new to scripting. I need a script to sort and the records in a file and then split them into different files. For example, the file is: H1...................... H2...................... D2.................... D2.................... H1........................... (15 Replies)
Discussion started by: Sunitha_edi82
15 Replies

5. Shell Programming and Scripting

Extract data from large file 80+ million records

Hello, I have got one file with more than 120+ million records(35 GB in size). I have to extract some relevant data from file based on some parameter and generate other output file. What will be the besat and fastest way to extract the ne file. sample file format :--... (2 Replies)
Discussion started by: learner16s
2 Replies

6. Shell Programming and Scripting

Unix sort for fixed length columns and records

I was trying to use the AIX 6.1 sort command to sort fixed-length data records, sorting by specific columns only. It took some time to figure out how to get it to work, so I wanted to share the solution. The sort man page wasn't much help, because it talks about field delimeters (default space... (1 Reply)
Discussion started by: CheeseHead1
1 Replies

7. UNIX for Dummies Questions & Answers

Grep specific records from a file of records that are separated by an empty line

Hi everyone. I am a newbie to Linux stuff. I have this kind of problem which couldn't solve alone. I have a text file with records separated by empty lines like this: ID: 20 Name: X Age: 19 ID: 21 Name: Z ID: 22 Email: xxx@yahoo.com Name: Y Age: 19 I want to grep records that... (4 Replies)
Discussion started by: Atrisa
4 Replies

8. UNIX for Dummies Questions & Answers

Alphabetical sort for multi line records contains in a single file

Hi all, I So, I've got a monster text document comprising a list of various company names and associated info just in a long list one after another. I need to sort them alphabetically by name... The text document looks like this: Company Name: the_first_company's_name_here Address:... (2 Replies)
Discussion started by: quee1763
2 Replies

9. Shell Programming and Scripting

Matching 10 Million file records with 10 Million in other file

Dear All, I have two files both containing 10 Million records each separated by comma(csv fmt). One file is input.txt other is status.txt. Input.txt-> contains fields with one unique id field (primary key we can say) Status.txt -> contains two fields only:1. unique id and 2. status ... (8 Replies)
Discussion started by: vguleria
8 Replies

10. Shell Programming and Scripting

How to read records in a file and sort it?

I have a file which has number of pipe delimited records. I am able to read the records....but I want to sort it after reading. i=0 while IFS="|" read -r usrId dataOwn expire email group secProf startDt endDt smhRole RoleCat DataProf SysRole MesgRole SearchProf do print $usrId $dataOwn... (4 Replies)
Discussion started by: harish468
4 Replies
gfs2_quota(8)						      System Manager's Manual						     gfs2_quota(8)

NAME
gfs2_quota - Manipulate GFS2 disk quotas SYNOPSIS
gfs2_quota <list|sync|get|limit|warn|check|init|reset> [OPTION]... DESCRIPTION
gfs2_quota is used to examine and change quota values in a GFS2 filesystem. This command has a number of different actions. GFS2 introduced a new linked list format for the quotas in the quota file. This list format allows for faster list, check and init opera- tions. Older GFS2 quota files may be migrated to this newer format using the gfs2_quota reset command. ACTIONS
list List the contents of the quota file. Only IDs that have a non-zero hard limit, warn limit, or value are printed. sync Sync any local quota changes to the quota file. get Get the current data for the ID specified by the -u or -g argument. limit Set the current hard limit for the ID specified by the -u or -g argument to the value specified by the -l argument on the specified filesystem. The filesystem won't let the user or group use more than this much space. A value of zero here means that no limit is enforced. warn Set the current warn limit for the ID specified by the -u or -g argument to the value specified by the -l argument on the specified filesystem. The filesystem will start complaining to the user or group when more than this much space is used. A value of zero here means that the user won't ever be warned. check Scan a filesystem and make sure that what's out there on the disk matches what's in the quota file. This is only accurate if the filesystem is idle when this is running. If there is a mismatch, it is printed to stdout. Note: GFS2 quotas are transactional and a quota check is not needed every time there is a system crash. init Scan a filesystem and initialize the quota file with the values obtained from the scan. The filesystem should be idle when this is run. You should only need to do this if you upgrade a pre-quota GFS2 filesystem (pre-GFS2 5.1). reset The reset operation will truncate the quota file and all quota information (values, limits, warnings) will be lost. All quota lim- its and warnings will have to be reassigned after this operation. OPTIONS
-b The units for disk space are filesystem blocks. -f Directory Specifies which filesystem to perform the action on. -g GID Specifies the group ID for get, limit, or warn. It can be either the group name from the group file, or the GID number. -h Print out a help message describing available options, then exit. -k The units for disk space are kilobytes. -l Size Specifies the new value for the limit or warn actions. The value is assumed to be in the units specified by the -m, -k, -s, -b arguments. The default is megabytes. -m The units for disk space are megabytes. This is the default. -n Don't try to resolve UIDs and GIDs into user and group names. -s The units for disk space are sectors (512-byte blocks). -u UID Specifies the user ID for get, limit, or warn. It can be either the username from the password file, or the UID number. -V Print program version information, then exit. EXAMPLE
To set the hard limit for user "nobody" to 1048576 kilobytes on filesystem /gfs20 gfs2_quota limit -l 1048576 -k -u nobody -f /gfs20 gfs2_quota(8)
All times are GMT -4. The time now is 11:57 AM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy