Login or Register to Ask a Question and Join Our Community

Sponsored Content
Full Discussion: Extarct specific records from wide file
Top Forums Shell Programming and Scripting Extarct specific records from wide file Post 85109 by acheepi on Saturday 1st of October 2005 09:22:13 PM
Old 10-01-2005
Extarct specific records from wide file
I have a file which is 5 million records. And each records has 412 fields has delimited by "|". So that makes each records to be 2923 bytes long. I wanted to extract specific records like top 100 or 2500 - 5000, 50001 - 10000 etc. from this file.

I tried using head command for top 100 records, but since the records being so wide I get incorrect results. I can't even "vi" this file. I get the message "line too long". I had to use vim editor to view the file.

I was wondering we could use awk, but awk has a limitation of 199 fields. Since this records being pretty wide, how could we acheive this in unix.

Thanks in advance.
AC
 

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

cut specific records from a file

I am trying to cut the first 10 characters from a file only if the file has 'xyz' in field 185-188. I tried this cat filename | cut -c1-10 but this gives me all the records regardless of what is in field 185-188. Is this doable ? Thanks in advance for responses. (2 Replies)
Discussion started by: jxh461
2 Replies

2. Shell Programming and Scripting

Column wide file binding

What is the best way to bind files in column wide? Looks a simple, but I don't know the most economic way. I tried to merge, and cat function, but not success!! Ex.) file 1 1 2 3 2 3 4 file 2 3 4 5 4 5 6 file 3 2 3 4 1 2 7 I would like to see the result below file 4 1 2 3 3... (2 Replies)
Discussion started by: Jae
2 Replies

3. Shell Programming and Scripting

How can i extarct the output from a file which has been updated from last half an hou

hi, I have a log file , which is appending with current data i need the extarct which is updated from last 30 minutes the format of the date is Jun 18, 2008 8:59:18 AM how can i subtract 30 mins from the current date thanks Tarun. (5 Replies)
Discussion started by: tarundeepdhawan
5 Replies

4. UNIX for Dummies Questions & Answers

Cut specific fields from a file containing multiline records

Hi, I am looking for a method to get column13 to column 50 data from the 1st line of a multiline reord. The records are stored in a large file and are separated by newline. sample format is (data in red is to be extracted) <header> A001dfhskhfkdsh hajfhksdhfjh... (3 Replies)
Discussion started by: sunayana3112
3 Replies

5. Shell Programming and Scripting

[Solved] Find Specific records from file and add totals into variables

Hi Eveyone, I am working on one shell script to find the specific records from data file and add the totals into variables and print them. you can find the sample data file below for more clarification. Sample Data File: PXSTYL00__20090803USA CHCART00__20090803IND... (7 Replies)
Discussion started by: veeru
7 Replies

6. UNIX for Dummies Questions & Answers

Grep specific records from a file of records that are separated by an empty line

Hi everyone. I am a newbie to Linux stuff. I have this kind of problem which couldn't solve alone. I have a text file with records separated by empty lines like this: ID: 20 Name: X Age: 19 ID: 21 Name: Z ID: 22 Email: xxx@yahoo.com Name: Y Age: 19 I want to grep records that... (4 Replies)
Discussion started by: Atrisa
4 Replies

7. Shell Programming and Scripting

how to Insert values in multiple lines(records) within a pipe delimited text file in specific cols

this is Korn shell unix. The scenario is I have a pipe delimited text file which needs to be customized. say for example,I have a pipe delimited text file with 15 columns(| delimited) and 200 rows. currently the 11th and 12th column has null values for all the records(there are other null columns... (4 Replies)
Discussion started by: vasan2815
4 Replies

8. Shell Programming and Scripting

Extract error records based on specific criteria from Unix file

Hi, I look for a awk one liner for below issue. input file ABC 1234 abc 12345 ABC 4567 678 XYZ xyz ght 678 ABC 787 yyuu ABC 789 7890 777 zxr hyip hyu mno uii 678 776 ABC ty7 888 All lines should be started with ABC as first field. If a record has another value for 1st... (7 Replies)
Discussion started by: ratheesh2011
7 Replies

9. Shell Programming and Scripting

When trying to open file Message:-Terminal too wide?

Hi, I am trying to open small size file only in vi editor on solaris or Linux machine but it giving message "Terminal too wide" and then I have to come out. As shown below:- -rwxr-x--- 1 rkycadm rkycprd 2445 Sep 12 04:06 $ vi file.txt Terminal too wide :q! ----------... (2 Replies)
Discussion started by: RahulJoshi
2 Replies

10. Shell Programming and Scripting

Listing the file name and no of records in each files for the files created on a specific day

Hi, I want to display the file names and the record count for the files in the 2nd column for the files created today. i have written the below command which is listing the file names. but while piping the above command to the wc -l command its not working for me. ls -l... (5 Replies)
Discussion started by: Showdown
5 Replies

LEARN ABOUT DEBIAN

recsel

RECSEL(1)							   User Commands							 RECSEL(1)

NAME

       recsel - print records from a recfile

SYNOPSIS

       recsel [OPTION]... [-t TYPE] [-n INDEXES | -e RECORD_EXPR | -q EXPR | -m NUM] [-c | (-p|-P) FIELD_EXPR] [FILE]...

DESCRIPTION

       Select and print rec data.

       -d, --include-descriptors
	      print record descriptors along with the matched records.

       -C, --collapse
	      do not section the result in records with newlines.

       -S, --sort=FIELD
	      sort the output by the specified field.

       -U, --uniq
	      remove duplicated fields in the output records.

       -s, --password=STR
	      decrypt confidential fields with the given password.

       --help print a help message and exit.

       --version
	      show version and exit.

   Record selection options:
       -i, --case-insensitive
	      make strings case-insensitive in selection expressions.

       -t, --type=TYPE
	      operate on records of the specified type only.

       -e, --expression=EXPR
	      selection expression.

       -q, --quick=STR
	      select records with fields containing a string.

       -n, --number=NUM,...
	      select specific records by position, with ranges.

       -R, --random=NUM
	      select a given number of random records.

   Output options:
       -p, --print=FIELDS
	      comma-separated list of fields to print for each matching record.

       -P, --print-values=FIELDS
	      as -p, but print only the values of the selected fields.

       -R, --print-row=FIELDS
	      as -P, but separate the values with spaces instead of newlines.

       -c, --count
	      print a count of the matching records instead of the records themselves.

   Special options:
       --print-sexps
	      print the data in sexps instead of rec format.

AUTHOR

       Written by Jose E. Marchesi.

REPORTING BUGS

       Report bugs to: bug-recutils@gnu.org
       GNU recutils home page: <http://www.gnu.org/software/recutils/>
       General help using GNU software: <http://www.gnu.org/gethelp/>

COPYRIGHT

       Copyright (C) 2010, 2011, 2012 Jose E. Marchesi.  License GPLv3+: GNU GPL version 3 or later <http://gnu.org/licenses/gpl.html>.
       This is free software: you are free to change and redistribute it.  There is NO WARRANTY, to the extent permitted by law.

SEE ALSO

       The  full documentation for recsel is maintained as a Texinfo manual.  If the info and recsel programs are properly installed at your site,
       the command

	      info recsel

       should give you access to the complete manual.

recsel 1.4.93							   January 2012 							 RECSEL(1)
All times are GMT -4. The time now is 05:30 PM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy