09-08-2008
Extract large list of substrings
I have a very long string (millions of characters).
I have a file with start location and length that is thousands of rows long:
Start Length
5 10
16 21
44 100
215 37
...
I'd like to extract the substring that corresponds to the start and length from each row of the list:
I tried just using a large awk '{print substr($1,5,10), "\n", substr($1,16,21) "\n", substr($1,44,100) "\n", substr($1,215,37)...}' infile > outfile &
command
But it seems to hang likely because the Bash line is too long.
Can you help me with a way to get out the substrings as rows.
10 More Discussions You Might Find Interesting
1. UNIX for Dummies Questions & Answers
Hi
I need to list all files in the system:
1. Greater than specific size
2. All files sorted by size
How can I do that?
Thanks in advance. (2 Replies)
Discussion started by: GNMIKE
2 Replies
2. Shell Programming and Scripting
Hi All!!
I have a large file containing millions of record. My purpose is to extract 7 characters immediately after text '19' from this file (including text '19') and save the result in new file.
So, my OUTPUT would be as under :
191234561
194567894
192789005
198839408
and so on.....
... (7 Replies)
Discussion started by: parshant_bvcoe
7 Replies
3. Shell Programming and Scripting
Hello,
I have got one file with more than 120+ million records(35 GB in size). I have to extract some relevant data from file based on some parameter and generate other output file.
What will be the besat and fastest way to extract the ne file.
sample file format :--... (2 Replies)
Discussion started by: learner16s
2 Replies
4. Shell Programming and Scripting
Hi All,
I am trying to extract data from a large text file , I want to extract lines which contains a five digit number followed by a hyphen , like
12345- , i tried with egrep ,eg : egrep "+" text.txt
but which returns all the lines which contains any number of digits followed by hyhen ,... (19 Replies)
Discussion started by: shijujoe
19 Replies
5. Shell Programming and Scripting
Hello people :)
That's here my first message to your forum, so I guess it would be fine ^^
I have a request about a code I want to use.
Actually, my system use a large variable, including much informations but those informations can change by more and I want to extract one of thoses... (26 Replies)
Discussion started by: WolwX
26 Replies
6. Shell Programming and Scripting
I have a log file like below.
66.249.73.11 - - "UCiZ7QocVqYAABgwfP8AAHAA" "US" "Mediapartners-Google" "-" www.mahashwetha.com.sg "GET... (2 Replies)
Discussion started by: Tuxidow
2 Replies
7. Shell Programming and Scripting
Hi i have a php script that works 100% however i don't want this to run on php because of server limits etc. Ideally if i could convert this simple php script to a shell script i can set it up to run on a cron. My mac server has curl on it. So i am assuming i should be using this to download the... (3 Replies)
Discussion started by: timgolding
3 Replies
8. UNIX for Dummies Questions & Answers
Dear all,
I want to extract around 300 columns from a very large file with almost 2million columns. There are no headers, but I can find out which column numbers I want. I know I can extract with the function 'cut -f2' for example just the second column but how do I do this for such a large... (1 Reply)
Discussion started by: fndijk
1 Replies
9. Shell Programming and Scripting
Hi All!!
I have a large file containing millions of records. My purpose is to extract 8 characters immediately from the given file.
222222222|ZRF|2008.pdf|2008|01/29/2009|001|B|C|C
222222222|ZRF|2009.pdf|2009|01/29/2010|001|B|C|C
222222222|ZRF|2010.pdf|2010|01/29/2011|001|B|C|C... (5 Replies)
Discussion started by: pavand
5 Replies
10. UNIX for Beginners Questions & Answers
Hi All,
I have records in unix file like below. In this file, we have empty fields from 4th Column to 22nd Column. I have some 200000 records in a file. I want to extract records only which have empty fields from 4th field to 22nd filed. This file is comma separated file. what is the unix... (2 Replies)
Discussion started by: rakeshp
2 Replies
mailq(1) General Commands Manual mailq(1)
NAME
mailq - prints the mail queue
SYNOPSIS
DESCRIPTION
prints a summary of the mail messages queued for future delivery.
The first line printed for each message shows the internal identifier used on this host for the message, the size of the message in bytes,
the date and time the message was accepted into the queue, and the envelope sender of the message. The second line shows the error message
that caused this message to be retained in the queue; it will not be present if the message is being processed for the first time. The
status characters are:
to indicate that the job is being processed
to indicate that the load is too high to process the job
to indicate that the job is too new in the queue to process.
The output lines that follow the second line show the message recipients, one per line.
is identical to
Options
The supported options are:
Show the mail submission queue specified in the
file instead of the MTA queue specified in the file.
Show the lost items in the mail queue instead of normal queue items.
Show the quarantined items in the mail queue instead
of the normal queue items.
Limit processed jobs to those containing
substr as a substring of the queue ID or not when is specified.
Limit processed jobs to quarantined jobs containing
substr as a substring of the quarantine reason or not when is specified.
Limit processed jobs to those containing
substr as a substring of one of the recipients or not when is specified.
Limit processed jobs to those containing
substr as a substring of the sender or not when is specified.
Print verbose information.
This adds the priority of the message and a single character indicator or blank) indicating whether a warning message has
been sent on the first line of the message. In addition, extra lines may be intermixed with the recipients indicating the
`controlling user' information. This shows who owns the programs that are executed on behalf of this message and the name
of the alias this command expanded from, if any.
RETURN VALUE
The utility exits with 0 on success, and >0 if an error occurs.
AUTHOR
was developed by the University of California, Berkeley, and originally appeared in 4.0BSD.
FILES
mail queue files for
SEE ALSO
sendmail(1M).
mailq(1)