07-20-2004
Split file using awk
I am trying to read a file and split the file into multiple files. I need to create new files with different set of lines from the original file. ie, the first output file may contain 10 lines and the second 100 lines and so on. The criteria is to get the lines between two lines starting with some characters(variable)
eg. A sample input file
DOC100
aaaaaa
bbbbbb
cccccccc
END
DOC200
ddddddd
eeeeeee
END
I need to send the lines between DOC100 and END to out.1
and lines between DOC200 and the next END to out.2
I thought I could do this using awk and I tried the following command but it didn't work.
k=grep DOC $filename|cut -c4-6
awk -v cn=$k '/DOC$cn/,/END/ { print $0 }' $filename >$outfile
Can anyone help me on this? Thanks
10 More Discussions You Might Find Interesting
1. UNIX for Dummies Questions & Answers
I have gone through all the threads in the forum and tested out different things. I am trying to split a 3GB file into multiple files. Some files are even larger than this.
For example:
split -l 3000000 filename.txt
This is very slow and it splits the file with 3 million records in each... (10 Replies)
Discussion started by: madhunk
10 Replies
2. Shell Programming and Scripting
I did a lot of search on this forum on spiting file; found a lot, but my requirement is a bit different, please guide.
Master file:
x:start:5
line1:23
line2:12
2:90
x:end:5
x:start:2
45:56
22:90
x:end:2
x:start:3
line1:23
line2:12
x:end:3
x:start:2
line5:23 (1 Reply)
Discussion started by: uwork72
1 Replies
3. Shell Programming and Scripting
How can I split a text file (in awk) in n others with number of record given in input?
Thanks (6 Replies)
Discussion started by: pinguc
6 Replies
4. Shell Programming and Scripting
Hi ,
I just need to split a file and outputfiles are redirected to gzip file
need:
Input file - A.gz
content of A.gz is
100|sfdds|dffdds|200112|sdfdf
100|sfdds|dffdds|200112|sdfdf
100|sfdds|dffdds|200112|sdfdf
100|sfdds|dffdds|200212|sdfdf
100|sfdds|dffdds|200212|sdfdf... (3 Replies)
Discussion started by: mohan_xunil
3 Replies
5. Shell Programming and Scripting
Hello,
I have a file like the following:
david,a,b,c,20,r
thomas,a,b,c,30,r
willaiam,a,b,c,80,r
barbara,a,b,c,100,r
I would like to split the file into other files using a condition for the contents of column 5.
The condition should be a if the contents of column 5 is in a range... (4 Replies)
Discussion started by: keenboy100
4 Replies
6. Shell Programming and Scripting
Hi All,
Input.txt
XYZONEABC
CZXTWOJJJ
KKKSIXOOO
asdfhajlsdhfajs
asdfasfasdf
Output Files:
ONE.txt
XYZONEABC
TWO.txt
CZXTWOJJJ
SIX.txt
KKKSIXOOO
I had a script (2 Replies)
Discussion started by: kmsekhar
2 Replies
7. Shell Programming and Scripting
Hi!
I have a file like this:
a,b,c,12,d,e
a,b,c,13,d,e
a,b,c,14,d,e
a,b,c,15,d,e
a,b,c,16,d,e
a,b,c,17,d,e
I need to split that file in two:
If field 4 is equal or higher than 14 that row goes to one file and if it is equal or higher than 15 to another.
Can anyone point me in the... (2 Replies)
Discussion started by: Tr0cken
2 Replies
8. Shell Programming and Scripting
Hi all,
I'm pretty new to Shell scripting and I need some help to split a source text file into multiple files. The source has a row with pattern where the file needs to be split, and the pattern row also contains the file name of the destination for that specific piece. Here is an example:
... (2 Replies)
Discussion started by: cul8er
2 Replies
9. Shell Programming and Scripting
Hi all,
First of all I' like to mention that I'm pretty new to unix scripting. :(
I'm trying to split an large xml with awk and rename it based on the values of two attributes.
Example XML
<RECORD>
<element1>11</element1>
<element2>22</element2>
<element3>33</element3>... (18 Replies)
Discussion started by: f0usk4s
18 Replies
10. UNIX for Beginners Questions & Answers
I need to split the incoming source file in to multiple files using awk.
Split position is (6,13) : 8 positions
All the records that are greater than 20170101 and less than or equal to 20181231 should go in a split file with file name as source... (11 Replies)
Discussion started by: rosebud123
11 Replies
LEARN ABOUT NETBSD
openssl_pkcs7
PKCS7(1) OpenSSL PKCS7(1)
NAME
pkcs7 - PKCS#7 utility
LIBRARY
libcrypto, -lcrypto
SYNOPSIS
openssl pkcs7 [-inform PEM|DER] [-outform PEM|DER] [-in filename] [-out filename] [-print_certs] [-text] [-noout] [-engine id]
DESCRIPTION
The pkcs7 command processes PKCS#7 files in DER or PEM format.
COMMAND OPTIONS
-inform DER|PEM
This specifies the input format. DER format is DER encoded PKCS#7 v1.5 structure.PEM (the default) is a base64 encoded version of the
DER form with header and footer lines.
-outform DER|PEM
This specifies the output format, the options have the same meaning as the -inform option.
-in filename
This specifies the input filename to read from or standard input if this option is not specified.
-out filename
specifies the output filename to write to or standard output by default.
-print_certs
prints out any certificates or CRLs contained in the file. They are preceded by their subject and issuer names in one line format.
-text
prints out certificates details in full rather than just subject and issuer names.
-noout
don't output the encoded version of the PKCS#7 structure (or certificates is -print_certs is set).
-engine id
specifying an engine (by its unique id string) will cause pkcs7 to attempt to obtain a functional reference to the specified engine,
thus initialising it if needed. The engine will then be set as the default for all available algorithms.
EXAMPLES
Convert a PKCS#7 file from PEM to DER:
openssl pkcs7 -in file.pem -outform DER -out file.der
Output all certificates in a file:
openssl pkcs7 -in file.pem -print_certs -out certs.pem
NOTES
The PEM PKCS#7 format uses the header and footer lines:
-----BEGIN PKCS7-----
-----END PKCS7-----
For compatibility with some CAs it will also accept:
-----BEGIN CERTIFICATE-----
-----END CERTIFICATE-----
RESTRICTIONS
There is no option to print out all the fields of a PKCS#7 file.
This PKCS#7 routines only understand PKCS#7 v 1.5 as specified in RFC2315 they cannot currently parse, for example, the new CMS as
described in RFC2630.
SEE ALSO
openssl_crl2pkcs7(1)
1.0.1i 2009-07-20 PKCS7(1)