12-23-2009
split a file using awk
Hi ,
I just need to split a file and outputfiles are redirected to gzip file
need:
Input file - A.gz
content of A.gz is
100|sfdds|dffdds|200112|sdfdf
100|sfdds|dffdds|200112|sdfdf
100|sfdds|dffdds|200112|sdfdf
100|sfdds|dffdds|200212|sdfdf
100|sfdds|dffdds|200212|sdfdf
100|sfdds|dffdds|200212|sdfdf
100|sfdds|dffdds|200312|sdfdf
100|sfdds|dffdds|200142|sdfdf
I wanted the out files as
Output file 1- 200112.gz
100|sfdds|dffdds|200112|sdfdf
100|sfdds|dffdds|200112|sdfdf
100|sfdds|dffdds|200112|sdfdf
Output file 2- 200212.gz
100|sfdds|dffdds|200212|sdfdf
100|sfdds|dffdds|200212|sdfdf
100|sfdds|dffdds|200212|sdfdf
Output file 3- 200312.gz
100|sfdds|dffdds|200312|sdfdf
Output file 4- 200142.gz
100|sfdds|dffdds|200142|sdfdf
need ur help in doing so
Thanks,
10 More Discussions You Might Find Interesting
1. Shell Programming and Scripting
I am trying to read a file and split the file into multiple files. I need to create new files with different set of lines from the original file. ie, the first output file may contain 10 lines and the second 100 lines and so on. The criteria is to get the lines between two lines starting with some... (8 Replies)
Discussion started by: pvar
8 Replies
2. UNIX for Dummies Questions & Answers
I have gone through all the threads in the forum and tested out different things. I am trying to split a 3GB file into multiple files. Some files are even larger than this.
For example:
split -l 3000000 filename.txt
This is very slow and it splits the file with 3 million records in each... (10 Replies)
Discussion started by: madhunk
10 Replies
3. Shell Programming and Scripting
I did a lot of search on this forum on spiting file; found a lot, but my requirement is a bit different, please guide.
Master file:
x:start:5
line1:23
line2:12
2:90
x:end:5
x:start:2
45:56
22:90
x:end:2
x:start:3
line1:23
line2:12
x:end:3
x:start:2
line5:23 (1 Reply)
Discussion started by: uwork72
1 Replies
4. Shell Programming and Scripting
How can I split a text file (in awk) in n others with number of record given in input?
Thanks (6 Replies)
Discussion started by: pinguc
6 Replies
5. Shell Programming and Scripting
Hello,
I have a file like the following:
david,a,b,c,20,r
thomas,a,b,c,30,r
willaiam,a,b,c,80,r
barbara,a,b,c,100,r
I would like to split the file into other files using a condition for the contents of column 5.
The condition should be a if the contents of column 5 is in a range... (4 Replies)
Discussion started by: keenboy100
4 Replies
6. Shell Programming and Scripting
Hi All,
Input.txt
XYZONEABC
CZXTWOJJJ
KKKSIXOOO
asdfhajlsdhfajs
asdfasfasdf
Output Files:
ONE.txt
XYZONEABC
TWO.txt
CZXTWOJJJ
SIX.txt
KKKSIXOOO
I had a script (2 Replies)
Discussion started by: kmsekhar
2 Replies
7. Shell Programming and Scripting
Hi!
I have a file like this:
a,b,c,12,d,e
a,b,c,13,d,e
a,b,c,14,d,e
a,b,c,15,d,e
a,b,c,16,d,e
a,b,c,17,d,e
I need to split that file in two:
If field 4 is equal or higher than 14 that row goes to one file and if it is equal or higher than 15 to another.
Can anyone point me in the... (2 Replies)
Discussion started by: Tr0cken
2 Replies
8. Shell Programming and Scripting
Hi all,
I'm pretty new to Shell scripting and I need some help to split a source text file into multiple files. The source has a row with pattern where the file needs to be split, and the pattern row also contains the file name of the destination for that specific piece. Here is an example:
... (2 Replies)
Discussion started by: cul8er
2 Replies
9. Shell Programming and Scripting
Hi all,
First of all I' like to mention that I'm pretty new to unix scripting. :(
I'm trying to split an large xml with awk and rename it based on the values of two attributes.
Example XML
<RECORD>
<element1>11</element1>
<element2>22</element2>
<element3>33</element3>... (18 Replies)
Discussion started by: f0usk4s
18 Replies
10. UNIX for Beginners Questions & Answers
I need to split the incoming source file in to multiple files using awk.
Split position is (6,13) : 8 positions
All the records that are greater than 20170101 and less than or equal to 20181231 should go in a split file with file name as source... (11 Replies)
Discussion started by: rosebud123
11 Replies
LEARN ABOUT MOJAVE
io::digest5.18
IO::Digest(3) User Contributed Perl Documentation IO::Digest(3)
NAME
IO::Digest - Calculate digests while reading or writing
SYNOPSIS
use IO::Digest;
# Get a Digest::MD5 object that takes input while $fh being written or read
my $fh;
my $iod = IO::Digest->new ($fh, 'MD5');
print $fh "fooo";
print $iod->hexdigest
DESCRIPTION
This module allows you to calculate digests while reading or writing file handles. This avoids the case you need to reread the same
content to compute the digests after written a file.
TEST COVERAGE
----------------------------------- ------ ------ ------ ------ ------ ------
File stmt branch cond sub time total
----------------------------------- ------ ------ ------ ------ ------ ------
blib/lib/IO/Digest.pm 100.0 n/a n/a 100.0 100.0 100.0
Total 100.0 n/a n/a 100.0 100.0 100.0
----------------------------------- ------ ------ ------ ------ ------ ------
AUTHORS
Chia-liang Kao <clkao@clkao.org>
COPYRIGHT
Copyright 2004 by Chia-liang Kao <clkao@clkao.org>.
This program is free software; you can redistribute it and/or modify it under the same terms as Perl itself.
See <http://www.perl.com/perl/misc/Artistic.html>
perl v5.18.2 2013-02-16 IO::Digest(3)