If you have a few thousand files, there's an even faster way:
Once you're processing more than a few lines, it's faster to use awk than a shell language, so we let awk translate the names for us, feeding them into xargs, which will run 'awk '{...}' file1 file2 file3 file4 file5 ...' for as many files as it can safely cram in one commandline, over and over, until it's used up all the filenames. Thus can reduce the number of times awk needs to be run manyfold, making it more efficient.
Hi,
I have a pointer file ptr.txt.
There may be any number of files mentioned in the ptr.txt file
eg: cat ptr.txt
/home/abc.txt
/home/pqr.txt
/home/xyz.txt
I have to read this pointer file and merge the files given in the pointer file
so that final file say... (1 Reply)
Hi Guys,
I wonder whether is possible to merge two files using awk. I have two files one with 7 columns and another one with 9 columns and the first column on both files is identical so will be my key to merge the files. Any ideas.Thanks in advance.
Harby. (2 Replies)
hi,
i am facing a problem in merging two files using awk,
the problem is as stated below,
file1:
A|B|C|D|E|F|G|H|I|1
M|N|O|P|Q|R|S|T|U|2
AA|BB|CC|DD|EE|FF|GG|HH|II|1
....
....
....
file2 :
1|Mn|op|qr (2 Replies)
Hi, guys. I have one question:
I have two files: passwd and shadow (the number of records in these files are not equal)the contents of them are below:
passwd:
**************
ftp:x:24:24:
sshd:x:71:65:
uucp:x:10:14:
brownj:x:5005:1000:
sherrys: x :5006:1000:
...
*************
... (2 Replies)
I want to merge data from 2nd file to 1st file based on 1st column
File1
====
data1,12,comp1
data1,13,comp2
data3,14,,
File2
====
data1,11,host1,lit
data2,11,host2,lit3
data3,11,host3,lit4
Required Ouput (5 Replies)
I have two file like follows. I want to merge them according the first field of file1. The separator of file1 is tab, while the second one is ",". I tried some code, but can't get the results.
File1:
AABB 6072 28 5922
BBCC 316 147 162
CCDD 907 71 231
File2:
CCDD,hTRBV12-4,hTRBJ2-3,319895... (7 Replies)
Data files coming in different names in a file name called process.txt.
1. shipments_yyyymmdd.gz
2 Order_yyyymmdd.gz
3. Invoice_yyyymmdd.gz
4. globalorder_yyyymmdd.gz
The process needs to discard all the below files and only process two of the 4 file names available
... (1 Reply)
Hi,
i have two files like these:
FILE 1
00:0f:35:1b:0c:00 1402691094.750049000 00:0f:35:1b:0c:00 1402691087.474893000
44:d3:ca:fd:a2:08 1402691091.865127000
30:e4:db:c1:df:de 1402691090.192464000
FILE 2_
00:0F:35 Cisco Systems, Inc
30:E4:DB Cisco Systems, Inc
I need a file 3, that... (5 Replies)
Discussion started by: bertiko
5 Replies
LEARN ABOUT LINUX
igawk
IGAWK(1) Utility Commands IGAWK(1)NAME
igawk - gawk with include files
SYNOPSIS
igawk [ all gawk options ] -f program-file [ -- ] file ...
igawk [ all gawk options ] [ -- ] program-text file ...
DESCRIPTION
Igawk is a simple shell script that adds the ability to have ``include files'' to gawk(1).
AWK programs for igawk are the same as for gawk, except that, in addition, you may have lines like
@include getopt.awk
in your program to include the file getopt.awk from either the current directory or one of the other directories in the search path.
OPTIONS
See gawk(1) for a full description of the AWK language and the options that gawk supports.
EXAMPLES
cat << EOF > test.awk
@include getopt.awk
BEGIN {
while (getopt(ARGC, ARGV, "am:q") != -1)
...
}
EOF
igawk -f test.awk
SEE ALSO gawk(1)
Effective AWK Programming, Edition 1.0, published by the Free Software Foundation, 1995.
AUTHOR
Arnold Robbins (arnold@skeeve.com).
Free Software Foundation Nov 3 1999 IGAWK(1)