12-29-2009
14341:- I thought that the issue is awk will barf
on big files, not that "comm" is faster on execution than awk; I know that shell commands always faster than external ones.
I hope I had clear the issue.
and still I don't know if awk has limitation on file raw or columns sizes.
BR
10 More Discussions You Might Find Interesting
1. Shell Programming and Scripting
I have a flat file like this
0001 THER ULT HEAD & NECK VES
0002 THER ULTRASOUND OF HEART
0003 THER ULT PERIPHERAL VES
0009 OTHER THERAPEUTIC ULTSND
0010 IMPLANT CHEMOTHERA AGENT
0011 INFUS DROTRECOGIN ALFA
0012 ADM INHAL NITRIC OXIDE
I need to conver this to a comma delimited flat file... (2 Replies)
Discussion started by: thumsup9
2 Replies
2. Shell Programming and Scripting
Hi All,
I am giving an example similar to the problem I have.
I have two data files of 10 columns each in which fields are delimited by comma(,). I need to compare compare the two files using the uniq col(col3). If there are any records in file1 and are not in file2 then I have check the value... (3 Replies)
Discussion started by: rajus19
3 Replies
3. Shell Programming and Scripting
Hi,
I need to compare two flat files (yesterday & today's data) and get only the changed data from flat files. In flat file i dont have data column or anything its just a string data in flat file.Can any one please let me know the script
With Regds
Shashi (3 Replies)
Discussion started by: jtshashidhar
3 Replies
4. Shell Programming and Scripting
Hi Gurus,
I searched the forum but didnt get much info.
I want to compare 2 files.
1)Newfile comes today with
2)Old file of previous day.
The files are same ,just the new files might have new records sometimes.
So I want to capture these new records in another file.
Can anyone help... (5 Replies)
Discussion started by: ganesh123
5 Replies
5. Programming
Before i start doing something, I wanted to know whether the approach to compare XML file with UNIX file system structure. I have a pre-configured file(contains a list of paths to executables) and i need to check against the UNIX directory structure. what are the various approches should i use ? I... (6 Replies)
Discussion started by: shafi2all
6 Replies
6. Shell Programming and Scripting
Hello,
I am strugling from quite a some time to compare flat files with over 1 million records could anyone please help me.
I want to compare two pipe delimited flat files, file1 with file2 and output the unmatched rows from file2 in file3
Sample File1:
... (9 Replies)
Discussion started by: suhaeb
9 Replies
7. Shell Programming and Scripting
I have four files, I need to compare these files together.
As such i know "sdiff and comm" commands but these commands compare 2 files together. If I use sdiff command then i have to compare each file with other which will increase the codes.
Please suggest if you know some commands whcih can... (6 Replies)
Discussion started by: nehashine
6 Replies
8. UNIX for Dummies Questions & Answers
Hi,
I'm a newbie to scripting and am trying to compare two files using awk.
The files are exactly the same dimensions. Where the first file has 0's I would like to create an updated version of the second file which has the corresponding elements set to zero also.
eg:
file1:
12345 1 2 0... (3 Replies)
Discussion started by: kasan0
3 Replies
9. Shell Programming and Scripting
compare to flat files using awk .but in 4th field contains non ordered substring. how to do that.
file1.txt
john|0.0|4|**:25;JP:50;UY:25
file2.txt
andy|0.0|4|JP:50;**:25;UY:25 (4 Replies)
Discussion started by: veeruasu
4 Replies
10. Shell Programming and Scripting
How to convert this:
F1-R1 F1-R2 F1-R3 into a flat file for bash?? Each record
F2-R1 F2-R2 F2-R3
F3-R1 F3-R2 F3-R3
F4-R1 F4-R2 F4-R3is on one line with all fields for that record, put into an output file. The output file should look like this when converted:
F1-R1,F2-R1,F3-R1,F4-R1... (6 Replies)
Discussion started by: bud1738
6 Replies
IGAWK(1) Utility Commands IGAWK(1)
NAME
igawk - gawk with include files
SYNOPSIS
igawk [ all gawk options ] -f program-file [ -- ] file ...
igawk [ all gawk options ] [ -- ] program-text file ...
DESCRIPTION
Igawk is a simple shell script that adds the ability to have ``include files'' to gawk(1).
AWK programs for igawk are the same as for gawk, except that, in addition, you may have lines like
@include getopt.awk
in your program to include the file getopt.awk from either the current directory or one of the other directories in the search path.
OPTIONS
See gawk(1) for a full description of the AWK language and the options that gawk supports.
EXAMPLES
cat << EOF > test.awk
@include getopt.awk
BEGIN {
while (getopt(ARGC, ARGV, "am:q") != -1)
...
}
EOF
igawk -f test.awk
SEE ALSO
gawk(1)
Effective AWK Programming, Edition 1.0, published by the Free Software Foundation, 1995.
AUTHOR
Arnold Robbins (arnold@skeeve.com).
Free Software Foundation Nov 3 1999 IGAWK(1)