Login or Register to Ask a Question and Join Our Community


Shell Programming and Scripting

using awk

Login to Discuss or Reply to this Discussion in Our Community

 
Thread Tools Search this Thread
Top Forums Shell Programming and Scripting using awk
# 1  
Old 11-28-2005
using awk
Hi,
I have one file like below:
0744 111305 9.92 52008
1552 111305 1.70 52008
5345 111305 0.40 52008
1552 111305 1.58 52056

and other file like below:
1552 name2
0744 name3
5345 name4

I need to paste the "name" column in the second file to the fist file if there is any match on the fist column. I can't use paste command since first file will have duplicated ID on the first column.

This is what I'd like to show on the final file:
0744 name3 11305 9.92 52008
1552 name2 111305 1.70 52008
5345 name4 111305 0.40 52008
1552 name2111305 1.58 52056

Any help would be very appreciated!
# 2  
Old 11-28-2005
shell or loop?
Hi,
I am new to shell and awk.
Can anyone give me a hint where I should start with it?

Thanks!
# 3  
Old 11-28-2005
nawk -f cin.awk otherFile oneFile

with cin.awk being:
Code:
NR==FNR { arr[$1]=$2; next }
$1 in arr { $1 = $1 OFS arr[$1] }
1

# 4  
Old 11-28-2005
nawk NR==FNR
Hi,
Thanks a lot! It worked.
I am wondering if you could explain with plain English because I like to know how I can modify the code for my program.

Smilie

Thanks again!
# 5  
Old 11-28-2005
here's the code with embedded comments:

Quote:
Originally Posted by vgersh99
nawk -f cin.awk otherFile oneFile

with cin.awk being:
Code:
# 'NR == FNR' results in 'true' ONLY for the FIRST file passed to script
# do 'man nawk' to get a detailed description(s) on FNR and NR
# when 'FNR==NR' create an array 'arr' indexed by the value of FIRST field '$1'
# and assigned a value of the SECOND field '$2'. 'next' skips the rest of the
# script and goes to the next record/line
NR==FNR { arr[$1]=$2; next }


# we get here for the file(s) OTHER than the  FIRST file
# If the value of the FIRST field '$1' is in the array '$1' - execute the action
# within the curlies: suffix the value of the FIRST field '$1' with the value of
# OFS [OutputFieldSeparator] followed by the value found in the array 'arr'
# indexed by the value of the FIRST field '$1' 
$1 in arr { $1 = $1 OFS arr[$1] }


# this is a shorthand for '{print}' which prints the current record
1

Last edited by vgersh99; 11-29-2005 at 12:26 AM..
# 6  
Old 11-29-2005
There is command in UNIX which does a "join" on files using their columns (analogous to database table joins). The only condition being the fields on which join to be performed should be sorted.

Lets call the first file "file1" and the second file "file2".
Heres what you can do:

sort file1>sfile1;sort file2>sfile2;
join -a1 -o 1.1,1.2,1.3,1.4,2.2 sfile1 sfile2

Explanation:
-o lets you specify which columns you want to see in ur output. Columns belonging to the first file are denoted by 1 followed by a decimal point and the column number. Columns belonging to the second file are denoted by 2 followed by a decimal point and the column number. So here we trying to see all columns from the first file and the second column from the second file in the order specified.

The -a flag prints unpaired lines from file1.
Login or Register to Ask a Question

Previous Thread | Next Thread

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

awk output yields error: awk:can't open job_name (Autosys)

Good evening, Im newbie at unix specially with awk From an scheduler program called Autosys i want to extract some data reading an inputfile that comprises jobs names, then formating the output to columns for example 1. This is the inputfile: $ more MapaRep.txt ds_extra_nikira_usuarios... (18 Replies)
Discussion started by: alexcol
18 Replies

2. Shell Programming and Scripting

Pass awk field to a command line executed within awk

Hi, I am trying to pass awk field to a command line executed within awk (need to convert a timestamp into formatted date). All my attempts failed this far. Here's an example. It works fine with timestamp hard-codded into the command echo "1381653229 something" |awk 'BEGIN{cmd="date -d... (4 Replies)
Discussion started by: tuxer
4 Replies

3. Shell Programming and Scripting

Passing awk variable argument to a script which is being called inside awk

consider the script below sh /opt/hqe/hqapi1-client-5.0.0/bin/hqapi.sh alert list --host=localhost --port=7443 --user=hqadmin --password=hqadmin --secure=true >/tmp/alerts.xml awk -F'' '{for(i=1;i<=NF;i++){ if($i=="Alert id") { if(id!="") if(dt!=""){ cmd="sh someScript.sh... (2 Replies)
Discussion started by: vivek d r
2 Replies

4. Shell Programming and Scripting

HELP with AWK one-liner. Need to employ an If condition inside AWK to check for array variable ?

Hello experts, I'm stuck with this script for three days now. Here's what i need. I need to split a large delimited (,) file into 2 files based on the value present in the last field. Samp: Something.csv bca,adc,asdf,123,12C bca,adc,asdf,123,13C def,adc,asdf,123,12A I need this split... (6 Replies)
Discussion started by: shell_boy23
6 Replies

5. Shell Programming and Scripting

awk command to compare a file with set of files in a directory using 'awk'

Hi, I have a situation to compare one file, say file1.txt with a set of files in directory.The directory contains more than 100 files. To be more precise, the requirement is to compare the first field of file1.txt with the first field in all the files in the directory.The files in the... (10 Replies)
Discussion started by: anandek
10 Replies

6. Shell Programming and Scripting

Comparison and editing of files using awk.(And also a possible bug in awk for loop?)

I have two files which I would like to compare and then manipulate in a way. File1: pictures.txt 1.1 1.3 dance.txt 1.2 1.4 treehouse.txt 1.3 1.5 File2: pictures.txt 1.5 ref2313 1.4 ref2345 1.3 ref5432 1.2 ref4244 dance.txt 1.6 ref2342 1.5 ref2352 1.4 ref0695 1.3 ref5738 1.2... (1 Reply)
Discussion started by: linuxkid
1 Replies

7. Shell Programming and Scripting

Problem with awk awk: program limit exceeded: sprintf buffer size=1020

Hi I have many problems with a script. I have a script that formats a text file but always prints the same error when i try to execute it The code is that: { if (NF==17){ print $0 }else{ fields=NF; all=$0; while... (2 Replies)
Discussion started by: fate
2 Replies

8. Shell Programming and Scripting

awk: assign variable with -v didn't work in awk filter

I want to filter 2nd column = 2 using awk $ cat t 1 2 2 4 $ VAR=2 #variable worked in print $ cat t | awk -v ID=$VAR ' { print ID}' 2 2 # but variable didn't work in awk filter $ cat t | awk -v ID=$VAR '$2~/ID/ { print $0}' (2 Replies)
Discussion started by: honglus
2 Replies

9. Shell Programming and Scripting

scripting/awk help : awk sum output is not comming in regular format. Pls advise.

Hi Experts, I am adding a column of numbers with awk , however not getting correct output: # awk '{sum+=$1} END {print sum}' datafile 2.15291e+06 How can I getthe output like : 2152910 Thank you.. # awk '{sum+=$1} END {print sum}' datafile 2.15079e+06 (3 Replies)
Discussion started by: rveri
3 Replies

10. Shell Programming and Scripting

Awk problem: How to express the single quote(') by using awk print function

Actually I got a list of file end with *.txt I want to use the same command apply to all the *.txt Thus I try to find out the fastest way to write those same command in a script and then want to let them run automatics. For example: I got the file below: file1.txt file2.txt file3.txt... (4 Replies)
Discussion started by: patrick87
4 Replies
Login or Register to Ask a Question