awk help


 
Thread Tools Search this Thread
Top Forums UNIX for Dummies Questions & Answers awk help
# 1  
Old 11-14-2011
awk help

Hi ,

I have one issue.
i have one file like data below.
Code:
NCAS_IND_PORT_TS          4194304000 3892314112
NCAS_IND_PORT_TS          4194304000 4160749568
NCAS_IND_PTP_TS           2097152000 1845493760
NCAS_IND_SSUB_TS          4194304000 3825205248
NCAS_IND_TS               2097152000 2076180480
NCAS_IND_TS               2097152000  146800640
NCAS_IND_VCONF_TS         2097152000 1677721600
NCAS_IND_VLCONN_TS        4194304000 3992977408
NCAS_TS                   2097152000 2086600704
NCAS_TS_CONN              4194304000 4127195136
NCAS_TS_CTP               4194304000 4127195136
NCAS_TS_PORT              4194304000 4127195136
NCAS_TS_PORT              4194304000 4160749568

if the first column is same i need to add second column with second coloumn and third column and print only one line for example
Code:
NCAS_IND_TS               2097152000 2076180480
NCAS_IND_TS               2097152000  146800640

in these two lines first column is same i need to print
Code:
NCAS_IND_TS              4194304000   2222981120

So how can do this using awk programming please help.

thanks in advance

Moderator's Comments:
Mod Comment Please use code tags <- click the link!

Last edited by zaxxon; 11-14-2011 at 08:47 AM.. Reason: code tags, see PM
# 2  
Old 11-14-2011
Assuming unsorted input :-),
Code:
{ C2[$1] += C2; C3[$1] += C3; }
END { for (x in C2) printf "%s\t%d\t%d\n", x, C2[x], C3[x]; }

If the sample numbers are indicative of your sample set, you may run into a precision issue with the results.
# 3  
Old 11-16-2011
Thanks..

Could you please explain me the code

and its not working also
Code:
$ cat  four | awk '{ C2[$1] += C2; C3[$1] += C3; }
continue:END { for (x in C2) printf "%s\t%d\t%d\n", x, C2[x], C3[x]; }'
awk: Cannot read the value of  C2. It is an array name.
 The input line number is 1.
 The source line number is 1.


Last edited by Scott; 11-16-2011 at 03:21 AM.. Reason: Code tags, please...
# 4  
Old 11-16-2011
Apologies for a bad cut-n-paste:
Code:
{ C2[$1] += $2; C3[$1] += $3; }
END { for (x in C2) printf "%s\t%d\t%d\n", x, C2[x], C3[x]; }

This User Gave Thanks to m.d.ludwig For This Post:
# 5  
Old 11-18-2011
Hi.. thanks for your reply

but its not summing up , it showing some different values and some negative values ...below is the output
Code:
 $ cat four
NCAS_IND_PORT_TS          4194304000 3892314112
NCAS_IND_PORT_TS          4194304000 4160749568
NCAS_IND_PTP_TS           2097152000 1845493760
NCAS_IND_SSUB_TS          4194304000 3825205248
NCAS_IND_TS               2097152000 2076180480
NCAS_IND_TS               2097152000  146800640
NCAS_IND_VCONF_TS         2097152000 1677721600
NCAS_IND_VLCONN_TS        4194304000 3992977408
NCAS_TS                   2097152000 2086600704
NCAS_TS_CONN              4194304000 4127195136
NCAS_TS_CTP               4194304000 4127195136
NCAS_TS_PORT              4194304000 4127195136
NCAS_TS_PORT              4194304000 4160749568
sridharr@hemavati:~/lab
 $ cat four | awk '{ C2[$1] += $2; C3[$1] += $3; }
continue:END { for (x in C2) printf "%s\t%d\t%d\n", x, C2[x], C3[x]; }'
NCAS_IND_PTP_TS 2097152000      1845493760
NCAS_IND_SSUB_TS        -100663296      -469762048
NCAS_IND_TS     -100663296      -2071986176
NCAS_IND_VCONF_TS       2097152000      1677721600
NCAS_TS_CONN    -100663296      -167772160
NCAS_TS_CTP     -100663296      -167772160
NCAS_TS_PORT    -201326592      -301989888
NCAS_IND_VLCONN_TS      -100663296      -301989888
NCAS_IND_PORT_TS        -201326592      -536870912
NCAS_TS 2097152000      2086600704


Last edited by Scott; 11-18-2011 at 03:45 AM.. Reason: Code tags
# 6  
Old 11-18-2011
Quote:
Originally Posted by ragilla
Hi.. thanks for your reply

but its not summing up , it showing some different values and some negative values ...below is the output
Code:
 $ cat four
NCAS_IND_PORT_TS          4194304000 3892314112
NCAS_IND_PORT_TS          4194304000 4160749568
NCAS_IND_PTP_TS           2097152000 1845493760
NCAS_IND_SSUB_TS          4194304000 3825205248
NCAS_IND_TS               2097152000 2076180480
NCAS_IND_TS               2097152000  146800640
NCAS_IND_VCONF_TS         2097152000 1677721600
NCAS_IND_VLCONN_TS        4194304000 3992977408
NCAS_TS                   2097152000 2086600704
NCAS_TS_CONN              4194304000 4127195136
NCAS_TS_CTP               4194304000 4127195136
NCAS_TS_PORT              4194304000 4127195136
NCAS_TS_PORT              4194304000 4160749568
sridharr@hemavati:~/lab
 $ cat four | awk '{ C2[$1] += $2; C3[$1] += $3; }
continue:END { for (x in C2) printf "%s\t%d\t%d\n", x, C2[x], C3[x]; }'
NCAS_IND_PTP_TS 2097152000      1845493760
NCAS_IND_SSUB_TS        -100663296      -469762048
NCAS_IND_TS     -100663296      -2071986176
NCAS_IND_VCONF_TS       2097152000      1677721600
NCAS_TS_CONN    -100663296      -167772160
NCAS_TS_CTP     -100663296      -167772160
NCAS_TS_PORT    -201326592      -301989888
NCAS_IND_VLCONN_TS      -100663296      -301989888
NCAS_IND_PORT_TS        -201326592      -536870912
NCAS_TS 2097152000      2086600704

Code:
$ /usr/xpg4/bin/awk '{ C2[$1] += $2; C3[$1] += $3; }
END { for (x in C2) printf "%25-s %d %d\n", x, C2[x], C3[x]; }' infile|sort

This User Gave Thanks to ygemici For This Post:
# 7  
Old 11-18-2011
The "%d" is converting the floating point number to integer, which is wrapping. Instead, use:
Code:
printf "%-23s %10.0f %10.0f\n"

Be aware of precision issues if your dataset is large.
 
Login or Register to Ask a Question

Previous Thread | Next Thread

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

awk output yields error: awk:can't open job_name (Autosys)

Good evening, Im newbie at unix specially with awk From an scheduler program called Autosys i want to extract some data reading an inputfile that comprises jobs names, then formating the output to columns for example 1. This is the inputfile: $ more MapaRep.txt ds_extra_nikira_usuarios... (18 Replies)
Discussion started by: alexcol
18 Replies

2. Shell Programming and Scripting

Pass awk field to a command line executed within awk

Hi, I am trying to pass awk field to a command line executed within awk (need to convert a timestamp into formatted date). All my attempts failed this far. Here's an example. It works fine with timestamp hard-codded into the command echo "1381653229 something" |awk 'BEGIN{cmd="date -d... (4 Replies)
Discussion started by: tuxer
4 Replies

3. Shell Programming and Scripting

Passing awk variable argument to a script which is being called inside awk

consider the script below sh /opt/hqe/hqapi1-client-5.0.0/bin/hqapi.sh alert list --host=localhost --port=7443 --user=hqadmin --password=hqadmin --secure=true >/tmp/alerts.xml awk -F'' '{for(i=1;i<=NF;i++){ if($i=="Alert id") { if(id!="") if(dt!=""){ cmd="sh someScript.sh... (2 Replies)
Discussion started by: vivek d r
2 Replies

4. Shell Programming and Scripting

HELP with AWK one-liner. Need to employ an If condition inside AWK to check for array variable ?

Hello experts, I'm stuck with this script for three days now. Here's what i need. I need to split a large delimited (,) file into 2 files based on the value present in the last field. Samp: Something.csv bca,adc,asdf,123,12C bca,adc,asdf,123,13C def,adc,asdf,123,12A I need this split... (6 Replies)
Discussion started by: shell_boy23
6 Replies

5. Shell Programming and Scripting

awk command to compare a file with set of files in a directory using 'awk'

Hi, I have a situation to compare one file, say file1.txt with a set of files in directory.The directory contains more than 100 files. To be more precise, the requirement is to compare the first field of file1.txt with the first field in all the files in the directory.The files in the... (10 Replies)
Discussion started by: anandek
10 Replies

6. Shell Programming and Scripting

Comparison and editing of files using awk.(And also a possible bug in awk for loop?)

I have two files which I would like to compare and then manipulate in a way. File1: pictures.txt 1.1 1.3 dance.txt 1.2 1.4 treehouse.txt 1.3 1.5 File2: pictures.txt 1.5 ref2313 1.4 ref2345 1.3 ref5432 1.2 ref4244 dance.txt 1.6 ref2342 1.5 ref2352 1.4 ref0695 1.3 ref5738 1.2... (1 Reply)
Discussion started by: linuxkid
1 Replies

7. Shell Programming and Scripting

Problem with awk awk: program limit exceeded: sprintf buffer size=1020

Hi I have many problems with a script. I have a script that formats a text file but always prints the same error when i try to execute it The code is that: { if (NF==17){ print $0 }else{ fields=NF; all=$0; while... (2 Replies)
Discussion started by: fate
2 Replies

8. Shell Programming and Scripting

awk: assign variable with -v didn't work in awk filter

I want to filter 2nd column = 2 using awk $ cat t 1 2 2 4 $ VAR=2 #variable worked in print $ cat t | awk -v ID=$VAR ' { print ID}' 2 2 # but variable didn't work in awk filter $ cat t | awk -v ID=$VAR '$2~/ID/ { print $0}' (2 Replies)
Discussion started by: honglus
2 Replies

9. Shell Programming and Scripting

scripting/awk help : awk sum output is not comming in regular format. Pls advise.

Hi Experts, I am adding a column of numbers with awk , however not getting correct output: # awk '{sum+=$1} END {print sum}' datafile 2.15291e+06 How can I getthe output like : 2152910 Thank you.. # awk '{sum+=$1} END {print sum}' datafile 2.15079e+06 (3 Replies)
Discussion started by: rveri
3 Replies

10. Shell Programming and Scripting

Awk problem: How to express the single quote(') by using awk print function

Actually I got a list of file end with *.txt I want to use the same command apply to all the *.txt Thus I try to find out the fastest way to write those same command in a script and then want to let them run automatics. For example: I got the file below: file1.txt file2.txt file3.txt... (4 Replies)
Discussion started by: patrick87
4 Replies
Login or Register to Ask a Question