Login or Register to Ask a Question and Join Our Community


Shell Programming and Scripting

how to use awk and wc

Login to Discuss or Reply to this Discussion in Our Community

 
Thread Tools Search this Thread
Top Forums Shell Programming and Scripting how to use awk and wc
# 1  
Old 02-10-2005
how to use awk and wc
Hi,
I need to add the total of column 6 for each min. and find out how many line it had, need to repeat it for 60 mins so the second column will increment to 2.xxx after 60 sec. below is just a sample from my data file.
I am using the following scrip to add the column 6 but dont know how to calculte the number of lines per min.

Code:
/bin/csh 
set i = 0 
while ($i < 47) 
awk 'int($2)=='$i' && $1=="r" && $4==24 {pkt += $6} END {print '$i'": " pkt}' out.tr 
set i = `expr $i + 1` 
end

Code:
+ 1.05751 12 24 tcp 40 ------- 5 12.0 0.5 0 0
- 1.05751 12 24 tcp 40 ------- 5 12.0 0.5 0 0
r 1.062542 12 24 tcp 40 ------- 5 12.0 0.5 0 0
+ 1.062542 24 21 tcp 40 ------- 5 12.0 0.5 0 0
- 1.062542 24 21 tcp 40 ------- 5 12.0 0.5 0 0
r 1.064545 24 21 tcp 40 ------- 5 12.0 0.5 0 0
+ 1.064545 21 20 tcp 40 ------- 5 12.0 0.5 0 0
- 1.064545 21 20 tcp 40 ------- 5 12.0 0.5 0 0
r 1.066549 21 20 tcp 40 ------- 5 12.0 0.5 0 0
+ 1.066549 20 22 tcp 40 ------- 5 12.0 0.5 0 0
- 1.066549 20 22 tcp 40 ------- 5 12.0 0.5 0 0
r 1.068552 20 22 tcp 40 ------- 5 12.0 0.5 0 0
+ 1.068552 22 0 tcp 40 ------- 5 12.0 0.5 0 0
- 1.068552 22 0 tcp 40 ------- 5 12.0 0.5 0 0
r 1.073584 22 0 tcp 40 ------- 5 12.0 0.5 0 0
+ 1.073584 0 22 ack 40 ------- 5 0.5 12.0 0 1
- 1.073584 0 22 ack 40 ------- 5 0.5 12.0 0 1
r 1.997913 18 19 ack 344 ------- 0 0.0 2.0 199697 2262
+ 1.997913 19 23 ack 344 ------- 0 0.0 2.0 199697 2262
- 1.997913 19 23 ack 344 ------- 0 0.0 2.0 199697 2262
r 1.999941 19 23 ack 344 ------- 0 0.0 2.0 199697 2262
+ 1.999941 23 2 ack 344 ------- 0 0.0 2.0 199697 2262
- 1.999941 23 2 ack 344 ------- 0 0.0 2.0 199697 2262
+ 2 3 23 tcp 40 ------- 1 3.0 0.1 44 2263
- 2 3 23 tcp 40 ------- 1 3.0 0.1 44 2263
r 2.005032 3 23 tcp 40 ------- 1 3.0 0.1 44 2263
+ 2.005032 23 19 tcp 40 ------- 1 3.0 0.1 44 2263
- 2.005032 23 19 tcp 40 ------- 1 3.0 0.1 44 2263
r 2.005216 23 2 ack 344 ------- 0 0.0 2.0 199697 2262
r 2.007035 23 19 tcp 40 ------- 1 3.0 0.1 44 2263
+ 2.007035 19 18 tcp 40 ------- 1 3.0 0.1 44 2263
- 2.007035 19 18 tcp 40 ------- 1 3.0 0.1 44 2263
r 2.009038 19 18 tcp 40 ------- 1 3.0 0.1 44 2263
+ 2.009038 18 22 tcp 40 ------- 1 3.0 0.1 44 2263
- 2.009038 18 22 tcp 40 ------- 1 3.0 0.1 44 2263
r 2.011042 18 22 tcp 40 ------- 1 3.0 0.1 44 2263
+ 2.011042 22 0 tcp 40 ------- 1 3.0 0.1 44 2263
- 2.011042 22 0 tcp 40 ------- 1 3.0 0.1 44 2263
r 2.016074 22 0 tcp 40 ------- 1 3.0 0.1 44 2263
v 2.097451853119999 eval {set sim_annotation {S 0 INV _o568:0}}
+ 2.099011 4 23 tcp 83 ---A--- 2 4.0 0.2 44 2264
- 2.099011 4 23 tcp 83 ---A--- 2 4.0 0.2 44 2264
+ 2.1 2 23 tcp 40 ------- 0 2.0 0.0 87 2265
- 2.1 2 23 tcp 40 ------- 0 2.0 0.0 87 2265
r 2.104077 4 23 tcp 83 ---A--- 2 4.0 0.2 44 2264
+ 2.104077 23 19 tcp 83 ---A--- 2 4.0 0.2 44 2264
- 2.104077 23 19 tcp 83 ---A--- 2 4.0 0.2 44 2264
r 2.105032 2 23 tcp 40 ------- 0 2.0 0.0 87 2265
+ 2.105032 23 19 tcp 40 ------- 0 2.0 0.0 87 2265

Any help will be appreciated
Last edited by zazzybob; 02-10-2005 at 06:21 PM.. Reason: added code tags
# 2  
Old 02-10-2005
Rather than reading the file 47 times in a loop, use awk to read it once and store the values in arrays, e.g...
Code:
awk '$1=="r" && $4==24 {
    sum[int($2)] += $6
    cnt[int($2)] ++
  }
  END {
    for (x=0; x<47; x++)
      if (cnt[x])
        printf "Index: %d Count: %d Sum: %d\n", x, cnt[x], sum[x]
  }' out.tr

Tested...

Index: 1 Count: 1 Sum: 40
# 3  
Old 02-10-2005
Getting error
printf "Index: %d Count: %d Sum: %d\n", x, cnt[x], sum[x]
}' out.trUnmatched '
%B%M:[%~]> Unmatched '
%B%M:[%~]> Badly placed ()'s
%B%M:[%~]> Badly placed ()'s
%B%M:[%~]> }: Command not found
%B%M:[%~]> END: Command not found
%B%M:[%~]> Badly placed ()'s
%B%M:[%~]> cnt[x]: No match
%B%M:[%~]> No match
%B%M:[%~]>
Login or Register to Ask a Question

Previous Thread | Next Thread

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

awk output yields error: awk:can't open job_name (Autosys)

Good evening, Im newbie at unix specially with awk From an scheduler program called Autosys i want to extract some data reading an inputfile that comprises jobs names, then formating the output to columns for example 1. This is the inputfile: $ more MapaRep.txt ds_extra_nikira_usuarios... (18 Replies)
Discussion started by: alexcol
18 Replies

2. Shell Programming and Scripting

Pass awk field to a command line executed within awk

Hi, I am trying to pass awk field to a command line executed within awk (need to convert a timestamp into formatted date). All my attempts failed this far. Here's an example. It works fine with timestamp hard-codded into the command echo "1381653229 something" |awk 'BEGIN{cmd="date -d... (4 Replies)
Discussion started by: tuxer
4 Replies

3. Shell Programming and Scripting

Passing awk variable argument to a script which is being called inside awk

consider the script below sh /opt/hqe/hqapi1-client-5.0.0/bin/hqapi.sh alert list --host=localhost --port=7443 --user=hqadmin --password=hqadmin --secure=true >/tmp/alerts.xml awk -F'' '{for(i=1;i<=NF;i++){ if($i=="Alert id") { if(id!="") if(dt!=""){ cmd="sh someScript.sh... (2 Replies)
Discussion started by: vivek d r
2 Replies

4. Shell Programming and Scripting

HELP with AWK one-liner. Need to employ an If condition inside AWK to check for array variable ?

Hello experts, I'm stuck with this script for three days now. Here's what i need. I need to split a large delimited (,) file into 2 files based on the value present in the last field. Samp: Something.csv bca,adc,asdf,123,12C bca,adc,asdf,123,13C def,adc,asdf,123,12A I need this split... (6 Replies)
Discussion started by: shell_boy23
6 Replies

5. Shell Programming and Scripting

awk command to compare a file with set of files in a directory using 'awk'

Hi, I have a situation to compare one file, say file1.txt with a set of files in directory.The directory contains more than 100 files. To be more precise, the requirement is to compare the first field of file1.txt with the first field in all the files in the directory.The files in the... (10 Replies)
Discussion started by: anandek
10 Replies

6. Shell Programming and Scripting

Comparison and editing of files using awk.(And also a possible bug in awk for loop?)

I have two files which I would like to compare and then manipulate in a way. File1: pictures.txt 1.1 1.3 dance.txt 1.2 1.4 treehouse.txt 1.3 1.5 File2: pictures.txt 1.5 ref2313 1.4 ref2345 1.3 ref5432 1.2 ref4244 dance.txt 1.6 ref2342 1.5 ref2352 1.4 ref0695 1.3 ref5738 1.2... (1 Reply)
Discussion started by: linuxkid
1 Replies

7. Shell Programming and Scripting

Problem with awk awk: program limit exceeded: sprintf buffer size=1020

Hi I have many problems with a script. I have a script that formats a text file but always prints the same error when i try to execute it The code is that: { if (NF==17){ print $0 }else{ fields=NF; all=$0; while... (2 Replies)
Discussion started by: fate
2 Replies

8. Shell Programming and Scripting

awk: assign variable with -v didn't work in awk filter

I want to filter 2nd column = 2 using awk $ cat t 1 2 2 4 $ VAR=2 #variable worked in print $ cat t | awk -v ID=$VAR ' { print ID}' 2 2 # but variable didn't work in awk filter $ cat t | awk -v ID=$VAR '$2~/ID/ { print $0}' (2 Replies)
Discussion started by: honglus
2 Replies

9. Shell Programming and Scripting

scripting/awk help : awk sum output is not comming in regular format. Pls advise.

Hi Experts, I am adding a column of numbers with awk , however not getting correct output: # awk '{sum+=$1} END {print sum}' datafile 2.15291e+06 How can I getthe output like : 2152910 Thank you.. # awk '{sum+=$1} END {print sum}' datafile 2.15079e+06 (3 Replies)
Discussion started by: rveri
3 Replies

10. Shell Programming and Scripting

Awk problem: How to express the single quote(') by using awk print function

Actually I got a list of file end with *.txt I want to use the same command apply to all the *.txt Thus I try to find out the fastest way to write those same command in a script and then want to let them run automatics. For example: I got the file below: file1.txt file2.txt file3.txt... (4 Replies)
Discussion started by: patrick87
4 Replies
Login or Register to Ask a Question