How to averaging column based on first column values


 
Thread Tools Search this Thread
Top Forums Shell Programming and Scripting How to averaging column based on first column values
# 1  
Old 08-15-2011
Question How to averaging column based on first column values

Hello

I have file that consist of 2 columns of millions of entries

timestamp and throughput

I want to find the average (throughput ) for each equal timestamp before change it to proper format

e.g : i want to average 2 coloumnd fot all 1308154800 values in column 1
and then
print 1308154800 with its average result
print 1308156600 with its average result
.
.
.
etc


sample file :

timestamp throughput
1308154800 7217
1308154800 353
1308154800 85
1308154800 35
1308154800 302
1308154800 778
1308154800 NA
1308154800 NA
1308154800 383
1308156600 4232
1308156600 10480
1308156600 10148
1308156600 2
1308156600 792608
1308156600 5362
1308156600 964
1308156600 10
1308156600 1666
1308156600 91
1308156600 NA
1308156600 0
1308156600 NA
1308156600 0
1308156600 729
1308156600 6
1308156600 34565
1308156600 5
1308156600 34
1308156600 0
1308156600 NA
1308156600 0
1308156600 0
1308156600 1375
1308156600 2087
1308156600 0
1308157200 NA
1308157200 134944
1308157200 NA
1308157200 647020
1308157200 NA

Thank you
# 2  
Old 08-15-2011
Have a look here and here

Last edited by h@foorsa.biz; 08-15-2011 at 05:04 PM..
# 3  
Old 08-15-2011
Thank you h@ foorsa . biz

But :

I have i condition in my code

if or switch ( $1 is equal to next value in $1 )
( make an average for adjacent $2 )
then print timestamp value and average for specific timestamp
then go to next.

I've tried work with arrays but I could not do it

thank you
# 4  
Old 08-15-2011
Code:
awk '{ T[$1] += $2; C[$1] ++; }
END { for (k in T) {  printf("%s\t%f\n",  k,T[k]/C[k]);    }'

This User Gave Thanks to Corona688 For This Post:
# 5  
Old 08-15-2011
Thank you very much Corona688
Login or Register to Ask a Question

Previous Thread | Next Thread

10 More Discussions You Might Find Interesting

1. UNIX for Beginners Questions & Answers

Filtering based on column values

Hi there, I am trying to filter a big file with several columns using values on a column with values like (AC=5;AN=10;SF=341,377,517,643,662;VRT=1). I wont to filter the data based on SF= values that are (bigger than 400) ... (25 Replies)
Discussion started by: daashti
25 Replies

2. Shell Programming and Scripting

Concatenate values in the first column based on the second column.

I have a file (myfile.txt) with contents like this: 1.txt apple is 3.txt apple is 5.txt apple is 2.txt apple is a 7.txt apple is a 8.txt apple is a fruit 4.txt orange not a fruit 6.txt zero isThe above file is already sorted using this command: sort -k2 myfile.txtMy objective is to get... (3 Replies)
Discussion started by: shoaibjameel123
3 Replies

3. UNIX for Dummies Questions & Answers

Repositioning based on column values

Dear all ... I have a file which I want to change the structure based on the values in some columns and I would be grateful if you can help... one of my files looks like ... they all have ten rows 1,0,0 10,0,0 2,0,0 3,0,0 4,1,1 4,1,1 4,1,1 5,0,0 6,0,0 7,0,0 8,0.5,2 9,0.33,3 9,0.33,3... (1 Reply)
Discussion started by: A-V
1 Replies

4. Shell Programming and Scripting

Fetch parent value based on column values

Hi All, I am trying to achieve the below logic, could you please help me in this. In second row 2nd column I've Value JC2 and the same JC2 is 4th row 1st column.So I need to replace JC2 value in 4th row with JC2 2nd row's 1st column. Input: Job1,JC1 Job1,JC2 Job1,JC3 JC2,JA1... (6 Replies)
Discussion started by: unme
6 Replies

5. Shell Programming and Scripting

Sum column values based in common identifier in 1st column.

Hi, I have a table to be imported for R as matrix or data.frame but I first need to edit it because I've got several lines with the same identifier (1st column), so I want to sum the each column (2nd -nth) of each identifier (1st column) The input is for example, after sorted: K00001 1 1 4 3... (8 Replies)
Discussion started by: sargotrons
8 Replies

6. Shell Programming and Scripting

Adding values of a column based on another column

Hello, I have a data such as this: ENSGALG00000000189 329 G A 4 2 0 ENSGALG00000000189 518 T C 5 1 0 ENSGALG00000000189 1104 G A 5 1 0 ENSGALG00000000187 3687 G T 5 1 0 ENSGALG00000000187 4533 A T 4 2 0 ENSGALG00000000233 5811 T C 4 2 0 ENSGALG00000000233 5998 C A 5 1 0 I want to... (3 Replies)
Discussion started by: Homa
3 Replies

7. UNIX for Dummies Questions & Answers

Changing values of a column based on formula

Hi, I have a tab delimited text file with two columns where the second column takes on values between 1 and 6 (including). If the value of the second column, includes 1,2,3 I want to replace it with LOW. If it is 4,5,6 I want to replace it with HIGH. How do I go about doing that? Thanks ... (3 Replies)
Discussion started by: evelibertine
3 Replies

8. Shell Programming and Scripting

Splitting file based on column values

Hi all, I have a file (say file.txt) which contains comma-separated rows. Each row has seven columns. Only column 4 or 5 (not both) can have empty values like "" in each line. Sample lines So, now i want all the rows that have column 4 as "" go in file1.txt and all the rows that have column... (8 Replies)
Discussion started by: jakSun8
8 Replies

9. Shell Programming and Scripting

How to pick values from column based on key values by usin AWK

Dear Guyz:) I have 2 different input files like this. I would like to pick the values or letters from the inputfile2 based on inputfile1 keys (A,F,N,X,Z). I have done similar task by using awk but in that case the inputfiles are similar like in inputfile2 (all keys in 1st column and values in... (16 Replies)
Discussion started by: repinementer
16 Replies

10. Shell Programming and Scripting

averaging column values with awk

Hello. Im just starting to learn awk so hang in there with me...I have a large text file formatted as such everything is in a single column ID001 value 1 value 2 value....n ID002 value 1 value 2 value... n I want to be able to calculate the average for values for each ID from the... (18 Replies)
Discussion started by: johnmillsbro
18 Replies
Login or Register to Ask a Question