how to manipulate with lines while playing with data


 
Thread Tools Search this Thread
Top Forums Shell Programming and Scripting how to manipulate with lines while playing with data
# 1  
Old 09-15-2009
Lightbulb how to manipulate with lines while playing with data

hello everyone,

well I have a file which contains data, I want to add the data on hourly basis, like my file contains data for 24 hours, (so a total of 1440 [60*24]) lines.

Now i want to add the data on hourly basis to get average values.

like if I use (head) command it is ok for first go, but for next next step how can I use it starting from 60 to 120 and so on.

for the first case (from 0 to 60 sec i.e. one hour) i use awk utility and its giving me correct result but for further i cant. Here is the code for first case:

Code:
awk 'BEGIN{total=0}
{total += $1}
END{print total}' test.wri

Please HelpSmilie
# 2  
Old 09-15-2009
Quote:
Originally Posted by jojo123
from 60 to 120
How about ...

Code:
head -n 120 | tail -n 60

# 3  
Old 09-15-2009
Question

thnkz dr.house, for your reply, but for the below code the output is the last 60 lines of the file....

can u please advice me further....Smilie
# 4  
Old 09-15-2009
Try

Code:
$ awk '{ total += $1 } NR % 60 == 0{ print total ; total = 0 }' filename

# 5  
Old 09-15-2009
hahaha my GOD agn, you are simply awesome.

Thnkz for helping me this way... now can you please describe me a bit regarding this code i'll be grateful to you..

I mean how this code is working
# 6  
Old 09-15-2009
NR represents record number(line number) in awk. So 'NR % 60 == 0' checks if the current line is 60th line and prints the total if it is the 60th line.
Login or Register to Ask a Question

Previous Thread | Next Thread

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Help - manipulate data by columns and repeated

Hello good afternoon to everyone. I'm new to the forum and would like to request your help in handling data. I hope my English is clear. I have a file (Dato01.txt) to contine the following structure. # Col1 - Col2 - Col3 - Col4 Patricia started Jun 22 05:22:58 Carolina started Jun... (5 Replies)
Discussion started by: kelevra
5 Replies

2. Shell Programming and Scripting

Extract & Manipulate continous data stream-- tcpdump

Hello; I have this rather tricky problem to solve --(to me, anyways) .. I am processing the following one liner with tcpdump.. tcpdump -i T3501 -A ether host 00:1e:49:29:fc:c9 or ether host 00:1b:2b:86:ec:1b or ether host 00:21:1c:98:a4:08 and net 149.83.6.0/24 | grep --line-buffered -B... (5 Replies)
Discussion started by: delphys
5 Replies

3. Shell Programming and Scripting

Need help to manipulate data using script

Hi i want to manipulate my data to convert row to column name 600 Slno vlan 1 600 2 609 3 700 name 700 Slno vlan 1 600 2 609 3 700 (8 Replies)
Discussion started by: nith_anandan
8 Replies

4. Shell Programming and Scripting

Extracting specific lines of data from a file and related lines of data based on a grep value range?

Hi, I have one file, say file 1, that has data like below where 19900107 is the date, 19900107 12 144 129 0.7380047 19900108 12 168 129 0.3149017 19900109 12 192 129 3.2766666E-02 ... (3 Replies)
Discussion started by: Wynner
3 Replies

5. Shell Programming and Scripting

Manipulate data in detail problem facing

Input Participant number: HAC Position type Location Distance_start Distance_end Range Mark 1 1 + Front 808 1083 276 2 1 + Front 1373 1636 264 3 1 - Back 1837 2047 211 Participant number: BCD Position type... (6 Replies)
Discussion started by: patrick87
6 Replies

6. Shell Programming and Scripting

Playing with Volume of data

Quick problem statement: How to read/extract data from a big-big file. Details: We are having a big big problemo in the work we are working at. We are using solaris plarform E25. There is a very big file created somewhere around 200 million records anad the lenght of each record is more than... (3 Replies)
Discussion started by: darshanw
3 Replies

7. Shell Programming and Scripting

Manipulate lines with sed/awk

Hey All, I need to reorganize a file's text. Here is the source: host John_Doe filename "config.cfg"; hardware ethernet 98:10:3d:13:8f:98; fixed-address 10.10.10.29; } host Jane_Doe filename "config.cfg"; hardware ethernet 98:13:11:fd:5a:57; fixed-address 10.10.5.24; } host... (2 Replies)
Discussion started by: TheBigAmbulance
2 Replies

8. UNIX for Dummies Questions & Answers

Excel data manipulate

All, I have the following format of data in a spreadsheet A 1 2 3 4 B 1 2 3 4 where 'A' is value of 'A1', '1 2 3 4' is value of cell B1, 'B' is value of cell A2, and '1 2 3 4' is value of cell B2. There... (12 Replies)
Discussion started by: rahulrathod
12 Replies

9. Shell Programming and Scripting

manipulate data with specific format

Hi everybody: I have a problem with how I have to manipulate the data which have specific format like this: 249. 0.30727021E+05 0.30601627E+05 0.37470780E-01 -0.44745335E+02 0.82674536E+03 248. 0.30428182E+05 0.30302787E+05 0.40564921E-01 -0.45210293E+02 ... (5 Replies)
Discussion started by: tonet
5 Replies

10. Shell Programming and Scripting

sed or other tool to manipulate data, including email addresses

I have a list of names and email addresses, like this. The <tab> markers are actually tabs. joe.blow <tab> joe.blow@wherever.com tom.t.hall <tab> tom.t.hall@wherever.com john.r.smith <tab> john.r.smith@wherever.com sally.jones <tab> sally.jones@state.or.us I want to parse the data so that... (3 Replies)
Discussion started by: manouche
3 Replies
Login or Register to Ask a Question