Login or Register to Ask a Question and Join Our Community

Sponsored Content
Full Discussion: Sum value from selected lines script (awk,perl)
Top Forums Shell Programming and Scripting Sum value from selected lines script (awk,perl) Post 302360760 by paolfili on Saturday 10th of October 2009 08:02:18 AM
Old 10-10-2009
Sum value from selected lines script (awk,perl)
Hello.
I face this (2 side) problem.

Some lines with this structure.

...........
12345678 4
12345989 13
12346356 205
12346644 74
12346819 22
.........


The first field (timestamp) is growing (or at least equal).

1)Sum the second fields if the first_field/500 are equals.
2)Sum the second fields if the difference between first fields is less than 500.
(sliding window)

In the example presented.

1) Becouse 12345678/500 and 12345989/500 both result 24691 sum=4+13
We cannot group the 3rd line so sum=205
And we group the 4th and 5th line so sum=74+22

2) We group the 1st and 2nd line becouse 12345989 - 12345678 < 500
For analogy we group the 2nd and 3th, the 3rd and 4th,
and the 3rd,4th and 5th becouse 12346819 (of the 5th line) - 12346356 (of the 3th line) < 500


Is there any (perl,awk,etc...) way to do it?

Thanks

Paolo
 

10 More Discussions You Might Find Interesting

1. UNIX for Dummies Questions & Answers

extracting selected few lines through perl

How can I extract few lines(like 10 to 15, top 10 and last 10) from a file using perl. I do it with sed, head and tail in unix scripting. I am new to perl. Appreciate your help. (2 Replies)
Discussion started by: paruthiveeran
2 Replies

2. Shell Programming and Scripting

Sum of all lines in file without roundup with awk

Hi, I have a file and I want to sum all the numbers in it. Example of the file: 0.6714359 -3842.59553830551 I used your forum (https://www.unix.com/shell-programming-scripting/74293-how-get-sum-all-lines-file.html) and found a script, what worked for me: awk '{a+=$0}END{print a}'... (8 Replies)
Discussion started by: mario8eren
8 Replies

3. Shell Programming and Scripting

shell script(Preferably awk or sed) to print selected number of columns from each row

Hi Experts, The question may look very silly by seeing the title, but please have a look at it clearly. I have a text file where the first 5 columns in each row were supposed to be attributes of a sample(like sample name, number, status etc) and the next 25 columns are parameters on which... (3 Replies)
Discussion started by: ks_reddy
3 Replies

4. Shell Programming and Scripting

Perl script to find particular field and sum it

Hi, I have a file with format a b c d e 1 1 2 2 2 1 2 2 2 3 1 1 1 1 2 1 1 1 1 4 1 1 1 1 6 in column e i want to find all similar fields ( with perl script )and sum it how many are there for instance in format above. 2 - 2 times 4 - 1 time 6 - 1 time what i use is ... (14 Replies)
Discussion started by: Learnerabc
14 Replies

5. Shell Programming and Scripting

trying to print selected fields of selected lines by AWK

I am trying to print 1st, 2nd, 13th and 14th fields of a file of line numbers from 29 to 10029. I dont know how to put this in one code. Currently I am removing the selected lines by awk 'NR==29,NR==10029' File1 > File2 and then doing awk '{print $1, $2, $13, $14}' File2 > File3 Can... (3 Replies)
Discussion started by: ananyob
3 Replies

6. Shell Programming and Scripting

awk script for getting the selected records from a file.

Hello, I have attached one file named file.txt . I have to create a file using the awk script with the records in which 38th position is P and not V . ex it should have 00501 HOLTSVILLE NYP00501 and it should not include 00501 I R S SERVICE CENTER ... (3 Replies)
Discussion started by: sonam273
3 Replies

7. Shell Programming and Scripting

AWK script - extracting min and max values from selected lines

Hi guys! I'm new to scripting and I need to write a script in awk. Here is example of file on which I'm working ATOM 4688 HG1 PRO A 322 18.080 59.680 137.020 1.00 0.00 ATOM 4689 HG2 PRO A 322 18.850 61.220 137.010 1.00 0.00 ATOM 4690 CD ... (18 Replies)
Discussion started by: grincz
18 Replies

8. Shell Programming and Scripting

Summing over specific lines and replacing the lines with the sum using sed, awk

Hi friends, This is sed & awk type question. I have a text file which has numbers spread all over the file. I want to sum the series of numbers whenever i find it and produce an output file with the sum. For example ###start of input text file #### abc def ghi 1 2 3 4 kjld random... (3 Replies)
Discussion started by: kaaliakahn
3 Replies

9. UNIX for Dummies Questions & Answers

awk to sum column field from duplicate row/lines

Hello, I am new to Linux environment , I working on Linux script which should send auto email based on the specific condition from log file. Below is the sample log file Name m/c usage abc xxx 10 abc xxx 20 abc xxx 5 xyz ... (6 Replies)
Discussion started by: asjaiswal
6 Replies

10. Shell Programming and Scripting

Shell script count lines and sum numbers from multiple files

I want to count the number of lines, I need this result be a number, and sum the last numeric column, I had done to make this one at time, but I need to make this for a crontab, so, it has to be an script, here is my lines: It counts the number of lines: egrep -i String file_name_201611* |... (5 Replies)
Discussion started by: Elly
5 Replies

LEARN ABOUT DEBIAN

mhc

mhc(5)								File Formats Manual							    mhc(5)

NAME

       mhc - Message Harmonized Calendaring system

DESCRIPTION

       This  manual  page  documents  briefly the mhc file format.  This manual page was written for the Debian GNU/Linux distribution because the
       original program does not have a manual page.

FIELDS

       Mhc file format is based on STD11/RFC822: Standard for the format of ARPA Internet text messages.  In mhc file, the following extra  header
       fields are used.

       X-SC-Day:
	      Date of event in format yyyymmdd.  You can specify multiple date with space separated like:

		 X-SC-Day: 19990409 19990413

	      which means April 9th 1999 and April 13th 1999.

       X-SC-Time:
	      Time of event in format hh:mm-hh:mm or hh:mm.  For event which has no meanings about time, you can leave it empty in this field.

       X-SC-Duration:
	      Period  of event in yyyymmdd-yyyymmdd.  You can omit start date or end date, like "19991121-".  X-SC-Duration: is used only to limit
	      date specified by X-SC-Day: or X-SC-Cond, so you can't describe event date only by X-SC-Duration:.  If X-SC-Duration: is	empty,	it
	      means no limit.

       X-SC-Cond:
	      Condition of event date by using following keyword.

		 00-31 Day of month.

		 1st 2nd 3rd 4th 5th Last Week in month.

		 Sun Mon ... Sat Day of week.

		 Jan Feb ... Dec Month

	      Examples,

		 X-SC-Cond: Tue Fri
			Every Tuesday and Friday.

		 X-SC-Cond: 31 Aug
			Every August 31th.

		 X-SC-Cond: 1st 3rd Fri
			Every 1st and 3rd Friday.

		 X-SC-Cond: Fri
		 X-SC-Day: !19990409
			Every Friday, but except April 9th 1999.

		 X-SC-Cond: Fri 13
			Every 13th and Every Friday, not 13th Friday.

       X-SC-Alarm:
	      Hint  for alarm of event.  Currently, mhc.el doesn't alaram, but gemcal will pop-up alarm window.  It will be useful if you transfer
	      this event to PalmOS.  In X-SC-Alarm:, you can specify the number (1 to 99) with suffix such as minute, hour or day.  For example,

		 X-SC-Alarm: 10 minutes
			Alarm 10 minutes before event.

		 X-SC-Alarm: 3 hour
			Alarm 3 hours before event.

		 X-SC-Alarm: 3 day
			Alarm 3 day before event.

       X-SC-Subject:
	      Subject of event. unstructured?

       X-SC-Location:
	      Location of event. unstructured?

       X-SC-Category
	      Category of event.  Any keyword, space separeated.  Case ignored.

       X-SC-Recoard-Id:
	      Internal use only.

SEE ALSO

       adb2mhc(1) gemcal(1), mhc-sync(1), mhc2palm(1), palm2mhc(1), today(1).

AUTHOR

       This program was written by Yoshinari Nomura <nom@quickhack.net> and this manual page was written by  Fumitoshi	UKAI  <ukai@debian.or.jp>,
       for the Debian GNU/Linux system (but may be used by others).

								    23 Jun 2000 							    mhc(5)
All times are GMT -4. The time now is 11:09 AM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy