Login or Register to Ask a Question and Join Our Community

Sponsored Content
Full Discussion: Average of elements throught multiple files
Top Forums Shell Programming and Scripting Average of elements throught multiple files Post 302222732 by jim mcnamara on Thursday 7th of August 2008 12:38:48 PM
Old 08-07-2008
Great. I got it. Try something like this.
Assume your files have the same base name with numbers after them 1 - 100 or so and the files are called filename1... filename<nnn>
Code:
#!/bin/ksh

> outputfile
filecount=0
for file in filename*
do
	sed -n '380000, $p' $file >> outputfile
	filecount=$(( filecount + 1))
done
awk -v filecount=$filecount '
            BEGIN { i=1}
            { avg[ i % 670000]+=$1 }
     	END{for (i=1; i<= 670000; i++) { printf("%.3f\n", avg[i]/filecount) }) ' outputfile > avgfile

The %.3f format specifier controls the precision of the output, this rounds to 1000ths
 

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Help in extracting multiple files and taking average at same time

Hi, I have 20 files which have respective 50 lines with different values. I would like to process each line of the 50 lines in these 20 files one at a time and do an average of 3rd field ($3) of these 20 files. This will be output to an output file. Instead of using join to generate whole... (8 Replies)
Discussion started by: ahjiefreak
8 Replies

2. UNIX for Dummies Questions & Answers

Average for repeated elements in a column

I have a file that looks like this 452 025_E3 8 025_E3 82 025_F5 135 025_F5 5 025_F5 23 025_G2 38 025_G2 71 025_G2 9 026_A12 81 026_A12 10 026_A12 some of the elements in column2 are repeated. I want an output file that will extract the... (1 Reply)
Discussion started by: FelipeAd
1 Replies

3. Shell Programming and Scripting

Computing average values from multiple text files

Hi, first, I have searched in the forum for this, but I could not find the right answer. (There were some similar threads, but I was not sure how to adapt the ideas.) Anyway, I have a quite natural problem: Given are several text files. All files contain the same number of lines and the same... (3 Replies)
Discussion started by: rbredereck
3 Replies

4. Shell Programming and Scripting

Array output through a for loop problematic with multiple elements.

This code works perfect when using a machine with only one interface online. (Excluding the loopback of course) But when I have other interface up for vmware or a vpn the output gets mixed up. I know I had this working when I was just reading ip's from files so I know it is not a problem with... (8 Replies)
Discussion started by: Azrael
8 Replies

5. Shell Programming and Scripting

Computing average and standard deviation from multiple text files

Hello there, I found an elegant solution to computing average values from multiple text files awk '{for (i=1;i<=NF;i++){if ($i!~"n/a"){a+=$i}else{b++}}}END{for (i=1;i<=FNR;i++){for (j=1;j<=NF;j++){printf (a/(3-b))((b>0)?"~"b" ":" ")};printf "\n"}}' file1 file2 file3 I tried to modify... (2 Replies)
Discussion started by: charmmilein
2 Replies

6. Shell Programming and Scripting

Average of a column in multiple files

I have several sequential files with name stat.1000, stat.1001....to stat.1020 with a format like this 0.01 1 3822 4.97379915032e-14 4.96982253992e-09 0 0.01 3822 1 4.97379915032e-14 4.96982253992e-09 0 0.01 2 502 0.00993165137406 993.165137406 0 0.01 502 2 0.00993165137406 993.165137406 0... (6 Replies)
Discussion started by: kayak
6 Replies

7. Shell Programming and Scripting

Number of elements, average value, min & max from a list of numbers using awk

Hi all, I have a list of numbers. I need an awk command to find out the numbers of elements (number of numbers, sort to speak), the average value the min and max value. Reading the list only once, with awk. Any ideas? Thanks! (5 Replies)
Discussion started by: black_fender
5 Replies

8. UNIX for Dummies Questions & Answers

Rename multiple files in shell bash, changing elements order.

Hi, I want to rename several files like this: example: A0805120817.BHN A0805120818.BHN ..... to: 20120817.0805.N 20120818.0805.N ...... How can i do this via terminal or in shell bash script ? thanks, (6 Replies)
Discussion started by: pintolcv
6 Replies

9. Shell Programming and Scripting

Match first two columns and average third from multiple files

I have the following format of input from multiple files File 1 24.01 -81.01 1.0 24.02 -81.02 5.0 24.03 -81.03 0.0 File 2 24.01 -81.01 2.0 24.02 -81.02 -5.0 24.03 -81.03 10.0 I need to scan through the files and when the first 2 columns match I... (18 Replies)
Discussion started by: ncwxpanther
18 Replies

10. Shell Programming and Scripting

Compare multiple arrays elements using awk

I need your help to discover missing elements for each box. In theory each box should have 4 items: ITEM01, ITEM02, ITEM08, and ITEM10. Some boxes either have a missing item (BOX02 ITEM08) or might have da duplicate item (BOX03 ITEM02) and missing another one (BOX03 ITEM01). file01.txt ... (2 Replies)
Discussion started by: alex2005
2 Replies

LEARN ABOUT DEBIAN

mp3cut

MP3CUT(1)							   User Command 							 MP3CUT(1)

NAME

       mp3cut - cut and assemble MP3 files

SYNOPSIS

       mp3cut  [ -o outputfile ] [ -T title ] [ -A artist ] [ -N album-name ] [ -t [hh:]mm:ss[+ms]-[hh:]mm:ss[+ms] ] mp3file [[ -t ...	] mp3file1
       ...]

DESCRIPTION

       The mp3cut utility cuts and assembles MP3 files according to the time specifications given on the command line. The mp3 output  is  written
       to  the	outputfile.  If  no outputfile is given on the command-line, the name for the outputfile is created from the name of the first mp3
       file by adding output.mp3 at the end. The -t flag specifies which part of the mp3 file following it will be extracted.

OPTIONS

       -o outputfile
	      Specify where the output is to be written.

       -T title
	      Specify the title ID3 tag for the output file.

       -A artist
	      Specify the artist ID3 tag for the output file.

       -N album-name
	      Specify the album name ID3 tag for the output file.

       -t [hh:]mm:ss[+ms]-[hh:]mm:ss[+ms]
	      Specify which part of the following mp3file will be included in the output file.

		    hh	= hours
		    mm	= minutes
		    ss	= seconds
		    ms	= milliseconds

	      If the starting time is omitted, 00:00:00+00 is used as starting time. If the ending time is omitted, the end of	the  MP3  file	is
	      used as ending time.

EXAMPLES

       mp3cut -o output.mp3 -t 23:42+500-01:23:42+750 input.mp3
	      Cut  the	segment  from  23  minutes,  42  seconds  and 500 milliseconds to 1 hour, 23 minutes, 42 seconds and 750 milliseconds from
	      input.mp3 and write the output to output.mp3.

       mp3cut -t 00:01-00:02 input1.mp3 -t -15:23 input2.mp3 -t 9:87+500- input3.mp3
	      Append the segments from input1.mp3, input2.mp3 and input3.mp3 and write the output to input1.output.mp3.

AUTHORS

       Manuel Odendahl <manuel@bl0rg.net>, Florian Wesch <dividuum@bl0rg.net>

								   February 2005							 MP3CUT(1)
All times are GMT -4. The time now is 08:25 PM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy