Login or Register to Ask a Question and Join Our Community

Sponsored Content
Full Discussion: Taking the averages of columns with deletion of some lines
Top Forums Shell Programming and Scripting Taking the averages of columns with deletion of some lines Post 302806127 by begin_shell on Sunday 12th of May 2013 02:34:08 PM
Old 05-12-2013
Taking the averages of columns with deletion of some lines
Hi,

I am in stage of post processing some of my results. I wanted to plot the data against the three axis x,y,z. The data file is quite complicated and i have to take the average of x, y,z over different steps of my test. A typical file look like below:

HTML Code:
Time taken:4s
No.of series : 3
Step:1
ID   X       Y      z
1    0.1    0.4   0.45
2    1.2   -1.2   0.25
3   -0.5   -1.2   0.26
3    0.8   -2.1   1.45
1    1.2   -8.2   0.25
2    0.25   1.2   0.25
Time taken:5s
No.of series : 3
Step:2
ID   X       Y      z
3    1.0    0.1    0.5
1   -2.0   -0.2    0.25
2   -0.4   -0.2   -0.60
2   -0.1   -1.1   -0.45
3    0.2   -0.2    0.25
1    1.1   -1.2    0.25
What i wanted to do?
From the above data, i wanted to get the average of values of X , Y , Z (column 2,3,4) along with Column 1 with title as their corresponding step number (i.e) Step.

The thing is that original file is so big that the number of IDs here shown as 3 is actually 600 and the steps are around 25000 which is shown here as two steps.I wanted to delete these following lines (which is displayed inbetween the steps ) while doing this automatically :

HTML Code:
Time taken:5s
No.of series : 3
Expected Output : I am in need of an output as a file, which exactly looks like this:

HTML Code:
Step:1 
ID    X         Y        z
1    0.65    -3.9    0.35
2    0.725    0      0.25
3    0.15    -1.65  0.855
Step:2
ID   X         Y      z
1    -0.45  -0.7     0.25
2   -0.25   -0.65   -0.525
3    0.6     -0.05    0.375

I would much thankfull for your immediate inputs on making a script for achieving the above result.
 

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Deletion of lines in a text file

Hi Everyone, Please help me with this. I have gone through many posts here but couldn't find what I wanted. I have a file with 79000+ lines and I want to delete lines in a pattern. I want to delete every 141st line in the file, starting from line 2000 till 50000. Please help guys. ... (8 Replies)
Discussion started by: max29583
8 Replies

2. UNIX for Dummies Questions & Answers

deletion of all lines ends with :

I have below file say temp1 BSCAJM1:HWJA10C BSCAJM1: BSCALW1: BSCALW1:GVND01B BSCALW1: BSCALW1: BSCBKNR:IJNMKTA BSCBKNR: BSCJOD1: BSCJOD1:JOD121B i want to delete all the lines ending with : and have below output BSCAJM1:HWJA10C BSCALW1:GVND01B BSCBKNR:IJNMKTA... (8 Replies)
Discussion started by: lalchand
8 Replies

3. Shell Programming and Scripting

Operations on a file with Deletion , Modification and Insertion of lines

Hi All , Given a file , I need to delete , modify and insert lines matching certain patterns in that file using shell scripting. e.g. If a file FILE1 has following content : CUST.ABC.DEF = CUST.ABC.DEF * CUST.ABC.DEF PRINTF(CUST.ABC.DEF) CUST.ABC.DEF = mid(CUST.ABC.DEF,10.34)... (5 Replies)
Discussion started by: swapnil.nawale
5 Replies

4. Shell Programming and Scripting

Taking 3 greped/awked lines of text

Say I used grep and awk for taking text out of a text file... I now /have 3 lines of text that I want to combine to make 1 line. What command could I use to do this? ... display line 1 twice then sed s/$line1/$line2/ ????... display line 2 twice then sed s/$line2/$line3/ (2 Replies)
Discussion started by: puttster
2 Replies

5. Shell Programming and Scripting

Comparison and deletion of lines between two files

Hi i need an help. I have two files list1 and list2, both contains the server names i want to delete the servers in list2 which were also found in list1. for an eg list2 list1 oradg1 oradg4 oradg2 oradg2 oradg3 ... (5 Replies)
Discussion started by: sudharson
5 Replies

6. Shell Programming and Scripting

Calculate Averages !

Hi, I have a file with more than 2,000 rows like this: 05/26/2011,1200,1500 I would like to create a awk shell script that calculate the price average of the second and third field each 5,10 and 20 rows or ask me for the values, starting at first row. Finally compare the average value... (1 Reply)
Discussion started by: csierra
1 Replies

7. Shell Programming and Scripting

Moving Averages SMA !

Hello, I am trying to create a awk script to calculate the simple moving average of two fields but I got only the result of the first field. Could you please help me to fix this awk shell script awk -F, -v points=5 ' { a = $2; b = $3; if(NR>=points) { total_a = 0; total_b... (1 Reply)
Discussion started by: csierra
1 Replies

8. UNIX for Dummies Questions & Answers

Taking the average of two columns and printing it on a new column

Hi, I have a space delimited text file that looks like the following: Aa 100 200 Bb 300 100 Cc X 500 Dd 600 X Basically, I want to take the average of columns 2 and 3 and print it in column 4. However if there is an X in either column 2 or 3, I want to print the non-X value. Therefore... (11 Replies)
Discussion started by: evelibertine
11 Replies

9. How to Post in the The UNIX and Linux Forums

Daily averages...

I have date file like below.. 1995 1 2 10 29 38.6706 -6.53823 41.9201 1995 1 2 10 29 -49.2477 -4.59733 17.2704 1995 1 2 10 29 -49.2369 -4.48045 8.61348 1995 1 3 8 48 -42.2643 ... (3 Replies)
Discussion started by: athithi
3 Replies

10. Shell Programming and Scripting

Merging multiple lines to columns with awk, while inserting commas for missing lines

Hello all, I have a large csv file where there are four types of rows I need to merge into one row per person, where there is a column for each possible code / type of row, even if that code/row isn't there for that person. In the csv, a person may be listed from one to four times... (9 Replies)
Discussion started by: RalphNY
9 Replies

LEARN ABOUT DEBIAN

ngraph

NGRAPH(1)						      General Commands Manual							 NGRAPH(1)

NAME

       Ngraph - creating scientific 2-dimensional graphs

SYNOPSIS

       ngraph [options] [data file(s) or ngp file]

DESCRIPTION

       Ngraph  is  the program to create scientific 2-dimensional graphs for researchers and engineers. Graphs can be exported to PostScript, SVG,
       PNG or PDF format.

OPTIONS

       Command line options are:

       -L file
	      load ngp file

       -x column
	      data column for the x axis

       -y column
	      data column for the y axis

       -X     use X axis as the x axis

       -Y     use Y axis as the y axis

       -U     use U axis as the x axis

       -R     use R axis as the y axis

       -d {mark | line | polygon | curve | diagonal | arrow | rectangle | rectangle_fill | rectangle_solid_fill | errorbar_x | errorbar_y | stair-
       case_x | staircase_y | bar_x | bar_y | bar_fill_x | bar_fill_y | bar_solid_fill_x | bar_solid_fill_y | fit}
	      specify plot type

       -m type
	      specify mark type (0-89)

       -o size
	      specify mark size

       -l style
	      specify line style

       -w width
	      specify line width

       -CR n  specify red component of the 1st plot color (0-255)

       -CG n  specify green component of the 1st plot color (0-255)

       -CB n  specify blue component of the 1st plot color (0-255)

       -cr n  specify red component of the 2nd plot color (0-255)

       -cg n  specify green component of the 2nd plot color (0-255)

       -cb n  specify blue component of the 2nd plot color (0-255)

       -s line
	      specify number of the head skip

       -r step
	      specify number of the read step

       -f line
	      specify number of the final line

       -vx n  neighbor average of the x data

       -vy n  neighbor average of the y data

       -mx formula
	      specify math transformation for the x data

       -my formula
	      specify math transformation for the y data

       -ex {linear | log | inverse | MJD}
	      specify scale type of the x axis

       -ey {linear | log | inverse | MJD}
	      specify scale type of the y axis

       -minx value
	      specify minimum value of x axis

       -maxx value
	      specify maximum value of x axis

       -incx value
	      specify increment value of x axis

       -miny value
	      specify minimum value of y axis

       -maxy value
	      specify maximum value of y axis

       -incy value
	      specify increment value of y axis

       -g     load settings from data file

       -png file
	      convert ngp file to PNG format

       -pdf file
	      convert ngp file to PDF format

       -ps file
	      convert ngp file to PostScript format

       -eps file
	      convert ngp file to Encapsulated PostScript format

       -svg file
	      convert ngp file to SVG format

       -gra file
	      convert ngp file to GRA format

       -dialog
	      show print dialog (with -p option)

       -p file
	      print ngp file

       -n     output ngp-file to stdout

       -h, --help
	      show help message

       -v, --version
	      show version of Ngraph

       -V, --VERSION
	      show detail information about Ngraph

FILES

       ${HOME}/.Ngraph/Ngraph.nsc
	      start up script

       ${HOME}/.Ngraph/Ngraph.ini
	      configuration file

       ${HOME}/.Ngraph/Ngraph.ngp
	      default graph

AUTHORS

       Satoshi ISHIZAKA

       Hiroyuki Ito <ZXB01226@nifty.com>

SEE ALSO

       ngp2(1)

COPYRIGHT

       Copyright (C) 2003 Satoshi ISHIZAKA

       Copyright (C) 2008-2011 Hiroyuki Ito

4th Berkeley Distribution					       Local								 NGRAPH(1)
All times are GMT -4. The time now is 08:02 AM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy