Sponsored Content
Top Forums Shell Programming and Scripting Awk getting statistics of a grid file, Post 302526499 by alex2005 on Tuesday 31st of May 2011 05:25:57 PM
Old 05-31-2011
Awk getting statistics of a grid file,

Hi ,
I have the following file which is basically a grid (has more than 100000 rows)
LLL1 PPP1
LLL1 PPP2
LLL1 PPP3
...............
LLL1 5500
.....
LLL2 PPP1
LLL2 PPP2
LLL2 PPP3
...............
LLL1 5500
.....
L100 PPP1
L100 PPP2
L100 PPP3
...............
2100 5500
..........

Using a mathematical formula I have to assign to each point a grid value. Let's say the formula is grid = int((PPP1+7)/8-int(PPP1/8). The input file will become:
Line Point Grid
LLL1 PPP1 1
LLL1 PPP2 1
LLL1 PPP3 2
...............
LLL1 5500 150
.....
LLL2 PPP1 1
LLL2 PPP2 1
LLL2 PPP3 2
...............
LLL2 5300 150
.....
L100 PPP1 1
L100 PPP2 1
L100 PPP3 2
...............
2100 5500 150


I need a summary of the unique values of the grid and some statistics as follows:


Grid #1
LLLL #
LLL1
LLL2
LLL3
....
L100
...
2100
FROM
PPPP
PPP1
PPP1
PPP1
...
PPP1
.....
PPP1
TO
PPPP
5550
5300
5100
...
5000
...
5500
Total
XXXX
XXXX
XXXX
...
XXXX
...
XXX

Grid #2
LLLL #
LLL2
LLL3
....
L100
...
2100
FROM
PPPP
PPP1
PPP1
...
PPP1
.....
PPP1
TO
PPPP
5300
5100
...
5000
...
5500
Total
XXXX
XXXX
...
XXXX
...
XXX

Grid #3
LLLL #
LLL1
LLL2
LLL3
....
L100
...
2100
FROM
PPPP
PPP1
PPP1
PPP1
...
PPP1
.....
PPP1
TO
PPPP
5550
5300
5100
...
5000
...
5500
Total
XXXX
XXXX
XXXX
...
XXXX
...
XXX



Thanks in advance for any help.
 

9 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

How to create a grid file

Hi everybody: I want to create a grid file for export to statistical program. My aid is create a file with both rows, one row are x coordenates and other for y coordenates. All grid obviousolly are same space. the form that i want is this: x=(400000 ........ 600000) and y=(4000000 .......... (1 Reply)
Discussion started by: tonet
1 Replies

2. UNIX for Dummies Questions & Answers

file statistics??

Is there any command in Unix (HP-UX) which will give me the file statistics .. e.g I have a file called r001 if I created that file on 2nd of aug 2005 and till now I changed that file contents 10 times. So how will I get the history statistic(time & date) of file modification. (1 Reply)
Discussion started by: zing_foru
1 Replies

3. Shell Programming and Scripting

AWK- extracting values from columns, saving them and gettins statistics

Hello, I am obviously quite new to unix and awk. I need to parse certain columns of a file (delimited by spaces), and somehow save the value of this column somewhere, together with the value of the column just after it (by pairs; so something like ). I'm then supposed to count the times that... (9 Replies)
Discussion started by: acsg
9 Replies

4. Shell Programming and Scripting

statistics using awk

Hi, I have 3 columns in a file listed below. X Y X/(X+Y) 1 1 0.5 1 1 0.5 4 1 0.8 1 1 0.5 6 1 0.857142857 1 1 0.5 23 1 0.958333333 Now I want to find confidence interval using the formula for each row. (p-2 sqrt p(1-p)/(x+y), p+2... (7 Replies)
Discussion started by: Diya123
7 Replies

5. Programming

C++ Help with file handle and simple statistics problem asking...

Input_file: >header_1 ASDFFDASADASF >header_2 ASDSAFASDAAFFFAFA Desired output file: 30 Source Code try: // reading a text file #include <iostream> #include <fstream> #include <string> using namespace std; int main () { string line; ifstream myfile ("Input_file"); (3 Replies)
Discussion started by: perl_beginner
3 Replies

6. Shell Programming and Scripting

Writing only timing statistics output of Timer to File

I'm running long integrations on a remote server, and I'm working in terminal in a tcsh shell. I'm looking to write ONLY the timing statistics to a file. For example: $time ls >timer.out writes both the files in my current directory & the timer statistics to the file timer.out. I only... (2 Replies)
Discussion started by: elemonier
2 Replies

7. Shell Programming and Scripting

awk based script to print the "mode(statistics term)" for each column in a data file

Hi All, Thanks all for the continued support so far. Today, I need to find the most occurring string/number(also called mode in statistics terminology) for each column in a data file (.csv type). For one column of data(1.txt) like below Sample 1 2 2 3 4 1 1 1 2 I can find the mode... (6 Replies)
Discussion started by: ks_reddy
6 Replies

8. Red Hat

CPU Usage statistics Dump in a text file over a period of time

I am facing issue related to performance of one customized application running on RHEL 5.9. The application stalls for some unknown reason that I need to track. For that I require some tool or shell scripts that can monitor the CPU usage statistics (what we get in TOP or in more detail by other... (6 Replies)
Discussion started by: Anjan Ganguly
6 Replies

9. UNIX for Advanced & Expert Users

Need optimized awk/perl/shell to give the statistics for the Large delimited file

I have a file size is around 24 G with 14 columns, delimiter with "|" My requirement- can anyone provide me the fastest and best to get the below results Number of records of the file First column and second Column- Unique counts Thanks for your time Karti ------ Post updated at... (3 Replies)
Discussion started by: kartikirans
3 Replies
All times are GMT -4. The time now is 10:04 AM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy