05-31-2011
Awk getting statistics of a grid file,
Hi ,
I have the following file which is basically a grid (has more than 100000 rows)
LLL1 PPP1
LLL1 PPP2
LLL1 PPP3
...............
LLL1 5500
.....
LLL2 PPP1
LLL2 PPP2
LLL2 PPP3
...............
LLL1 5500
.....
L100 PPP1
L100 PPP2
L100 PPP3
...............
2100 5500
..........
Using a mathematical formula I have to assign to each point a grid value. Let's say the formula is grid = int((PPP1+7)/8-int(PPP1/8). The input file will become:
Line Point Grid
LLL1 PPP1 1
LLL1 PPP2 1
LLL1 PPP3 2
...............
LLL1 5500 150
.....
LLL2 PPP1 1
LLL2 PPP2 1
LLL2 PPP3 2
...............
LLL2 5300 150
.....
L100 PPP1 1
L100 PPP2 1
L100 PPP3 2
...............
2100 5500 150
I need a summary of the unique values of the grid and some statistics as follows:
Grid #1
LLLL #
LLL1
LLL2
LLL3
....
L100
...
2100
FROM
PPPP
PPP1
PPP1
PPP1
...
PPP1
.....
PPP1
TO
PPPP
5550
5300
5100
...
5000
...
5500
Total
XXXX
XXXX
XXXX
...
XXXX
...
XXX
Grid #2
LLLL #
LLL2
LLL3
....
L100
...
2100
FROM
PPPP
PPP1
PPP1
...
PPP1
.....
PPP1
TO
PPPP
5300
5100
...
5000
...
5500
Total
XXXX
XXXX
...
XXXX
...
XXX
Grid #3
LLLL #
LLL1
LLL2
LLL3
....
L100
...
2100
FROM
PPPP
PPP1
PPP1
PPP1
...
PPP1
.....
PPP1
TO
PPPP
5550
5300
5100
...
5000
...
5500
Total
XXXX
XXXX
XXXX
...
XXXX
...
XXX
Thanks in advance for any help.
9 More Discussions You Might Find Interesting
1. Shell Programming and Scripting
Hi everybody:
I want to create a grid file for export to statistical program.
My aid is create a file with both rows, one row are x coordenates and other for y coordenates.
All grid obviousolly are same space.
the form that i want is this:
x=(400000 ........ 600000) and y=(4000000 .......... (1 Reply)
Discussion started by: tonet
1 Replies
2. UNIX for Dummies Questions & Answers
Is there any command in Unix (HP-UX) which will give me the file statistics ..
e.g
I have a file called r001
if I created that file on 2nd of aug 2005 and till now I changed that file contents 10 times. So how will I get the history statistic(time & date) of file modification. (1 Reply)
Discussion started by: zing_foru
1 Replies
3. Shell Programming and Scripting
Hello,
I am obviously quite new to unix and awk. I need to parse certain columns of a file (delimited by spaces), and somehow save the value of this column somewhere, together with the value of the column just after it (by pairs; so something like ).
I'm then supposed to count the times that... (9 Replies)
Discussion started by: acsg
9 Replies
4. Shell Programming and Scripting
Hi,
I have 3 columns in a file listed below.
X Y X/(X+Y)
1 1 0.5
1 1 0.5
4 1 0.8
1 1 0.5
6 1 0.857142857
1 1 0.5
23 1 0.958333333
Now I want to find confidence interval using the formula for each row.
(p-2 sqrt p(1-p)/(x+y), p+2... (7 Replies)
Discussion started by: Diya123
7 Replies
5. Programming
Input_file:
>header_1
ASDFFDASADASF
>header_2
ASDSAFASDAAFFFAFA
Desired output file:
30
Source Code try:
// reading a text file
#include <iostream>
#include <fstream>
#include <string>
using namespace std;
int main () {
string line;
ifstream myfile ("Input_file"); (3 Replies)
Discussion started by: perl_beginner
3 Replies
6. Shell Programming and Scripting
I'm running long integrations on a remote server, and I'm working in terminal in a tcsh shell.
I'm looking to write ONLY the timing statistics to a file.
For example:
$time ls >timer.out
writes both the files in my current directory & the timer statistics to the file timer.out.
I only... (2 Replies)
Discussion started by: elemonier
2 Replies
7. Shell Programming and Scripting
Hi All,
Thanks all for the continued support so far.
Today, I need to find the most occurring string/number(also called mode in statistics terminology) for each column in a data file (.csv type).
For one column of data(1.txt) like below
Sample
1
2
2
3
4
1
1
1
2
I can find the mode... (6 Replies)
Discussion started by: ks_reddy
6 Replies
8. Red Hat
I am facing issue related to performance of one customized application running on RHEL 5.9. The application stalls for some unknown reason that I need to track. For that I require some tool or shell scripts that can monitor the CPU usage statistics (what we get in TOP or in more detail by other... (6 Replies)
Discussion started by: Anjan Ganguly
6 Replies
9. UNIX for Advanced & Expert Users
I have a file size is around 24 G with 14 columns, delimiter with "|"
My requirement- can anyone provide me the fastest and best to get the below results
Number of records of the file
First column and second Column- Unique counts
Thanks for your time
Karti
------ Post updated at... (3 Replies)
Discussion started by: kartikirans
3 Replies