02-15-2011
thanks guys , both solutions worked fine
10 More Discussions You Might Find Interesting
1. Shell Programming and Scripting
Hi,
May I know, if a pipe separated File is large, what is the best method to calculate the unique row count of 3rd column and get a list of unique value of the 3rdcolum?
Thanks in advance! (20 Replies)
Discussion started by: deepakwins
20 Replies
2. Shell Programming and Scripting
Hi ,
I have
#echo $var1
#hdisk2 hdisk3 hdisk0 hdisk2
Now I need to remove duplicate entries from this . ie. after sorting it should only have
hdisk2 hdisk3 hdisk0 .
I can have these values in a array as well . I understand we can use sort -u to remove the duplicates in a... (2 Replies)
Discussion started by: praveenbvarrier
2 Replies
3. Shell Programming and Scripting
Hi all,
I've searched the forum and I can find some code to sort uniquely in perl but not by a single field.
I have a file with data such as the following:
1,test,34
1,test2,65
2,test,35,
1,test3,34
2,test,34
What i want to do is sort it uniqely by the first field only so I'd end... (2 Replies)
Discussion started by: Donkey25
2 Replies
4. Shell Programming and Scripting
Hi all,
I am writing a script where i can parse through the directory and get common string in two directories i get. The command below SUN_PLATFORM=`$FIND $STREAM_PATH . -depth -name ShareableEntities | $AWK -F"/" '{if($10 ~ /sun5/) print $0}'` gives the following output:-
... (1 Reply)
Discussion started by: asirohi
1 Replies
5. Shell Programming and Scripting
I have a file with contents below
123,502
123,506
123,702
234,101
235,104
456,104
456,100
i want to sort such that i get a unique value in column A, and for those with multiple value in A, i want the lowest value in B.
output should be
123,502
234,101
235,104
456,100 (3 Replies)
Discussion started by: dealerso
3 Replies
6. Shell Programming and Scripting
I have another file with three columns A,B,C as below
123,1,502
123,2,506
123,3,702
234,4,101
235,5,104
456,6,104
456,7,100
i want to sort such that i get a unique value in column A, and for those with multiple value in A, i want the lowest value in C.
output should be
Code:... (3 Replies)
Discussion started by: dealerso
3 Replies
7. Shell Programming and Scripting
Hi, this is about sorting a very large file (like 10 gb) to keep lines with unique entries across SOME of the columns.
The line originally looked like this:
sort -u -k2,2 -k3,3n -k4,4n -k5,5n -k6,6n file_unsorted > file_sorted
please note the -u flag.
The problem is that this single... (4 Replies)
Discussion started by: jbr950
4 Replies
8. UNIX for Dummies Questions & Answers
I would like to print unique lines without sort or unique. Unfortunately the server I am working on does not have sort or unique. I have not been able to contact the administrator of the server to ask him to add it for several weeks. (7 Replies)
Discussion started by: cokedude
7 Replies
9. Shell Programming and Scripting
i need to sort to get all the unique records based on the 1st and 2nd column, and keep the record with the highest value on 5th column if there are duplicates, every column with varies length
a^2^x^y^z
bxc^2xx2^aa^bvxxxx^cdd
a^3^1^2^3
a^2^x^1^c
I want a result which will only keep the 1st... (2 Replies)
Discussion started by: dtdt
2 Replies
10. Shell Programming and Scripting
Hi,
I have an input file that I have sorted in a previous stage by $1 and $4. I now need something that will take the first record from each group of data based on the key being $1
Input file
1000AAA|"ZZZ"|"Date"|"1"|"Y"|"ABC"|""|AA
1000AAA|"ZZZ"|"Date"|"2"|"Y"|"ABC"|""|AA... (2 Replies)
Discussion started by: Ads89
2 Replies
LEARN ABOUT PLAN9
fitcircle
FITCIRCLE(l) FITCIRCLE(l)
NAME
fitcircle - find mean position and pole of best-fit great [or small] circle to points on a sphere.
SYNOPSIS
fitcircle [ xyfile ] -Lnorm [ -H[nrec] ] [ -S ] [ -V ] [ -: ] [ -bi[s][n] ]
DESCRIPTION
fitcircle reads lon,lat [or lat,lon] values from the first two columns on standard input [or xyfile]. These are converted to cartesian
three-vectors on the unit sphere. Then two locations are found: the mean of the input positions, and the pole to the great circle which
best fits the input positions. The user may choose one or both of two possible solutions to this problem. The first is called -L1 and the
second is called -L2. When the data are closely grouped along a great circle both solutions are similar. If the data have large dispersion,
the pole to the great circle will be less well determined than the mean. Compare both solutions as a qualitative check.
The -L1 solution is so called because it approximates the minimization of the sum of absolute values of cosines of angular distances. This
solution finds the mean position as the Fisher average of the data, and the pole position as the Fisher average of the cross-products
between the mean and the data. Averaging cross-products gives weight to points in proportion to their distance from the mean, analogous to
the "leverage" of distant points in linear regression in the plane.
The -L2 solution is so called because it approximates the minimization of the sum of squares of cosines of angular distances. It creates a
3 by 3 matrix of sums of squares of components of the data vectors. The eigenvectors of this matrix give the mean and pole locations. This
method may be more subject to roundoff errors when there are thousands of data. The pole is given by the eigenvector corresponding to the
smallest eigenvalue; it is the least-well represented factor in the data and is not easily estimated by either method.
-L Specify the desired norm as 1 or 2, or use -L or -L3 to see both solutions.
OPTIONS
xyfile ASCII [or binary, see -b] file containing lon,lat [lat,lon] values in the first 2 columns. If no file is specified, fitcircle will
read from standard input.
-H Input file(s) has Header record(s). Number of header records can be changed by editing your .gmtdefaults file. If used, GMT default
is 1 header record.
-S Attempt to fit a small circle instead of a great circle. The pole will be constrained to lie on the great circle connecting the pole
of the best-fit great circle and the mean location of the data.
-V Selects verbose mode, which will send progress reports to stderr [Default runs "silently"].
-: Toggles between (longitude,latitude) and (latitude,longitude) input/output. [Default is (longitude,latitude)]. Applies to geo-
graphic coordinates only.
-bi Selects binary input. Append s for single precision [Default is double]. Append n for the number of columns in the binary file(s).
[Default is 2 input columns].
EXAMPLES
Suppose you have lon,lat,grav data along a twisty ship track in the file ship.xyg. You want to project this data onto a great circle and
resample it in distance, in order to filter it or check its spectrum. Try:
fitcircle ship.xyg -L2
project ship.xyg -Cox/oy -Tpx/py -S -pz | sample1d -S-100 -I1 > output.pg
Here, ox/oy is the lon/lat of the mean from fitcircle, and px/py is the lon/lat of the pole. The file output.pg has distance, gravity data
sampled every 1 km along the great circle which best fits ship.xyg
SEE ALSO
gmt(1gmt), project(1gmt), sample1d(1gmt)
1 Jan 2004 FITCIRCLE(l)