02-17-2013
Works great, you taught me a lot. Thanks again.
10 More Discussions You Might Find Interesting
1. Shell Programming and Scripting
Greetings All!!
I have a very peculiar problem where I have to parse a big text file and extract useful data out of it with starting and ending block pattern matching.
e.g. I have a input file like this:
sample data
block1
sample data
start
useful data
end
sample data
block2
sample... (5 Replies)
Discussion started by: arminder
5 Replies
2. Shell Programming and Scripting
Hi,
I have file (FILE.tmp) having contents,
FILE.tmp
========
filename=menudata
records=0000000000037
ldbname=pinsys
timestamp=2005/05/14-18:32:33
I want to parse it bring a new file which will look like,
filename records ldbname timestamp... (2 Replies)
Discussion started by: Omkumar
2 Replies
3. Shell Programming and Scripting
I have a file that is large and is broken up by groups of data. I want to take certain fields and display them different to make it easier to read. Given input file below:
2008 fl01 LAC 2589 polk doal
xx 2008q1 mx
sect 25698541
Sales 08 Dept group
lead1 ... (8 Replies)
Discussion started by: timj123
8 Replies
4. Shell Programming and Scripting
Hi all,
I wud like to get ur assistance in retrieving lines containing l1.My excel dataset contains around 8000 lines.I converted it into a text tab delimiter file and got the lines containing l1,My output is a list of lines containing l1 saved in a outfile.Some of d lines from my outfile s... (5 Replies)
Discussion started by: sayee
5 Replies
5. Shell Programming and Scripting
Hi All
I have two files:
file 1
>AB_1
MLKKPIIIGVTGGSGGGKTSVSRAILDSFPNARIAMIQHDSYYKDQSHMSFEERVKTNYDHPLAFDTDFM
IQQLKELLAGRPVDIPIYDYKKHTRSNTTFRQDPQDVIIVEGILVLEDERLRDLMDIKLFVDTDDDIRII
RRIKRDMMERGRSLESIIDQYTSVVKPMYHQFIEPSKRYADIVIPEGVSNVVAIDVINSKIASILGEV
>AB_2... (5 Replies)
Discussion started by: Lucky Ali
5 Replies
6. Shell Programming and Scripting
Hi,
I have a folder that contains many (multiple) files
1.fasta
2.fasta
3.fasta
4.fasta
5.fasta
.
.
100's of files
Each such file have data in the following format
for example:
vi 1.fasta
>AB_1 gi|15835212|ref|NP_296971.1| preprotein translocase subunit SecE... (3 Replies)
Discussion started by: Lucky Ali
3 Replies
7. Shell Programming and Scripting
Hi All,
I need some help to effectively parse out a subset of results from a big results file.
Below is an example of the text file. Each block that I need to parse starts with "Output of GENE for sequence file 100.fasta" (next block starts with another number). I have given the portion of... (8 Replies)
Discussion started by: Lucky Ali
8 Replies
8. Shell Programming and Scripting
Hi,
I have 2 files
format of file 1 is:
a1
b2
a2
c2
d1
f3
format of file 2 is (tab delimited):
a1 1.2 0.5 0.06 0.7 0.9 1 0.023
a3 0.91 0.007 0.12 0.34 0.45 1 0.7
a2 1.05 2.3 0.25 1 0.9 0.3 0.091
b1 1 5.4 0.3 9.2 0.3 0.2 0.1
b2 3 5 7 0.9 1 9 0 1
b3 0.001 1 2.3 4.6 8.9 10 0 1 0... (10 Replies)
Discussion started by: Lucky Ali
10 Replies
9. Shell Programming and Scripting
I have 2 text files where I need to parse data from file 2 using the data from file 1. Below are my sample files
File 1 (tab delimited)
257 350
670 845
725 1025
767 820
...
....
....
file 2 (tab delimited)
220..450 TA AB650 ABCED
520..850 GA AB720 ABCDE
700..1100 TC AB820 ABCDE... (2 Replies)
Discussion started by: Lucky Ali
2 Replies
10. Shell Programming and Scripting
Im really beginner in this case, maybe someone can help me find the answer:
if my input file like this:
void main(int a, int b){
int x; double y;
printf("file");
}
and i want output like this:
int a
int b
int x
double y
A awk script that can parse only data tipe, im confused.
what... (2 Replies)
Discussion started by: radynaraya
2 Replies
FITCIRCLE(l) FITCIRCLE(l)
NAME
fitcircle - find mean position and pole of best-fit great [or small] circle to points on a sphere.
SYNOPSIS
fitcircle [ xyfile ] -Lnorm [ -H[nrec] ] [ -S ] [ -V ] [ -: ] [ -bi[s][n] ]
DESCRIPTION
fitcircle reads lon,lat [or lat,lon] values from the first two columns on standard input [or xyfile]. These are converted to cartesian
three-vectors on the unit sphere. Then two locations are found: the mean of the input positions, and the pole to the great circle which
best fits the input positions. The user may choose one or both of two possible solutions to this problem. The first is called -L1 and the
second is called -L2. When the data are closely grouped along a great circle both solutions are similar. If the data have large dispersion,
the pole to the great circle will be less well determined than the mean. Compare both solutions as a qualitative check.
The -L1 solution is so called because it approximates the minimization of the sum of absolute values of cosines of angular distances. This
solution finds the mean position as the Fisher average of the data, and the pole position as the Fisher average of the cross-products
between the mean and the data. Averaging cross-products gives weight to points in proportion to their distance from the mean, analogous to
the "leverage" of distant points in linear regression in the plane.
The -L2 solution is so called because it approximates the minimization of the sum of squares of cosines of angular distances. It creates a
3 by 3 matrix of sums of squares of components of the data vectors. The eigenvectors of this matrix give the mean and pole locations. This
method may be more subject to roundoff errors when there are thousands of data. The pole is given by the eigenvector corresponding to the
smallest eigenvalue; it is the least-well represented factor in the data and is not easily estimated by either method.
-L Specify the desired norm as 1 or 2, or use -L or -L3 to see both solutions.
OPTIONS
xyfile ASCII [or binary, see -b] file containing lon,lat [lat,lon] values in the first 2 columns. If no file is specified, fitcircle will
read from standard input.
-H Input file(s) has Header record(s). Number of header records can be changed by editing your .gmtdefaults file. If used, GMT default
is 1 header record.
-S Attempt to fit a small circle instead of a great circle. The pole will be constrained to lie on the great circle connecting the pole
of the best-fit great circle and the mean location of the data.
-V Selects verbose mode, which will send progress reports to stderr [Default runs "silently"].
-: Toggles between (longitude,latitude) and (latitude,longitude) input/output. [Default is (longitude,latitude)]. Applies to geo-
graphic coordinates only.
-bi Selects binary input. Append s for single precision [Default is double]. Append n for the number of columns in the binary file(s).
[Default is 2 input columns].
EXAMPLES
Suppose you have lon,lat,grav data along a twisty ship track in the file ship.xyg. You want to project this data onto a great circle and
resample it in distance, in order to filter it or check its spectrum. Try:
fitcircle ship.xyg -L2
project ship.xyg -Cox/oy -Tpx/py -S -pz | sample1d -S-100 -I1 > output.pg
Here, ox/oy is the lon/lat of the mean from fitcircle, and px/py is the lon/lat of the pole. The file output.pg has distance, gravity data
sampled every 1 km along the great circle which best fits ship.xyg
SEE ALSO
gmt(1gmt), project(1gmt), sample1d(1gmt)
1 Jan 2004 FITCIRCLE(l)