Sponsored Content
Full Discussion: Data manipulation with Awk
Top Forums Shell Programming and Scripting Data manipulation with Awk Post 302347324 by Cham on Tuesday 25th of August 2009 11:32:10 AM
Old 08-25-2009
I just noticed something bad with my data. Some points are doubled for nothing. Here's a list of Long/Lat coordinates (it's just a sample of a huge data file) :
Quote:
-0.1194983E+03 0.6000011E+02
-0.1194394E+03 0.6000006E+02
-0.1195464E+03 0.6000011E+02 <-------- A
-0.1195464E+03 0.6000011E+02 <-------- A'
-0.1195002E+03 0.6000021E+02
-0.1194394E+03 0.6000006E+02 # END
-0.1065872E+03 0.5324551E+02
-0.1100000E+03 0.6000000E+02
-0.1099966E+03 0.6000000E+02 <-------- B
-0.1099966E+03 0.6000000E+02 <-------- B'
-0.1090837E+03 0.6000000E+02 <-------- C
-0.1090837E+03 0.6000000E+02 <-------- C'
-0.1090004E+03 0.6000012E+02
....
-0.1194394E+03 0.6000006E+02 # END
So I now need to remove all the doubles (A', B', C' in the example above), while keeping the first (A, B, C). Take note that the doubles are always located immediately after the first.

So how can I remove them, using Awk ? I'm pretty sure this should be easy, but I'm really not a specialist of Awk. Smilie
 

10 More Discussions You Might Find Interesting

1. UNIX for Dummies Questions & Answers

data manipulation script

I have a folder called {homedata} Within this folder there are 12 subfolders 200601.......200612 Within each subfolder there are 8 sets of files Each filename commences with A B C D E F G or H, so {filename}* can be used. I am trying to write a script which will from the top level go... (1 Reply)
Discussion started by: grinder182533
1 Replies

2. UNIX for Dummies Questions & Answers

Data Manipulation

Hello I am currently having problems in mapulating a certain file which contains vaious data. Belos is a sample content Event=<3190> Client IP=<151.111.11.143> DNS=<abc.sbc.com> TransCount=<139> Client IP=<150.222.133.163> DNS=<xyz.yuu.com> TransCount=<3734> Event=<3120> Client... (11 Replies)
Discussion started by: khestoi
11 Replies

3. Shell Programming and Scripting

Data manipulation from one file

HI all i have a file consisting of following numbers 0000 0000 0000 0000 0000 1010 0000 0100 0000 0000 0000 1111 0000 1010 0000 0100 (3 Replies)
Discussion started by: vaibhavkorde
3 Replies

4. Shell Programming and Scripting

awk data subsets manipulation

Hi, I'm working on a data file with the following structure val1,val2,flag 214.7332983,979.0259,1 12.87435571,205.7679,1 1.365976384,19.01616,1 44.08584096,205.7679,2 7.034721792,383.8778,2 189.5685503,979.0259,2 1.96352032,19.01616,2 where the field 'flag' identifies different... (10 Replies)
Discussion started by: Linoleum
10 Replies

5. Shell Programming and Scripting

Help with data manipulation script

Y,T,,H05,6,6,0,0 -> TH05_6 D,5,BT,B -> BT_KIOSK P,KQC222 -> KQC222 G,B,2 -> BRANI_GATE_2 fileA TPM658 Y,T,,H05,6,6,0,0 TPM110 D,5,BT,B TPM136 P,KQC222 TPM180 P,BQC913 TPM575 Y,B,,T05,14,14,0,0 IPM760 G,B,2 TPM011 I need to use second column $1,$2,$3,$4..... if first char... (6 Replies)
Discussion started by: ment0smintz
6 Replies

6. Shell Programming and Scripting

Data manipulation using shell

Dear all I have a dataset (in text format,delimited by tab) which have 100 variables (say, var0-var99) and more than 100,000 observations. I want to do the following: 1. for variable var0-var49, I want to add "00" in front of each data (for example, "1" would become "001") 2. for variable... (8 Replies)
Discussion started by: littlewenwen
8 Replies

7. UNIX for Dummies Questions & Answers

Data manipulation

Hallo Team, I need to manipulate existing data file. Have a look at current data and expected data: Current Data: 27873517141 27873540000 27873515109 27873517140 27873540001 27873540000 27873501343 27873540000 27873517140 27873511292 27873645989 27873540000 27873540000... (7 Replies)
Discussion started by: kekanap
7 Replies

8. UNIX for Dummies Questions & Answers

Data/date manipulation

Hallo Team, I need your help. I would like to change field9 format to yyyy-mm-dd it should be for example 2013-11-16 instead of 20131116 0780112843,0873599381,E,ISOL,ZAR,0.0035,O,1,20131116,4373200,0.21 0733001720,0873516499,E,ISOL,ZAR,0.0035,O,1,20131116,4331600,0.21... (3 Replies)
Discussion started by: kekanap
3 Replies

9. UNIX for Dummies Questions & Answers

Data Manipulation

Dear Sir, I have file input RGR001|108.28|-2.86489|100-120|RANGGAR RGR002|108.071|-2.69028|80-100|RANNGAR RGR003|108.168|-2.97053|50-80|RANNGAR RGR007|108.192722222|-2.766138889|0-50|RANGGARI want to create files by joining each rows with each rows below Output as below ... (4 Replies)
Discussion started by: radius
4 Replies

10. Shell Programming and Scripting

Data manipulation, Please help..

Hello, I have a huge set of data that needs to be reformatted. Here is a simple example to explain the process. I have number n=5 and a input with many numbers separated with comma: ... (11 Replies)
Discussion started by: liuzhencc
11 Replies
SbVec3s(3)							       Coin								SbVec3s(3)

NAME
SbVec3s - The SbVec3s class is a 3 dimensional vector with short integer coordinates. This vector class provides storage for a 3 dimensional vector as well as simple integer arithmetic operations. SYNOPSIS
#include <Inventor/SbLinear.h> Public Member Functions SbVec3s (void) SbVec3s (const short v[3]) SbVec3s (short x, short y, short z) SbVec3s (const SbVec3us &v) SbVec3s (const SbVec3b &v) SbVec3s (const SbVec3i32 &v) SbVec3s (const SbVec3f &v) SbVec3s (const SbVec3d &v) SbVec3s & setValue (const short v[3]) SbVec3s & setValue (short x, short y, short z) SbVec3s & setValue (const SbVec3us &v) SbVec3s & setValue (const SbVec3b &v) SbVec3s & setValue (const SbVec3i32 &v) SbVec3s & setValue (const SbVec3f &v) SbVec3s & setValue (const SbVec3d &v) const short * getValue (void) const void getValue (short &x, short &y, short &z) const short & operator[] (int i) const short & operator[] (int i) const int32_t dot (const SbVec3s &v) const void negate (void) SbVec3s & operator*= (int d) SbVec3s & operator*= (double d) SbVec3s & operator/= (int d) SbVec3s & operator/= (double d) SbVec3s & operator+= (const SbVec3s &v) SbVec3s & operator-= (const SbVec3s &v) SbVec3s operator- (void) const void print (FILE *fp) const Protected Attributes short vec [3] Related Functions (Note that these are not member functions.) SbVec3s operator* (const SbVec3s &v, int d) SbVec3s operator* (const SbVec3s &v, double d) SbVec3s operator* (int d, const SbVec3s &v) SbVec3s operator* (double d, const SbVec3s &v) SbVec3s operator/ (const SbVec3s &v, int d) SbVec3s operator/ (const SbVec3s &v, double d) SbVec3s operator+ (const SbVec3s &v1, const SbVec3s &v2) SbVec3s operator- (const SbVec3s &v1, const SbVec3s &v2) int operator== (const SbVec3s &v1, const SbVec3s &v2) int operator!= (const SbVec3s &v1, const SbVec3s &v2) Detailed Description The SbVec3s class is a 3 dimensional vector with short integer coordinates. This vector class provides storage for a 3 dimensional vector as well as simple integer arithmetic operations. Be aware that this class is an extension for Coin, and it is not available in the original SGI Open Inventor v2.1 API. See also: SbVec2s, SbVec2f, SbVec2d, SbVec3f, SbVec3d, SbVec4f, SbVec4d. Since: Coin 2.0 TGS Inventor ?.? Constructor &; Destructor Documentation SbVec3s::SbVec3s (void) [inline] The default constructor does nothing. The vector coordinates will be uninitialized until you do a setValue() call. SbVec3s::SbVec3s (const shortv[3]) [inline] Constructs an SbVec3s instance with initial values from v. SbVec3s::SbVec3s (shortx, shorty, shortz) [inline] Constructs an SbVec3s instance with the initial vector endpoint set to <x,y,z>. SbVec3s::SbVec3s (const SbVec3us &v) [inline], [explicit] Since: Coin 2.5 SbVec3s::SbVec3s (const SbVec3b &v) [inline], [explicit] Since: Coin 2.5 SbVec3s::SbVec3s (const SbVec3i32 &v) [inline], [explicit] Since: Coin 2.5 SbVec3s::SbVec3s (const SbVec3f &v) [inline], [explicit] Since: Coin 2.5 SbVec3s::SbVec3s (const SbVec3d &v) [inline], [explicit] Since: Coin 2.5 Member Function Documentation SbVec3s & SbVec3s::setValue (const shortv[3]) [inline] Set new coordinates for the vector from v. Returns reference to self. See also: getValue(). SbVec3s & SbVec3s::setValue (const SbVec3us &v) SbVec3s & SbVec3s::setValue(short x, short y, short z) Set new coordinates for the vector. Returns reference to self. See also: getValue(). Sets the value from an SbVec3us instance. Since: Coin 2.5 SbVec3s & SbVec3s::setValue (const SbVec3b &v) Sets the value from an SbVec3b instance. Since: Coin 2.5 SbVec3s & SbVec3s::setValue (const SbVec3i32 &v) Sets the value from an SbVec3i32 instance. Since: Coin 2.5 SbVec3s & SbVec3s::setValue (const SbVec3f &v) Sets the value from an SbVec3f instance. Since: Coin 2.5 SbVec3s & SbVec3s::setValue (const SbVec3d &v) Sets the value from an SbVec3d instance. Since: Coin 2.5 const short * SbVec3s::getValue (void) const [inline] Returns a pointer to an array of three shorts containing the x, y and z coordinates of the vector. See also: setValue(). void SbVec3s::getValue (short &x, short &y, short &z) const [inline] Returns the x, y and z coordinates of the vector. See also: setValue(). short & SbVec3s::operator[] (inti) [inline] Index operator. Returns modifiable x, y or z coordinate of vector. See also: getValue() and setValue(). short SbVec3s::operator[] (inti) const [inline] Index operator. Returns x, y or z coordinate of vector. See also: getValue() and setValue(). int32_t SbVec3s::dot (const SbVec3s &v) const [inline] Calculates and returns the result of taking the dot product of this vector and v. void SbVec3s::negate (void) [inline] Negate the vector (i.e. point it in the opposite direction). SbVec3s & SbVec3s::operator*= (intd) [inline] Multiply components of vector with value d. Returns reference to self. SbVec3s & SbVec3s::operator*= (doubled) Multiply components of vector with value d. Returns reference to self. SbVec3s & SbVec3s::operator/= (intd) [inline] Divides components of vector with value d. Returns reference to self. SbVec3s & SbVec3s::operator/= (doubled) [inline] Divides components of vector with value d. Returns reference to self. SbVec3s & SbVec3s::operator+= (const SbVec3s &v) [inline] Adds this vector and vector v. Returns reference to self. SbVec3s & SbVec3s::operator-= (const SbVec3s &v) [inline] Subtracts vector v from this vector. Returns reference to self. SbVec3s SbVec3s::operator- (void) const [inline] Non-destructive negation operator. Returns a new SbVec3s instance which points in the opposite direction of this vector. See also: negate(). void SbVec3s::print (FILE *fp) const Dump the state of this object to the file stream. Only works in debug version of library, method does nothing in an optimized compile. Friends And Related Function Documentation SbVec3s operator* (const SbVec3s &v, intd) [related] Returns an SbVec3s instance which is the components of vector v multiplied with d. SbVec3s operator* (const SbVec3s &v, doubled) [related] Returns an SbVec3s instance which is the components of vector v multiplied with d. SbVec3s operator* (intd, const SbVec3s &v) [related] Returns an SbVec3s instance which is the components of vector v multiplied with d. SbVec3s operator* (doubled, const SbVec3s &v) [related] Returns an SbVec3s instance which is the components of vector v multiplied with d. SbVec3s operator/ (const SbVec3s &v, intd) [related] Returns an SbVec3s instance which is the components of vector v divided on the scalar factor d. SbVec3s operator/ (const SbVec3s &v, doubled) [related] Returns an SbVec3s instance which is the components of vector v divided on d. SbVec3s operator+ (const SbVec3s &v1, const SbVec3s &v2) [related] Returns an SbVec3s instance which is the sum of vectors v1 and v2. SbVec3s operator- (const SbVec3s &v1, const SbVec3s &v2) [related] Returns an SbVec3s instance which is vector v2 subtracted from vector v1. int operator== (const SbVec3s &v1, const SbVec3s &v2) [related] Returns 1 if v1 and v2 are exactly equal, 0 otherwise. int operator!= (const SbVec3s &v1, const SbVec3s &v2) [related] Returns 1 if v1 and v2 are not equal, 0 if they are equal. Author Generated automatically by Doxygen for Coin from the source code. Version 3.1.3 Wed May 23 2012 SbVec3s(3)
All times are GMT -4. The time now is 05:57 PM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy