Data manipulation with Awk

Cham · #1 (**permalink**) 08-24-2009

Hello guys,

I'm a new member here and I need some help with the Awk application. I'm using it through the Terminal app of OSX (I'm a Mac user).

I have a huge file with a large amount of data (rows of 3D cartesian coordinates). The data is typically like the following example (actually, the data is made of several thousands of "curves" defined by a list of points in 3D) :

Quote:

2.344 1.453 -1.345
1.234 3.134 3.123
2.566 1.345 2.344
-1.234 -2.333 -4.555
1.344 1.453 -1.345 # End of curve
3.234 4.134 6.123
2.566 4.345 3.344
-1.234 -2.333 -4.555
-7.344 1.453 -5.345 # End of curve
1.234 -3.134 3.123
6.566 5.345 8.344
-1.234 2.333 4.555 # End of curve

I need Awk to read this input file, and write out the number of lines for each "curve" (with some arbitrary symbol in front of it), followed by a list of line numbers. From the data above, Awk should output something like this :

Quote:

NumberOfLines 5
0 1 2 3 4

NumberOfLines 4
5 6 7 8

NumberOfLines 3
9 10 11

Take note that the first line is numbered as "0".
How can I do that ? Someone has an idea ?

The only data manipulation I know to do with Awk is like this example :

Quote:

cat path_to_input | awk '{ print $1 "\t" $2 "\t" $3 "\t"}' > path_to_output

Thanks, and sorry for my bad English.

Franklin52 · #2 (**permalink**) 08-24-2009

Try this:

Code:

awk '
{s=n?s " " c++:c++; n++}
/# End/{print "NumberOfLines " n; print s "\n"; n=0; s =""}
' file

Cham · #3 (**permalink**) 08-24-2009

Quote:

Originally Posted by Franklin52

Try this:

Code:

awk '
{s=n?s " " c++:c++; n++}
/# End/{print "NumberOfLines " n; print s "\n"; n=0; s =""}
' file

OMG !! It worked like a charm !

THANK YOU SO MUCH !!!

summer_cherry · #4 (**permalink**) 08-24-2009

Code:

awk '/End of/{
if(flag==0){
  flag=1
  print "NumberOfLines"NR
  for(i=1;i<=NR;i++){
    printf i-1" "
  }
  pre=NR
}
else{
  num=NR-pre
  print "NumberOfLines"num
  for(i=pre+1;i<=NR;i++){
    printf i-1" "
  }
  pre=NR
}
print ""
}'

protocomm · #5 (**permalink**) 08-24-2009

Hi!!

Franklin 52, could you explain, your command line....i don't understand the part...

Code:

{s=n?s " " c++:c++;

Thanks by advance.

Franklin52 · #6 (**permalink**) 08-24-2009

Quote:

Originally Posted by protocomm

Hi!!

Franklin 52, could you explain, your command line....i don't understand the part...

Code:

{s=n?s " " c++:c++;

Thanks by advance.

I've used a conditional operator, the form is :

Code:

expr ? action1 : action2

If expr is true, return action1 else return action2

Code:

s=n?s " " c++:c++

Explanation:

if n != 0 then s = s " " c++ else s = c++

Regards

protocomm · #7 (**permalink**) 08-24-2009

Great, thanks...

More UNIX and Linux Forum Topics You Might Find Helpful
Thread	Thread Starter	Forum	Replies	Last Post
Data manipulation/ formatting question	ddurden7	UNIX for Dummies Questions & Answers	2	04-12-2009 07:42 PM
Data manipulation in perl	chriss_58	Shell Programming and Scripting	1	06-13-2008 01:56 PM
data manipulation script	grinder182533	UNIX for Dummies Questions & Answers	1	11-10-2006 02:48 PM
More log manipulation	StevePace	Shell Programming and Scripting	8	02-13-2006 03:20 AM
Help with log manipulation	StevePace	Shell Programming and Scripting	3	01-31-2006 08:28 PM

Thread Tools	Search this Thread
Show Printable Version Email this Page	Search this Thread: Advanced Search
Display Modes	Rate This Thread
Switch to Linear Mode Hybrid Mode Switch to Threaded Mode	Rate This Thread: