Extracting From A File Then Processing

Grizzly · #1 (**permalink**) 10-01-2009

Hi. Im working with this data in a file:

Code:

-94.49109387652327,39.2956736296775
-93.0906917141962,38.72762798197614
-90.57659976220785,-40.25685140137304
-92.340961875134,39.44522321129584
92.340961875134,39.44522321129584
-94.72083812873272,37.63567097374739

Is there a way to set everything before the comma as say var1 and everything after the comma as var2. Then be able to process those vars, then move onto the next set until theres no more sets?

All that data was extracted from a KML using:

Code:

sed -n 's/.*<coordinates>\(.*\)\,.*/\1/ip;T' Test.kml

The line it extracts from looks like this:

Code:

<coordinates>-90.57659976220785,40.25685140137304,0</coordinates>

Maybe do the same thing only extracting them individually from the KML instead of the other file and then processing them, then moving to the next and so forth?

vgersh99 · #2 (**permalink**) 10-01-2009

Code:

nawk -F'[>,]' '{print $2, $3}' Test.kml

scottn · #3 (**permalink**) 10-01-2009

Hi.

You could try something like:

Code:

sed -n 's/.*<coordinates>\(.*\)\,.*/\1/ip;T' Test.kml | while IFS=, read A B; do
  echo a is $A   b is $B
  ...
done

(this assumes that your Test.kml looks like the data you posted after sed processed it)

i.e.

Code:

-94.49109387652327,39.2956736296775
-93.0906917141962,38.72762798197614
-90.57659976220785,-40.25685140137304
-92.340961875134,39.44522321129584
92.340961875134,39.44522321129584
-94.72083812873272,37.63567097374739

Then the output is

Code:

a is -94.49109387652327 b is 39.2956736296775
a is -93.0906917141962 b is 38.72762798197614
a is -90.57659976220785 b is -40.25685140137304
a is -92.340961875134 b is 39.44522321129584
a is 92.340961875134 b is 39.44522321129584
a is -94.72083812873272 b is 37.63567097374739

Grizzly · #4 (**permalink**) 10-02-2009

This is just to compile some stuff for my reference.

Code:

sed -n 's/.*<coordinates>\(.*\)\,.*/\1/ip;T' Test.kml 
-94.49109387652327,39.2956736296775
-93.0906917141962,38.72762798197614
-90.57659976220785,40.25685140137304
-92.340961875134,39.44522321129584
-92.340961875134,39.44522321129584
-94.72083812873272,37.63567097374739


sed -n 's/.*<longitude>\(.*\)<\/longitude>.*/\1/ip;T' Test.kml 
-94.49109387652327
-93.0906917141962
-90.57659976220786
-92.340961875134
-92.340961875134
-94.72083812873272

#Math with decimals
a=`echo "1+1.2" | bc` && echo $a
2.2

a=`dc -e '1.2 1+p'`
echo $a
2.2

#Extracting coords as vars then processing
sed -n 's/.*<coordinates>\(.*\)\,.*/\1/ip;T' Test.kml | while IFS=, read A B; do
  echo a is $A   b is $B
  echo "asdf"
done
a is -94.49109387652327 b is 39.2956736296775
a is -93.0906917141962 b is 38.72762798197614
a is -90.57659976220785 b is 40.25685140137304


#Multi Condition if statement
if [ $i = "+" -o $i = "-" -o $i = "/" -o $i = "%" ]; then
$x=$vr1
else
print "You have entered an invalid option."

scottn · #5 (**permalink**) 10-02-2009

Quote:

Originally Posted by Grizzly

This is just to compile some stuff for my reference.

Code:

sed -n 's/.*<coordinates>\(.*\)\,.*/\1/ip;T' Test.kml 
-94.49109387652327,39.2956736296775
-93.0906917141962,38.72762798197614
-90.57659976220785,40.25685140137304
-92.340961875134,39.44522321129584
-92.340961875134,39.44522321129584
-94.72083812873272,37.63567097374739


sed -n 's/.*<longitude>\(.*\)<\/longitude>.*/\1/ip;T' Test.kml 
-94.49109387652327
-93.0906917141962
-90.57659976220786
-92.340961875134
-92.340961875134
-94.72083812873272

#Math with decimals
a=`echo "1+1.2" | bc` && echo $a
2.2

a=`dc -e '1.2 1+p'`
echo $a
2.2

#Extracting coords as vars then processing
sed -n 's/.*<coordinates>\(.*\)\,.*/\1/ip;T' Test.kml | while IFS=, read A B; do
  echo a is $A   b is $B
  echo "asdf"
done
a is -94.49109387652327 b is 39.2956736296775
a is -93.0906917141962 b is 38.72762798197614
a is -90.57659976220785 b is 40.25685140137304


#Multi Condition if statement
if [ $i = "+" -o $i = "-" -o $i = "/" -o $i = "%" ]; then
$x=$vr1
else
print "You have entered an invalid option."

I never thought of the site as a personal organiser before

Have a word with Neo. He might want to endorse it!

Grizzly · #6 (**permalink**) 10-03-2009

Hah yea it just made sense. Easiest way to transport code from home to work. I tried out

Code:

sed -n 's/.*<coordinates>\(.*\)\,.*/\1/ip;T' Test.kml | while IFS=, read A B; do
  echo a is $A   b is $B
  echo "asdf"
done

at home on Ubuntu 9.04 and it worked but now it says that the command is garbled on solaris 10. I had a feeling this would happen as Im sure my Solaris box must be running an older version of pretty much everything. Can anyone think of a more flexible or older sed/bash friendly way perhaps?

scottn · #7 (**permalink**) 10-03-2009

Hi.

Well, the nawk from vger works fine, which would leave you with:

Code:

nawk -F'[>,]' '{print $2, $3}' | while read A B; do
  echo a is $A   b is $B
done

(use /usr/xpg4/bin/awk if you don't have nawk)

Or an alternative sed:

Code:

sed 's/.*<coordinates>\(.*\)<.*/\1/'  | while IFS=, read A B junk; do
  echo a is $A   b is $B
done

More UNIX and Linux Forum Topics You Might Find Helpful
Thread	Thread Starter	Forum	Replies	Last Post
Parsing file, yaml file? Extracting specific sections	Rhije	Shell Programming and Scripting	3	01-22-2009 06:36 PM
Extracting information from Config files /text processing	oconmx	Shell Programming and Scripting	3	01-21-2009 07:09 PM
Extracting data from text file based on configuration set in config file	suparnbector	Shell Programming and Scripting	3	08-10-2007 03:25 AM
Have a shell script check for a file to exist before processing another file	heprox	Shell Programming and Scripting	3	11-14-2006 03:26 AM
[Splitting file] Extracting group of segments from one file to others	ozgurgul	Shell Programming and Scripting	1	09-14-2006 01:17 PM

Thread Tools	Search this Thread
Show Printable Version Email this Page	Search this Thread: Advanced Search
Display Modes	Rate This Thread
Switch to Linear Mode Hybrid Mode Switch to Threaded Mode	Rate This Thread:


	Powered by