Please Help with AWK to parse rapidly changing XML messages Post: 302594248

Sponsored Content

Top Forums Shell Programming and Scripting Please Help with AWK to parse rapidly changing XML messages Post 302594248 by knight_eon on Tuesday 31st of January 2012 12:37:32 AM

01-31-2012

Registered User

AWK will read the file once before executing. AWK doesn't treat the input file as Dynamic File as far as I know.

So why not put the awk in loop:

Code:

 
while [ 1 ]; do
 
awk 'BEGIN { INTERVAL=120;    "date +%s"|getline sec;
    NEXT=sec+120;}
 
    {
        if(sec >= NEXT)
        {
           printf( "\nSummary\n" );
           for( x in agcount )
              printf( "%s,%d\n", x, agcount[x] ) | "sort";
 
           NEXT=sec+120;
        }
 
        gsub( ">", "" );        # strip uneeded junk and make "foo bar" easy to capture
        gsub( " ", "~" );
        gsub( "<", " " );
 
        for( i = 1; i <= NF; i++ )          # snarf up each name=value pair
        {
            if( split( $(i), a, "=" ) == 2 )
            {
                gsub(  "\"", "", a[2] );
                gsub(  "~", " ", a[2] );
                values[a[1]] = a[2];
            }
        }
 
        #gcount[values["Gender"]]++;         # collect counts
        #acount[values["Age"]]++;
        agcount[values["Gender"]","values["Age"]]++;
 
        printf( "%s %s %s %s\n", values["NAME"], values["Age"], values["D.O.B"], values["Gender"] );
    }' input-file
 
   ## Keep one LOOP BREAK CONDITION if you need to break out of loop on certain exception or conditions here
 
  if [ BREAKLOOP ]; then
       break
  fi
 
done

knight_eon

View Public Profile for knight_eon

Find all posts by knight_eon

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

How to parse a XML file using PERL and XML::DOm

I need to know the way. I have got parsing down some nodes. But I was unable to get the child node perfectly. If you have code please send it. It will be very useful for me.

2. Shell Programming and Scripting

Need AWk To parse XML logs

Hi , I need an Awk script to parse my log file . 2008-04-26 10:00:13,391 INFO Logger - <?xml version="1.0" encoding="UTF-8" standalone="no"?><2dm tmsg...

3. Shell Programming and Scripting

Parse an XML task list to create each task.xml file

I have an task definition listing xml file that contains a list of tasks such as <TASKLIST <TASK definition="Completion date" id="Taskname1" Some other <CODE name="Code12" <Parameter pname="Dog" input="5.6" units="feet" etc /Parameter> <Parameter...

4. Shell Programming and Scripting

how to parse the file in xml format using awk/nawk

Hi All, I have an xml file with the below format. <a>111</a><b>222</b><c>333<c><d><e>123</e><f>234</f><d><e>456</e><f>789</f> output needed is 111,222,333,123,234 111,222,333,456,789 nawk 'BEGIN{FS="<|>"} {print a,b,c,e,f a="" ...

5. UNIX for Dummies Questions & Answers

Parse XML e report con AWK

Thanks in advance who can answer. I have to make a small shell that after reading an XML file and extract the fields I create a text file with the same fields taken previously in tabular form. I did this parse.awk ---------------------- BEGIN { FS="" } { for(i=2; i<=NF; i+=2) { ...

6. Shell Programming and Scripting

Parse XML

Hi all! I'm looking to write a quick script and in it I need to request an XML file from a service running on localhost and parse that XML file and output it. I'm looking to do it in bash although it doesn't really matter what shell it is in. The XML file returned would look like this: ...

7. Shell Programming and Scripting

Shell script (not Perl) to parse xml with awk

Hi, I have to make an script according to these: - I have couples of files like: xxxxxxxxxxxxx.csv xxxxxxxxxxxxx_desc.xml - every xml file has diferent fields, but keeps this format: ........ <defaultName>2011-02-25T16:43:43.582Z</defaultName> ...........

8. Shell Programming and Scripting

python - wget xml doc and parse with awk

Well, that's what I'd do in bash :) Here's what I have so far: import urllib2 from BeautifulSoup import BeautifulStoneSoup xml = urllib2.urlopen('http://weatherlink.com/xml.php?user=blah&pass=blah') soup = BeautifulStoneSoup(xml) print soup.prettify() but all it does is grab the html...

9. Shell Programming and Scripting

AWK to Parse XML messages

Hello Guys, Please help with AWK problem. I have XML file which contains a list of messages for subjects. Example of the messages: , message=, message=, message=, message=, message=, message=, message=, message= I want to use AWK to parse these xml messages but I am...

10. Shell Programming and Scripting

awk Script to parse a XML tag

I have an XML tag like this: <property name="agent" value="/var/tmp/root/eclipse" /> Is there way using awk that i can get the value from the above tag. So the output should be: /var/tmp/root/eclipse Help will be appreciated. Regards, Adi

LEARN ABOUT SUSE

xml-xparse

XML-XPARSE(1)							   User Commands						     XML-XPARSE(1)

NAME

       xml-xparse - Parse XML documents with entity and URI resolution

SYNOPSIS

       xml-xparse [options] xmlfile

DESCRIPTION

       xml-xparse  is a simple command line tool for parsing and validating XML documents.  It is not an actual XML parser, it just wraps around a
       JAXP Parser, adding support for catalog-based entity and URI resolution.

OPTIONS

       -c catalogfile
	      Load a particular catalog file.  May be specified multiple times.

       -v     Perform a validating parse.  This is the default.

       -w     Perform a well-formed parse, not a validating parse.

       -N     Perform a namespace-aware parse.	This is the default.

       -n     Perform a namespace-ignorant parse.

       -d debuglevel
	      Set the debug level (an integer).  Warnings are shown if the debug level is set to greater than 2.

       -E maxerrors
	      Set the maximum number of errors to display.  The default is 10.

FILES

       /etc/java/resolver/CatalogManager.properties
	      The central catalog manager configuration file used by xml-xparse.

SEE ALSO

       xml-xread(1), xml-resolver(1), java(1), the OASIS entity resolution technical committee	home  page  at	<http://www.oasis-open.org/commit-
       tees/entity/>.

AUTHOR

       Norman Walsh <Norman.Walsh@Sun.COM>

1.1								     July 2004							     XML-XPARSE(1)

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

How to parse a XML file using PERL and XML::DOm

Discussion started by: girigopal

2. Shell Programming and Scripting

Need AWk To parse XML logs

Discussion started by: amit1_x

3. Shell Programming and Scripting

Parse an XML task list to create each task.xml file

Discussion started by: MissI

4. Shell Programming and Scripting

how to parse the file in xml format using awk/nawk

Discussion started by: natalie23