Please Help with AWK to parse rapidly changing XML messages Post: 302594248

Sponsored Content

Top Forums Shell Programming and Scripting Please Help with AWK to parse rapidly changing XML messages Post 302594248 by knight_eon on Tuesday 31st of January 2012 12:37:32 AM

01-31-2012

Registered User

AWK will read the file once before executing. AWK doesn't treat the input file as Dynamic File as far as I know.

So why not put the awk in loop:

Code:

 
while [ 1 ]; do
 
awk 'BEGIN { INTERVAL=120;    "date +%s"|getline sec;
    NEXT=sec+120;}
 
    {
        if(sec >= NEXT)
        {
           printf( "\nSummary\n" );
           for( x in agcount )
              printf( "%s,%d\n", x, agcount[x] ) | "sort";
 
           NEXT=sec+120;
        }
 
        gsub( ">", "" );        # strip uneeded junk and make "foo bar" easy to capture
        gsub( " ", "~" );
        gsub( "<", " " );
 
        for( i = 1; i <= NF; i++ )          # snarf up each name=value pair
        {
            if( split( $(i), a, "=" ) == 2 )
            {
                gsub(  "\"", "", a[2] );
                gsub(  "~", " ", a[2] );
                values[a[1]] = a[2];
            }
        }
 
        #gcount[values["Gender"]]++;         # collect counts
        #acount[values["Age"]]++;
        agcount[values["Gender"]","values["Age"]]++;
 
        printf( "%s %s %s %s\n", values["NAME"], values["Age"], values["D.O.B"], values["Gender"] );
    }' input-file
 
   ## Keep one LOOP BREAK CONDITION if you need to break out of loop on certain exception or conditions here
 
  if [ BREAKLOOP ]; then
       break
  fi
 
done

knight_eon

View Public Profile for knight_eon

Find all posts by knight_eon

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

How to parse a XML file using PERL and XML::DOm

I need to know the way. I have got parsing down some nodes. But I was unable to get the child node perfectly. If you have code please send it. It will be very useful for me.

2. Shell Programming and Scripting

Need AWk To parse XML logs

Hi , I need an Awk script to parse my log file . 2008-04-26 10:00:13,391 INFO Logger - <?xml version="1.0" encoding="UTF-8" standalone="no"?><2dm tmsg...

3. Shell Programming and Scripting

Parse an XML task list to create each task.xml file

I have an task definition listing xml file that contains a list of tasks such as <TASKLIST <TASK definition="Completion date" id="Taskname1" Some other <CODE name="Code12" <Parameter pname="Dog" input="5.6" units="feet" etc /Parameter> <Parameter...

4. Shell Programming and Scripting

how to parse the file in xml format using awk/nawk

Hi All, I have an xml file with the below format. <a>111</a><b>222</b><c>333<c><d><e>123</e><f>234</f><d><e>456</e><f>789</f> output needed is 111,222,333,123,234 111,222,333,456,789 nawk 'BEGIN{FS="<|>"} {print a,b,c,e,f a="" ...

5. UNIX for Dummies Questions & Answers

Parse XML e report con AWK

Thanks in advance who can answer. I have to make a small shell that after reading an XML file and extract the fields I create a text file with the same fields taken previously in tabular form. I did this parse.awk ---------------------- BEGIN { FS="" } { for(i=2; i<=NF; i+=2) { ...

6. Shell Programming and Scripting

Parse XML

Hi all! I'm looking to write a quick script and in it I need to request an XML file from a service running on localhost and parse that XML file and output it. I'm looking to do it in bash although it doesn't really matter what shell it is in. The XML file returned would look like this: ...

7. Shell Programming and Scripting

Shell script (not Perl) to parse xml with awk

Hi, I have to make an script according to these: - I have couples of files like: xxxxxxxxxxxxx.csv xxxxxxxxxxxxx_desc.xml - every xml file has diferent fields, but keeps this format: ........ <defaultName>2011-02-25T16:43:43.582Z</defaultName> ...........

8. Shell Programming and Scripting

python - wget xml doc and parse with awk

Well, that's what I'd do in bash :) Here's what I have so far: import urllib2 from BeautifulSoup import BeautifulStoneSoup xml = urllib2.urlopen('http://weatherlink.com/xml.php?user=blah&pass=blah') soup = BeautifulStoneSoup(xml) print soup.prettify() but all it does is grab the html...

9. Shell Programming and Scripting

AWK to Parse XML messages

Hello Guys, Please help with AWK problem. I have XML file which contains a list of messages for subjects. Example of the messages: , message=, message=, message=, message=, message=, message=, message=, message= I want to use AWK to parse these xml messages but I am...

10. Shell Programming and Scripting

awk Script to parse a XML tag

I have an XML tag like this: <property name="agent" value="/var/tmp/root/eclipse" /> Is there way using awk that i can get the value from the above tag. So the output should be: /var/tmp/root/eclipse Help will be appreciated. Regards, Adi

LEARN ABOUT DEBIAN

mojo::dom::html

Mojo::DOM::HTML(3pm)					User Contributed Perl Documentation				      Mojo::DOM::HTML(3pm)

NAME

       Mojo::DOM::HTML - HTML5/XML engine

SYNOPSIS

	 use Mojo::DOM::HTML;

	 # Turn HTML5 into DOM tree
	 my $html = Mojo::DOM::HTML->new;
	 $html->parse('<div><p id="a">A</p><p id="b">B</p></div>');
	 my $tree = $html->tree;

DESCRIPTION

       Mojo::DOM::HTML is the HTML5/XML engine used by Mojo::DOM.

ATTRIBUTES

       Mojo::DOM::HTML implements the following attributes.

   "charset"
	 my $charset = $html->charset;
	 $html	     = $html->charset('UTF-8');

       Charset used for decoding and encoding HTML5/XML.

   "tree"
	 my $tree = $html->tree;
	 $html	  = $html->tree(['root', [qw(text lalala)]]);

       Document Object Model.

   "xml"
	 my $xml = $html->xml;
	 $html	 = $html->xml(1);

       Disable HTML5 semantics in parser and activate case sensitivity, defaults to auto detection based on processing instructions.

METHODS

       Mojo::DOM::HTML inherits all methods from Mojo::Base and implements the following new ones.

   "parse"
	 $html = $html->parse('<foo bar="baz">test</foo>');

       Parse HTML5/XML document.

   "render"
	 my $xml = $html->render;

       Render DOM to XML.

SEE ALSO

       Mojolicious, Mojolicious::Guides, <http://mojolicio.us>.

perl v5.14.2							    2012-09-05						      Mojo::DOM::HTML(3pm)

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

How to parse a XML file using PERL and XML::DOm

Discussion started by: girigopal

2. Shell Programming and Scripting

Need AWk To parse XML logs

Discussion started by: amit1_x

3. Shell Programming and Scripting

Parse an XML task list to create each task.xml file

Discussion started by: MissI

4. Shell Programming and Scripting

how to parse the file in xml format using awk/nawk

Discussion started by: natalie23