Nested awk Statements Post: 302825467

Sponsored Content

Top Forums Shell Programming and Scripting Nested awk Statements Post 302825467 by Parrakarry on Monday 24th of June 2013 12:54:08 PM

06-24-2013

Registered User

tl;dr: I should wait until I hear more from my boss before asking confusing questions.

I have a list of hundreds of different document types, and the various keywords associated with them in our document storage system. Unfortunately, I have not received the required values for the keywords yet, and I know that the program we are feeding the XML into will slow waaaay down when you try to do too much at once. The idea is, I will generate XML in the format

Code:

<section name="Query1">
<entry name="DocumentType">Document Type</entry>
<entry name="KWName1">Project Number</entry>
<entry name="KWValue1">12345</entry>
<entry name="KWValue2">12346</entry>
..
<entry name="KWValueN">Nth Project Number</entry>
</section>
<section name="Query2">
<entry name="DocumentType">Invoices</entry>
<entry name="KWName1">Project Number</entry>
<entry name="KWValue1">12345</entry>
<entry name="KWValue2">12346</entry>
..
<entry name="KWValueN">Nth Project Number</entry>
</section>

then feed it into another program which will spit out all documents of that type with the listed keywords matching the listed values.

I actually think RudiC's suggestion may well solve the problem though, unless my boss requires multiple keywords in each XML file. My initial question was regarding being able to sort of switch back and forth between files: read a KWName, then move to the other input file, where each row is filled with numbers for a specific KWName, enumerating the KWValues for each one, then switch back and print the next KWName. However, writing this all out has made me realize that it's possible I will only have to generate a file for each KWName, in which case it should be readily doable using multiple inputs in one awk statement. I didn't even know that was a thing. Also, he's way smarter than me and can probably explain how to do this, I was just impatient and wanted to get a head start (solving the problem "by myself" is a good way to look good!) Sorry for wasting your time.

Parrakarry

View Public Profile for Parrakarry

Find all posts by Parrakarry

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

awk compound statements

how can i use two or multiple statements in the if part of an awk code for example i want to check two flag if they are true i will write some print operations and increase the counter. here is the c version of the code that i want to write: counter=0; if (flag1==1 && flag2==0) {...

2. Shell Programming and Scripting

Help a newbie please with awk if else statements

Hi, Despite reading the Conditional Statements chapter in the O'Reilly Sed & Awk book several times and looking at numerous examples, I cannot for the life of me get any kind of if ... else statement to work in my awk scripts! My scripts work perfectly (as they are written at least) and do what...

3. Shell Programming and Scripting

Nested if statements with && and ||?

Hello, I'm a shell scripting noob and new to this forum as well. My question is can nested if statements be done with && and || instead and if it can be done can someone provide an example pls. Thanks in advance for the help

4. UNIX for Dummies Questions & Answers

AWK w/ if statements failing.

I'm converting some code from ksh on my macbook (Version M 1993-12-28 s+) to an older solaris machine with ksh 88. I can't seem to figure out this line, it worked on the new shell version. set -A combo -- $(for x in ${ImageIDs}; do nawk -v s=$x 'if($2 == s) getline ; getline if ($1 ==...

5. Shell Programming and Scripting

syntax question in regards to nested awk statements

Hello all, I am writing up an input file and I was hoping I could get some guidance as to how to best consolidate these 2 awk statements for 1 while loop. Here's my input file # cat databases.lst #NOTE: These entries are delimited by tabs "\t" #oracleSID name/pass # db11 ...

6. Shell Programming and Scripting

Nested looping statements

I cannot get the code below to work correctly. The IF statement works just fine, but not the looping. The inner loop tries to find files for a given vendor; if found, I need to sleep giving another process time to move the files. Once the given vendor's files are gone, then I want to move on to the...

7. UNIX for Dummies Questions & Answers

Combine two awk statements into one

Hi, I have the following two awk statements which I'd like to consolidate into one by piping the output from the first into the second awk statement (rather than having to write kat.txt out to a file and then reading back in). awk 'BEGIN {FS=OFS=" "} {printf("%s ", $2);for (x=7; x<=10;...

8. Shell Programming and Scripting

awk problem - combining awk statements

i have a datafile that has several lines that look like this: 2,dataflow,Sun Mar 17 16:50:01 2013,1363539001,2990,excelsheet,660,mortar,660,4 using the following command: awk -F, '{$3=strftime("%a %b %d %T %Y,%s",$3)}1' OFS=, $DATAFILE | egrep -v "\-OLDISSUES," | ${AWK} "/${MONTH} ${DAY}...

9. Shell Programming and Scripting

awk with many if statements

Hi What is the right structure to use awk with multiple If statements The following code doesn't work # awk ' { A = $1 } END { for ( i = 1; i <= c; i++ ) { if ( A == 236 && A ==199...

10. Shell Programming and Scripting

Nested if statements with word/number extracts

Hi everyone! I'm having difficulties setting up a complex script with nested if statements while doing some word extracts, any help is appreciated. Scenario: 1- Check if the file.txt has the word BINGO 2- If so then get the available number (any number) in the line that contains the word...

LEARN ABOUT CENTOS

itstool

ITSTOOL(1)						      General Commands Manual							ITSTOOL(1)

NAME

       itstool - convert between XML and PO using ITS

SYNOPSIS

       itstool [OPTIONS] [XMLFILES]
       itstool -m <MOFILE> [OPTIONS] [XMLFILES]

DESCRIPTION

       itstool	extracts  messages  from  XML files and outputs PO template files, then merges translations from MO files to create translated XML
       files. It determines what to translate and how to chunk it into messages using the W3C Internationalization Tag Set (ITS).

       To extract messages from XML files FILES and output them to OUT.pot:

       itstool -o OUT.pot FILES

       After merging with existing translations or translating strings, generate an MO file with msgfmt(1), then output translated  files  to  the
       directory DIR:

       itstool -m OUT.mo -o DIR FILES

       ITS  definitions  are  loaded  from  the  built-in  rules, rules embedded in the source XML files, files passed with the -i option, and ITS
       attributes in the source XML files. Later definitions take precedence.

OPTIONS

   Extracting
       -o FILE
       --out=FILE
	   output PO template to the file OUT

   Merging
       -m FILE
       --merge=FILE
	   merge from an MO file FILE and output XML files

       -l LANG
       --lang=LANG
	   explicitly set the language code output to XML

       -o FILE
       --out=FILE
	   output XML files in the directory OUT

   Common
       -i ITS
       --its=ITS
	   load the ITS rules in the file ITS (can specify multiple times)

AUTHOR

       Shaun McCance <shaunm@gnome.org>

SEE ALSO

       More documentation for itstool is maintained online. For more information, see:

	      http://itstool.org/documentation/

itstool 1.2.0							     May 2011								ITSTOOL(1)

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

awk compound statements

Discussion started by: gfhgfnhhn

2. Shell Programming and Scripting

Help a newbie please with awk if else statements

Discussion started by: jonathanm

3. Shell Programming and Scripting

Nested if statements with && and ||?

Discussion started by: zomgshellscript

4. UNIX for Dummies Questions & Answers

AWK w/ if statements failing.

Discussion started by: nerdcurious