Script to parse a file faster Post: 302551521

Sponsored Content

Top Forums Shell Programming and Scripting Script to parse a file faster Post 302551521 by agama on Tuesday 30th of August 2011 05:20:49 PM

08-30-2011

Registered User

Glad you were able to get something to work. Some comments that should help explain things:

Code:

#!/usr/bin/ksh awk ' 
    # for each record from the input file, test to see if we should execute each block of code...
    /uid=oracle/ {              # execute this block when the string "uid=orical" is found in the record
        split( $3, a, "=" );    # split the third field into the array a using "=" as the seperator; a[2] is the id
        uids[a[2]] = 1;         # track all ids that we have seen
        next;                   # skip the remainder of the programme, read next record and start processing
    }

    /connection from/ {         # execute this block when "connection from" is in the record
        split( $3, a, "=" );    # split the connection id into array a
        if( uids[a[2]] )        # if we saw this id as an oricle id earlier, uids[id] 
                                #will be non-zero and thus true,  then print the info
            printf( "connid=%s IP=%s\n", a[2], $(NF-2) ); 
    } ' input-file-name

And not to 'backseat mod' here, but please place code-tags around any code or sample in/output. It really helps to have those kinds of information not mashed into a paragraph.

agama

View Public Profile for agama

Find all posts by agama

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Help!!! Shell script to parse data file.

I am faced with a :confused: tricky problem to parse a data file ( May not be a tricky problem to the scripting guru's ). Here is what I am faced with. I have a file with multiple rows of data and the rows are not of fixed length. "|" is used as a delimiters for individual columns and each row...

2. UNIX for Advanced & Expert Users

shell script to parse html file

hi all, i have a html file something similar to this. <tr class="evenrow"> <td class="data">added</td><td class="data">xyz@abc.com</td> <td class="data">filename.sql</td><td class="modifications-data">08/25/2009 07:58:40</td><td class="data">Added TK prof script</td> </tr> <tr...

3. Shell Programming and Scripting

Parse XML file in shell script

Hi Everybody, I have an XML file containing some data and i want to extract it, but the specific issue in my file is that the data is repeated some times like the following example : <section1> <subsection1> X=... Y=... Z=... <\subsection1> <subsection2> X=... Y=... Z=......

4. Shell Programming and Scripting

Bash Shell Script to parse file

Raw Results: results|192.168.2|192.168.2.1|general/udp|10287|Security Note|For your information, here is the traceroute from 192.168.2.24 to 192.168.2.1 : \n192.168.2.24\n192.168.2.1\n\n results|192.168.2|192.168.2.1|ssh (22/tcp)|22964|Security Note|An SSH server is running on this port.\n...

5. UNIX for Dummies Questions & Answers

Help to parse csv file with shell script

Hello ! I am very aware that this is not the first time this question is asked here, because I have already read a lot of previous answers, but none of them worked, so... As said in the title, I want to read a csv file with a bash script. Here is a sample of the file: ...

6. Shell Programming and Scripting

script to parse the properties file

Hi Friends, I have a requirement to parse a properties file having a key=value pairs. i need to count the number of key value pairs in the properties file and iterate through each key-value pair. I have written the script to read the number of lines from the property file, but cannot...

7. Shell Programming and Scripting

Script to parse and update a parameter file

Dear All- My requirement is as below, need your inputs please 1] I have a file name Param.txt which contains the below data #GLOBAL# PARAM_VALUE=N ............. ............ CTRY=UK ......... 2] Next, I want to write a script which will check for some condition (lets assume...

8. Shell Programming and Scripting

Script to parse bookmarks file

I am using Internet Explorer v10 at work and regularly need to import my personal Firefox bookmarks over. Long story short, I have found the import falling over on any bookmark elements which are over 256 characters. The bookmark file contains bookmarks of this format: <DT><A...

9. Shell Programming and Scripting

Script parse file Linux

Hi all, I need help for a script that pulls out a series of numbers from a file (attached file) Basically I need a parse to write me in a variable: 9d424312 Can someone help me? Thank you

10. Homework & Coursework Questions

Script parse file

Use and complete the template provided. The entire template must be completed. If you don't, your post may be deleted! 1. The problem statement, all variables and given/known data: Hi all, I need help for a script that pulls out a series of numbers from a file (attached file) Basically I...

LEARN ABOUT DEBIAN

px_put_recordn

PX_PUT_RECORDN(3)					     Library Functions Manual						 PX_PUT_RECORDN(3)

NAME

       PX_put_recordn -- Stores record in Paradox file at certain position

SYNOPSIS

       #include <paradox.h>

       int PX_put_recordn(pxdoc_t *pxdoc, char *data, int recpos)

DESCRIPTION

       Stores  a  record  in the buffer data into a Paradox file at the given position recpos.	The first position has number 0. The function will
       determine the data block for this record. If the position is after the last data block, then as many as needed empty data  blocks  will	be
       added.  If the position is in the middle of a data block and there is no record right before the position, then the position will be recal-
       culated to make sure the new record will be stored in the first free slot of the datablock. For example, if a datablock contains H  records
       and  the first call of PX_put_recordn wants to store a record at postion 11, then this will be corrected to position H. PX_put_recordn will
       also add an empty data block and store the record as the first record of the second data block.	Storing a second  record  at  position	11
       again, will be executed without any position change.

       data  must  be constructed with PX_put_data_xxx(3) functions before. It is of the same structure as the record returned by PX_get_record(3)
       and PX_get_record2(3).

RETURN VALUE

       Returns the record position on success and -1 on failure. The first position has number 0.

SEE ALSO

       PX_get_record(3), PX_get_record2(3), PX_put_record(3),  PX_put_data_byte(3),  PX_put_data_short(3),  PX_put_data_long(3),  PX_put_data_dou-
       ble(3), PX_put_data_alpha(3)

AUTHOR

       This manual page was written by Uwe Steinmann uwe@steinmann.cx.

																 PX_PUT_RECORDN(3)