Shell Programming and Scripting

Hi RudiC

Let me try this sed in your last post.

Thanks.

You have already been told that shell variables are not expanded inside single quotes! This is true in any shell script. It doesn't matter whether the single quoted string is a sed script inside a shell script or an awk script inside a shell script.

What is in the file named /tmp/transnum? As stated in my post describing this script, that file must contain a list of one or more transaction numbers to be extracted, with one transaction number per line. IF YOU DO NOT PUT THE TRANSACTION NUMBERS YOU WANT TO EXTRACT IN THAT FILE, MY SCRIPT CANNOT WORK! There is nothing shown in your script that puts any data in /tmp/transnum.

What am I missing? Why is 23962395676 important as the last part of your output filename before the transaction number. (We know this is not a transaction number because you have told us that transaction numbers are 19 characters (not 12). And, the code I provided already included the transaction number as the last part of the output file's pathname. If what you want is the 2nd input file's pathname followed by an underscore followed by the transaction number; just change every occurrence of:

Code:

"TX:" transnum

in the script I posted in post #14 in this thread to:

Code:

FILENAME "_" transnum

And since the end of a transaction is NOT 0000EOT as you repeatedly told us, it is no wonder that the scripts that have been provided to you do not work. Since the end of a transaction is a line like:

Code:

0000EOT<><>000000000000019000000000000000000000000000019<><><>

instead of the exact line:

Code:

0000EOT

that you described before, you also need to change the line in my script:

Code:

$1 == "0000EOT" {

to:

Code:

/^0000EOT/ {

And, if the transaction number you're trying to extract is ABC160120XYZ0983921 (and, since this transaction number does not appear in your latest sample input, there would be no output), the transaction number has also changed positions from where you said it was (from following the 1st tilde to following the 2nd tilde), then you also need to change the line in my script:

Code:

$1 == "%%YEDTRN" && $2 in t {

to:

Code:

$1 == "%%YEDTRN" && $3 in t {

This is a classic case of what computer scientists refer to as GIGO (Garbage In, Garbage Out). If the specification of the input data does not match the input data provided for processing, please don't blame the scripts that we suggested! You HAVE to give us representative samples of the data you are processing if you need our help in writing your code!

If you don't fully understand how awk is processing this script, you might also want to keep the comments I provided instead of throwing them away.

@RudiC,

Thanks for your efforts trying to help me. But my version of unix(AIX) is not working for this SED command you have provided.
Thanks.

I'm sorry to hear that. Did you try any of the suggestions given on an (artificially) simplified data sample?

Hi Don,

Sorry, Since i am new to use blogging websites i am afraid of giving a banks transaction input structure in a public website. I am afraid since it might end up me in trouble and also apologize for a faulty input. I am learning 1 by 1 towards perfection.

I am going to try out your new suggestions will update you in 15 mins.

Thanks.

---------- Post updated at 05:40 PM ---------- Previous update was at 05:01 PM ----------

Hi Don

I am getting the below error after doing the changes what ever you have suggested.

Code:

awk: Cannot divide by zero.

 The input line number is 32042. The file is /tmp/remedixz.20160120_085021_41222370_1.
 The source line number is 18.

The line 32042 is the EOT line of the particular transaction reference number. Please find the code below

Code:

big_file='/tmp/remedixz.20160120_085021_41222370_1'
trannum="/tmp/transnum"

/tmp> cat /tmp/transnum
ABC160120XYZ0983921 

##In the above you can see the transnum given

awk -F '~' '
    FNR == NR {
      t[$1]
      tc = FNR
      next
      } 
      {
      l[++lc] = $0
      }
    $1 == "%%YEDTRN" && $3 in t {
        remove t[transnum = $2]
        tc--
    }

    /^0000EOT/ {
        if(transnum) {
            for(i = 1; i <= lc; i++)
                print l[i] > (/tmp/remedixz.20160120_085021_41222370_1_new "_" transnum)
            close(/tmp/remedixz.20160120_085021_41222370_1_new "_" transnum)
            printf("Transaction #%s extracted to file /tmp/remedixz.20160120_085021_41222370_1_new "_" transnum:%s\n", transnum,
                transnum)
        }
        if(tc) {
            lc = 0
            transnum = ""
        } else {
            exit
        }
    }' $trannum $file

This time i just directly gave the output file name rather than a variable.
Kindly let me know where i am missing something.

Thanks.

Try this adaptation of RudiC's suggestion and Don's adaption for proper shell quoting on AIX:

Code:

sed -n "
/~$transnum~/ {
H
g
}
/~$transnum~/,/EOT/p
h
" file

---
Not so much 2047 bytes, in most implementations much higher or unlimited, and for some there is a much lower limit but unrelated to LINE_MAX, as I think we worked out before here: Sequence extraction

hi Don

One more request too, the way how i want to give my output file was through a variable and not directly a file name. Please suggest for it.

Thanks.

---------- Post updated at 05:51 PM ---------- Previous update was at 05:43 PM ----------

Dear Scrutinizer,

Thanks a lot this time SED worked.

It gave me desired output .

Thanks.

---------- Post updated at 05:54 PM ---------- Previous update was at 05:51 PM ----------

Hi,

This msg is intended to all who are all replied to help me out.
Hats off for your efforts to help me. Also i request each one of you to suggest me a link of good materials as you feel it was, for me to learn the SED & AWK atleast the basics.

Thanks.