Shell Programming and Scripting

Hi all,

We are going through a total migration from AIX-based server framework to Linux-based servers. When I am testing *.sh and *.awk in a lower environments, it abends at the same step everytime in verifying the record length of the first row of the source file.

I know this source file is good because I pulled the file from the production environment in which the source file was already processed succesfully. So, I'm thinking the existing script (a header checking process) that was pulled from the existing AIX production server. There are two result options for this script: Good or Problem File.

The error always comes back that there is a "Problem with the source file sent". I'm not a scripter as it's not part of my duties, but the task has fallen onto my team. Wondering if the script below is compatible with Linux server syntax?? ANY insight would be greatly appreciated.


BEGIN {
good_count = 0
bad_count = 0
line_count = 0
}
NR == 1 {
rec_count = substr($0, 15, 8)
date_str = substr($0, 32, 10)

print "Date in Header Record : " date_str
}
NR > 1 {
line_count++

if (length($0) == 710)
{
print $0 > GoodFile
good_count++
}
else
{
print $0 > BadFile
bad_count++
}
}
END {
if ( line_count == rec_count && bad_count==0 )
{
print "********************************************"
print "Count in header : " rec_count
print "Count in file received : " line_count
print " "
print "Number of Good Records : " good_count
print "Number of Bad Records : " bad_count
}
else
{
print "********************************************"
print " PROBLEM WITH FILE SENT FROM SOURCE "
print " "
print "Count in header : " rec_count
print "Count in file received : " line_count
print " "
print "Number of Good Records : " good_count
print "Number of Bad Records : " bad_count
exit 99
}
}

HI ,

if u can post the sample of your input file .it would be helpful to debug

Hi zozoo,

I tried pasting the header and 1st row of data but the format didn't show up right, so I'm attaching it. Although the actual 1st record row is displayed in multiple lines in the atachment, it IS on one line in the source file.

I also want to show the logfile for the result of 'verifying record length':

Date in Header Record : 04/22/2013
******************************************** PROBLEM WITH FILE SENT FROM SOURCE
Count in header : 400133
Count in file received : 400133
Number of Good Records : 400133
Number of Bad Records : 0

In the future, please post your source code as a single block inside CODE tags instead of tagging each line of your source code!

There isn't anything immediately obvious to me that is wrong with this awk script file.

I'm assuming that you at least realize that this is an awk script file; not a shell script file. Please show us the exact command line that is being used to invoke awk using this script file and show us how the input file is being passed to awk. Is input coming from a tape drive with variable length records (that the script is then verifying all each contain 710 characters not counting the trailing newline character)?

What Linux system are you using?
What shell are you using on Linux?
What version of AIX are you using on your AIX server?
What shell is being used on your AIX server?
Is the input data file encoded in EBCDIC?

[QUOTE=I'm assuming that you at least realize that this is an awk script file; not a shell script file. Please show us the exact command line that is being used to invoke awk using this script file and show us how the input file is being passed to awk. Is input coming from a tape drive with variable length records (that the script is then verifying all each contain 710 characters not counting the trailing newline character)?

What Linux system are you using?
What shell are you using on Linux?
What version of AIX are you using on your AIX server?
What shell is being used on your AIX server?
Is the input data file encoded in EBCDIC?[/QUOTE]


Hi Don,

Yes, sorry...yes I know it's an awk script based on the extension of the script.

==============
The process that invokes the awk script:

1. Check for source file arrival
2. Header date verified on incoming file from internal sql query to database
lookup table
3. Translate unwanted Characters to spaces
4. Move file from source directory to processing directory

After the above completes, the Verify Record Length AWK script automatically begins.

1. Veryifies total records and checks record lengths
===============

What Linux system are you using? Red Hat Enterprise Linux Server release 5.8 (Tikanga)
What shell are you using on Linux? Korn
What version of AIX are you using on your AIX server? 5.3.0.0
What shell is being used on your AIX server? Korn
Is the input data file encoded in EBCDIC? Do not know.

Should be all in one line:

Code:

if ( line_count == rec_count && bad_count==0 ) {

Dito

Code:

if (length($0) == 710) {

Hello,

So you're saying to place that one character symbol on the line you showed in your post?

Forgive me, but I am not involved in any scripiting in my job, so I am a bit ignorant. However, through googling trying to figure this out, I am a little more familiar now than I was before.

Question: regarding the "($0)" if (length($0) == 710)
Is this checking ONLY the length of the FIRST record? Not entirely sure what that variable is representing.