Login or Register to Ask a Question and Join Our Community


Shell Programming and Scripting

Verify the header and trailer in file

Login to Discuss or Reply to this Discussion in Our Community

 
Thread Tools Search this Thread
Top Forums Shell Programming and Scripting Verify the header and trailer in file
# 1  
Old 12-25-2012
Verify the header and trailer in file
please see my requirement, I hope I am clear.
Last edited by mirwasim; 01-17-2013 at 03:01 AM..
# 2  
Old 12-25-2012
Code:
awk -v L=$( wc -l < filename ) 'NR==1{
 header_p=sprintf "%s", substr($0,1,2);
 header=sprintf "%s", substr($0,3,22);
 } NR==L {
 trailer_p=sprintf "%s", substr($0,1,2);
 trailer=sprintf "%s", substr($0,3,22);
 trailer_L=sprintf "%s", substr($0,25,8);
 TL=sprintf "%08i", (L-2);
 if((header_p=="HH") && (trailer_p=="TT") && (header==trailer) && (trailer_L==TL))
  print "Validation Successful."
 else
  print "Validation Failed."
} ' filename

# 3  
Old 12-25-2012
when I executed code given by you in debug mode it mentioned below error
I replace file name with $1 in script.

Code:
+ wc -l
+ 0< toa_mica_usage_feed00009554
+ awk -v L= 565568 NR==1{
 header_p=sprintf "%s", substr($0,1,2);
 header=sprintf "%s", substr($0,3,22);
 } NR==L {
 trailer_p=sprintf "%s", substr($0,1,2);
 trailer=sprintf "%s", substr($0,3,22);
 trailer_L=sprintf "%s", substr($0,25,8);
 TL=sprintf "%08i", (L-2);
 if((header_p=="HH") && (trailer_p=="TT") && (header==trailer) && (trailer_L==TL))
  print "Validation Successful."
 else
  print "Validation Failed."
}  toa_mica_usage_feed00009554

Code:
awk: syntax error near line 1
awk: bailing out near line 1

Last edited by mirwasim; 01-17-2013 at 03:44 AM..
# 4  
Old 12-25-2012
Use nawk instead if your OS is SunOS or Solaris

Copy and use below code, pass filename as argument:
Code:
#!/bin/ksh

line_no=$( wc -l < $1 | sed 's/ //g' )

nawk -v L=$line_no 'NR==1{
 header_p=sprintf("%s", substr($0,1,2));
 header=sprintf("%s", substr($0,3,22));
 } NR==L {
 trailer_p=sprintf("%s", substr($0,1,2));
 trailer=sprintf("%s", substr($0,3,22));
 trailer_L=sprintf("%s", substr($0,25,8));
 TL=sprintf("%08i", (L-2));
 if((header_p=="HH") && (trailer_p=="TT") && (header==trailer) && (trailer_L==TL))
  print "Validation Successful."
 else
  print "Validation Failed."
} ' $1

# 5  
Old 12-25-2012
Below is the error after using nawk
Code:
nawk: can't open file NR==1{
 header_p=sprintf "%s", substr($0,1,2);
 header=sprintf "%s", substr($0,3,22);
 } NR==L {
 trailer_p=sprintf "%s", substr($0,1,2);
 trailer=sprintf "%s", substr($0,3,22);
 trai
 source line number 1

# 6  
Old 12-25-2012
I see you have used a different code, copy and use the nawk code which I posted above.
# 7  
Old 12-25-2012
---------- Post updated at 08:51 AM ---------- Previous update was at 08:42 AM ----------

Ok.thanks I lot, but I you can explain me how this code is doing it. for my understanding
Last edited by mirwasim; 01-17-2013 at 03:45 AM..
Login or Register to Ask a Question

Previous Thread | Next Thread

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Bash to verify and validate file header and data type

The below bash is a file validation check executed that will verify the correct header count of 10 and the correct data type in each field of the tab-delimited file. The key has the data type of each field in it. My real data has 58 headers in it but only the header and next row need to be... (6 Replies)
Discussion started by: cmccabe
6 Replies

2. UNIX for Advanced & Expert Users

Removing Header and Trailer record of a EBCDIC file

I have a EBCDIC multi layout file which has a header record which is 21 bytes, The Detail records are 2427 bytes long and the trailer record is 9 bytes long. Is there a command to remove the header as well as trailer record and read only the detail records while at the same time not altering... (1 Reply)
Discussion started by: abhilashnair
1 Replies

3. Shell Programming and Scripting

Split and add header and trailer from input file

I need to split the file based on pattern from position 34-37 while retaining the header and trailer records in each individual split file Also is it possible to output the TOM and PAT records in the same output file ? I need the output file names same as xyz_pattern_Datetimestamp.txt ... (23 Replies)
Discussion started by: techedipro
23 Replies

4. Shell Programming and Scripting

Script to validate file header and trailer

Hi, I need a script that validates a file header/detail/trailer. File layout is: Header - Rec_Type|File_name|File_Date Detail - Rec_Type|field1|field2|field3... Trailder - Rec_Type|File_name|File_Date|Record_count Sample Data: HDR|customer_data.dat|20120709... (7 Replies)
Discussion started by: ash_sh
7 Replies

5. Shell Programming and Scripting

Remove last few characters in a file but keeping Header and trailer intact

Hi All, I am trying write a simple command using AWK and SED to this but without any success. Here is what I am using: head -1 test1.txt>test2.txt|sed '1d;$d' test1.txt|awk '{print substr($0,0,(length($0)-2))}' >>test2.txt|tail -1 test1.txt>>test2.txt Input: Header 1234567 abcdefgh... (2 Replies)
Discussion started by: nvuradi
2 Replies

6. UNIX for Dummies Questions & Answers

Adding header and trailer into a file

Hi, I want to add the below Header to all the files in sequence File1,File2,File3...etc "ABC,<number of chracter in the file>" e,g - If File1 is as below pqrstuvdt abcdefgh then I want to add the above header into it ,So that File1 becomes as below ABC,17 pqrstuvdt abcdefgh ... (9 Replies)
Discussion started by: spari2
9 Replies

7. Shell Programming and Scripting

Adding Header and Trailer records to a appended file

How can we a shell script and pass date parameters .I have 3 files comming from Datastage with |" delimited I need append 3 files as above: File1: P0000|"47416954|"AU|"000|"INS|"0000|"|"20060601|"99991231|"|"|"|"|"01 File 2:... (2 Replies)
Discussion started by: e1994264
2 Replies

8. Shell Programming and Scripting

Creating Header & Trailer for bulk volume data file

Hi all, I have a requirement to create a Header &Trailer for a file which is having 20 millions of records. If I use the following method, i think it will take more time. cat "Header"> file1.txt cat Data_File>>file1.txt cat "Trailer">>file1.txt since second CAT command has to read all... (4 Replies)
Discussion started by: Raamc
4 Replies

9. Shell Programming and Scripting

Removing Header & Trailer from a file

Hi All, I am karthik. I am new to this forum. I have one requirement. I have a file with header and footer. Header may be like HDR0001 or FILE20090110 (Assume it is unknown so far, but i am sure there is a header in the file) likewise file has the trailer too. I just... (7 Replies)
Discussion started by: karthi_gana
7 Replies

10. UNIX for Dummies Questions & Answers

Copy all the files with time stamp and remove header,trailer from file

All, I am new to unix and i have the following requirement. I have file(s) landing into input directory with timestamp, first i want to copy all these files into seperate directory then i want to rename these files without timestamp and also remove header,trailer from that file.. Could... (35 Replies)
Discussion started by: ksrams
35 Replies
Login or Register to Ask a Question