Sponsored Content
Top Forums Shell Programming and Scripting Split and add header and trailer from input file Post 302904206 by Chubler_XL on Monday 2nd of June 2014 08:09:21 PM
Old 06-02-2014
Try this:

Code:
awk -v stamp=$(date +%Y%m%d%H%M%S) '
{
  if (/^H/) {header=$0}
  else if (/^T/) {trailer=$0}
  else {
    typ=substr($0,34,3)
    if(typ == "PAT") typ="TOM"
    fname="xyz_" typ "_" stamp ".txt"
    if (!(fname in A)) {A[fname]; print header > fname}
    print $0 >> fname
    close(fname)
  }
}
END {
  for (fname in A) {
    print trailer >> fname
    close(fname)
  }
}
' Test.txt

Note: You will need the close(fname) statements if you ever get more than 20 or so record types as awk has a limited number of open files.
 

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Split large file and add header and footer to each file

I have one large file, after every 200 line i have to split the file and the add header and footer to each small file? It is possible to add different header and footer to each file? (1 Reply)
Discussion started by: ashish4422
1 Replies

2. Shell Programming and Scripting

Split large file and add header and footer to each small files

I have one large file, after every 200 line i have to split the file and the add header and footer to each small file? It is possible to add different header and footer to each file? (7 Replies)
Discussion started by: ashish4422
7 Replies

3. Shell Programming and Scripting

Removing Header & Trailer from a file

Hi All, I am karthik. I am new to this forum. I have one requirement. I have a file with header and footer. Header may be like HDR0001 or FILE20090110 (Assume it is unknown so far, but i am sure there is a header in the file) likewise file has the trailer too. I just... (7 Replies)
Discussion started by: karthi_gana
7 Replies

4. Shell Programming and Scripting

Creating Header & Trailer for bulk volume data file

Hi all, I have a requirement to create a Header &Trailer for a file which is having 20 millions of records. If I use the following method, i think it will take more time. cat "Header"> file1.txt cat Data_File>>file1.txt cat "Trailer">>file1.txt since second CAT command has to read all... (4 Replies)
Discussion started by: Raamc
4 Replies

5. Shell Programming and Scripting

Adding Header and Trailer records to a appended file

How can we a shell script and pass date parameters .I have 3 files comming from Datastage with |" delimited I need append 3 files as above: File1: P0000|"47416954|"AU|"000|"INS|"0000|"|"20060601|"99991231|"|"|"|"|"01 File 2:... (2 Replies)
Discussion started by: e1994264
2 Replies

6. UNIX for Dummies Questions & Answers

Adding header and trailer into a file

Hi, I want to add the below Header to all the files in sequence File1,File2,File3...etc "ABC,<number of chracter in the file>" e,g - If File1 is as below pqrstuvdt abcdefgh then I want to add the above header into it ,So that File1 becomes as below ABC,17 pqrstuvdt abcdefgh ... (9 Replies)
Discussion started by: spari2
9 Replies

7. Shell Programming and Scripting

Remove last few characters in a file but keeping Header and trailer intact

Hi All, I am trying write a simple command using AWK and SED to this but without any success. Here is what I am using: head -1 test1.txt>test2.txt|sed '1d;$d' test1.txt|awk '{print substr($0,0,(length($0)-2))}' >>test2.txt|tail -1 test1.txt>>test2.txt Input: Header 1234567 abcdefgh... (2 Replies)
Discussion started by: nvuradi
2 Replies

8. Shell Programming and Scripting

Script to validate file header and trailer

Hi, I need a script that validates a file header/detail/trailer. File layout is: Header - Rec_Type|File_name|File_Date Detail - Rec_Type|field1|field2|field3... Trailder - Rec_Type|File_name|File_Date|Record_count Sample Data: HDR|customer_data.dat|20120709... (7 Replies)
Discussion started by: ash_sh
7 Replies

9. Shell Programming and Scripting

Verify the header and trailer in file

please see my requirement, I hope I am clear. (9 Replies)
Discussion started by: mirwasim
9 Replies

10. UNIX for Advanced & Expert Users

Removing Header and Trailer record of a EBCDIC file

I have a EBCDIC multi layout file which has a header record which is 21 bytes, The Detail records are 2427 bytes long and the trailer record is 9 bytes long. Is there a command to remove the header as well as trailer record and read only the detail records while at the same time not altering... (1 Reply)
Discussion started by: abhilashnair
1 Replies
clm imac(1)							  USER COMMANDS 						       clm imac(1)

  NAME
      clm imac - Interpret Matrices (c.q. MCL iterands output by mcl) As Clusterings.

      clmimac  is not in actual fact a program. This manual page documents the behaviour and options of the clm program when invoked in mode imac.
      The options -h, --apropos, --version, -set, --nop are accessible in all clm modes. They are described in the clm manual page.

  SYNOPSIS
      clm imac -imx <fname> [options]

      clm imac -imx fname (input file) [-o fname (name/stem for output)] [-dag fname (output  DAG)]  [-overlap	str  (overlap  mode)]  [-sort  str
      (size|revsize|lex|none)]	[-strict  num (in 0..1)] [-h (print synopsis, exit)] [--apropos (print synopsis, exit)] [--version (print version,
      exit)]

  DESCRIPTION
      Use clm imac to interpret matrices (as clusterings) output by mcl using mcl's -dump ite option.

      Use clm imac only if you have a special reason; the normal usage of mcl is to do multiple runs for varying -I parameters and use	the  clus-
      terings output by mcl itself.  One reason is if you are interested in clusterings with overlap; early MCL iterands generally induce cluster-
      ings possessing overlap.	Another reason is to investigate how the cluster structure associated with the MCL process evolves over time.

  OPTIONS
      -imx fname (input file)
	The input file is presumably an MCL iterand resulting from the mcl option -dump ite.

      -strict num (in 0..1)
	Higher values (up until 1) will thin out the DAG constructed by clm imac. The default value is 0.00001, yielding the full DAG.

      -o fname (file name/stem)
	Write to file named fname.

      -dag fname (output DAG)
	Write the DAG (directed acyclic graph) constructed from the input to file. This DAG is constructed according to the  structure	associated
	with  diagonally positive semi-definite matrices as described in the PhD thesis Graph clustering by flow simulation.  Consult mclfamily(7)
	for references.

      -sort str (size|revsize|lex|none)
	Sort the clusters either by increasing size, decreasing size, lexicographically by the indices they contain, or use the clustering exactly
	as obtained from the interpretation routine.

      -overlap mode (overlap mode)
	With  mode  set  to  cut,  remove  any overlap by allocating the nodes in overlap to the first cluster in which they were found. Mode keep
	leaves overlap unchanged, and mode split results in overlapping parts excised and introduced as clusters in their own right.

  AUTHOR
      Stijn van Dongen.

  SEE ALSO
      mclfamily(7) for an overview of all the documentation and the utilities in the mcl family.

  clm imac 12-068						      8 Mar 2012							 clm imac(1)
All times are GMT -4. The time now is 08:34 PM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy