Hi Team,

I am trying to cut a large file into multiple files. It has

Header

50,050 records

Trailer

-------------------------------------------

I need to cut the files into multiple files of 1000 records and should have the same header and trailer as the original files.

-------------------------------------------

Output files should be

Header

1000 Records

Trailer.

-------------------------------------------------

Can someone help me here??

split -d -l 1000 filename filename_out

head -1 filename > header
tail -1 filename > trailer

for file in filename_out*
do
   cat header ${file} trailer > tmp
   mv tmp ${file}
done

Thanks.

But the code has an issue.

the first file has

Header
999records..

I want to start the split from 3rd records. As my file has
Header
\n(One line Gap)
Records
\n(one line gap)
Trailer

Also for trailer I need the record count.

Say if a file has 5005 records... then first 5 files should show
Header, 1000 records, and Trailer(containing the records count of 1000)

6th file should have header, 5 records, Trailer with records count as 5.

You said that you want the same header and trailer as the original file!

By the way I missed skipping header & trailer, which you can do using awk :

lines=$( wc -l < filename )
awk -v L=$lines 'NR>1&&NR<L' filename > filename_data
split -d -l 1000 filename_data filename_out

head -1 filename > header

for file in filename_out*
do
   cat header ${file} > tmp
   wc -l < ${file} >> tmp
   mv tmp ${file}
done

Trying to find a awk only solution, the script has become uglier and uglier, but here it is:

$ awk  'NR==FNR {T=(T?T:"\n")$0; next}        # save trailer from tail process substitution below
        FNR<3   {H=H$0(H?"":"\n"); next}      # save header in first two lines
        /^$/    {exit}                        # find start of trailer (= empty line as specified) and quit
        !((FNR-2)%N-1) {if (fn) print T > fn; # every N records:
                        fn="file"++i;         # create new filename
                        print H > fn}
        {print > fn}                          # print to just created filename
        END {print T > fn}                    # add trailer to last file
       ' N=1000 <(tail -2 file) file          # process substitution, not in all shells available