Shell Programming and Scripting

Hi All,

We have file structure as following. (Coma ';' delimiter file)

Header
1;...
1;...
1;...
2;...
2;...
2;...
Trailer

We need to split this file as following. (for each change in first field, after header, we need to create new file with Header and Trailer line)

Header
1;...
1;...
1;...
Trailer

Header
2;...
2;...
2;...
Trailer

Please advice how we can do this.

Thanks.

Hi the below code will create the separate files for each diffrent first value.

Code:

TESTING>cat awk_input1.txt
Header
1;...
1;...
1;...
2;...
2;...
2;...
Trailer

awk -F";" '{ print >> "file"_$1}' awk_input1.txt

Try to modify the above code to place the header and footer in each file.

Thanks panyam. I will try this code.

After the above command .you can do something like this

TEST> for i in `ls file*`
> do
> echo "Header" > ${i}"_changed"
> cat $i >> ${i}"_changed"
> echo "Trailer" >> ${i}"_changed"
> done

my code also generates a file for Header and Footer ..Don't forget to get rid of that or delete the files at the end.

for i in file*

Hi All,

Thanks for your help. I am using following code and its working fine.

awk -F";" '{ print >> "file"_$1}' Testfile.txt
for i in `ls file*`
do
awk '/^HEADER/ {print $0 }' Testfile.txt > ${i}"_CHANGED"
cat $i >> ${i}"_CHANGED"
awk '/^TRAILER/ {print $0 }' Testfile.txt >> ${i}"_CHANGED"
echo "\n" >> ${i}"_CHANGED"
done
rm *DFHDR* *DFTLR*

Thanks.

Hi
This code works for small files.
but for large files, its giving error...

awk: too many output files 10
record number 222

its creating max 10 files.... any option that we need to change so that code creates more files.

Please advice.
thanks.