Removing trailer from a flat file!!!

kumarsaravana_s · #1 (**permalink**) 06-23-2007

Hi,

I get some flat files with trailer which gives the totol records count and i want to remove the trailer from the file.

i used the following command it works fine with a single file.

cat file_name | grep -v 'Total records:' > file1
mv file file_name

But i dont know how to remove the trailer when we have more than 1 file and how to redirect them and move them back to the original file name

The syntax of file is :

<date>.file_name.txt

something like 06222007.aaa_ddd_ccc_ddd.txt
06212007.aaa_ddd_ccc_ddd.txt
06202007.aaa_ddd_ccc_ddd.txt

Regards,
Kumar

kamitsin · #2 (**permalink**) 06-23-2007

Code:

#!/bin/ksh
for i in `ls -lrt *file_name.txt|awk '{print $9}'
do
   grep -v 'Total records:' $i > $i_new
   mv $i_new $i
done

Simple !!!!

reborg · #3 (**permalink**) 06-23-2007

Quote:

Originally Posted by kamitsin

Code:

for i in `ls -lrt *file_name.txt|awk '{print $9}'

Not as simple as it should be.

Code:

for file in *file_name.txt ; do
   grep -v 'Total records:' $file > ${file}_new
   mv ${file}_new $file
done

or even simpler if you have gnu sed

Code:

sed -i '/Total records:/d' *file_name.txt

RishiPahuja · #4 (**permalink**) 06-23-2007

Try this

Code:

for filename in `ls -1  *aaa_ddd_ccc_ddd.txt`
do 
sed -e '$d' $filename > /tmp/tmpfile
mv /tmp/tmpfile $filename
done

This assumes your trailer is last line always!

reborg · #5 (**permalink**) 06-23-2007

RishiPahuja, if you used the same sed expression as I did in the gnu sed you would not depend on it being the last line.

Quote:

Originally Posted by RishiPahuja

Try this

Code:

for filename in `ls -1  *aaa_ddd_ccc_ddd.txt`

Don't do this. The shell has glob pattern, the ls is not required and will break the code if there are spaces in the filename.

The correct way to do this is:

Code:

for fillename in *aaa_ddd_ccc_ddd.txt

kumarsaravana_s · #6 (**permalink**) 06-23-2007

Quote:

Originally Posted by reborg

RishiPahuja, if you used the same sed expression as I did in the gnu sed you would not depend on it being the last line.

Don't do this. The shell has glob pattern, the ls is not required and will break the code if there are spaces in the filename.

The correct way to do this is:

Code:

for fillename in *aaa_ddd_ccc_ddd.txt

Thanks a lot friends.I will try these methods and let you know.Thanks again.

kumarsaravana_s · #7 (**permalink**) 06-23-2007

Quote:

Originally Posted by reborg

RishiPahuja, if you used the same sed expression as I did in the gnu sed you would not depend on it being the last line.

Don't do this. The shell has glob pattern, the ls is not required and will break the code if there are spaces in the filename.

The correct way to do this is:

Code:

for fillename in *aaa_ddd_ccc_ddd.txt

Hi,

When i run the following code,it gets into an infinite loop and never comes out.
#!/usr/bin/ksh
cd /space/tmp/file

for filename in *aaa_ddd_ccc_ddd.txt
do
grep -v 'Total records:' > $filename_new
mv $filename_new $filename
done

More UNIX and Linux Forum Topics You Might Find Helpful
Thread	Thread Starter	Forum	Replies	Last Post
Removing asterix (*) from flat files	ctrl_alt_del	Shell Programming and Scripting	3	10-18-2007 09:29 AM
Copy all the files with time stamp and remove header,trailer from file	ksrams	UNIX for Dummies Questions & Answers	35	07-30-2007 02:15 PM
Help with a Flat File!!!	kumarsaravana_s	Shell Programming and Scripting	11	06-07-2007 11:15 PM
Count No of Records in File without counting Header and Trailer Records	guiguy	Shell Programming and Scripting	2	06-07-2007 12:15 PM
Remove header(first line) and trailer(last line) in ANY given file	madhunk	Shell Programming and Scripting	2	03-13-2006 03:36 PM

Thread Tools	Search this Thread
Show Printable Version Email this Page	Search this Thread: Advanced Search
Display Modes	Rate This Thread
Switch to Linear Mode Hybrid Mode Switch to Threaded Mode	Rate This Thread: