Copy all the files with time stamp and remove header,trailer from file


 
Thread Tools Search this Thread
Top Forums UNIX for Dummies Questions & Answers Copy all the files with time stamp and remove header,trailer from file
# 15  
Old 07-26-2007
Quote:
Originally Posted by Shell_Life
Ok.
Show me exactly how you are running the shell I wrote.
Here is the script..
Quote:
#!usr/bin/ksh
inDir=$1
outDir=$2
timeStmpExpr='_[0-9]\{8\}.[0-9]\{6\}.TXT'
ls ${inDir} | grep $timeStmpExpr | \
while read inFile
do
echo "inside loop"
FName=`echo ${inFile} | sed "s/\(.*\)${timeStmpExpr}/\1/"`
outFile=${outDir}${FName}'.txt'
sed '1d;$d' ${inFile} > ${outFile}
rm -f ${inFile}
done
echo "FIle copying COmpleted"
Then i executed the following command for script cp_script.ksh

Quote:
$. cp_script.ksh /home/input /home/output
Output displayed on the screen is
Quote:
$FIle copying COmpleted
None of the files copied to /home/output directory
Please correct if anything i am doing wrong..
# 16  
Old 07-26-2007
Ksrams,
The first thing I can see is on the first line:
Code:
#!usr/bin/ksh

It should be exactly where the 'ksh' is located in your system.

Generally:
Code:
#!/bin/ksh

# 17  
Old 07-26-2007
@ksrams

I would like to modify the shell_life code a bit here ... see it.

#!/bin/ksh
mInDir=$1 ## Parameter one
mOutDir=$2 ## Parameter two
mDTimeExp='_[0-9]\{8\}.[0-9]\{6\}.txt'
cd ${1}
ls -1 | while read mFile
do
if [[ -f $mFName]]
then
mFName=`echo ${mFile} | sed "s/\(.*\)${mDTimeExp}/\1/"`
mOutFile=${mOutDir}${mFName}'.txt'
sed '1d;$d' ${mFile} > ${mOutFile}
rm -f ${mFile}
fi
done


Please pass as argument the absolute path to input directory and oupt directory
Ex script_name /home/user/ksrams/input /home/user/ksrams/output
keep all your input*_22224*.txt directory here ...
run the script hope work .
enjoy
# 18  
Old 07-26-2007
Code:
timeStmpExpr='_[0-9]\{8\}.[0-9]\{6\}.TXT'

versus:
Code:
timeStmpExpr='_[0-9]\{8\}.[0-9]\{6\}.txt'

# 19  
Old 07-26-2007
Quote:
Originally Posted by Shell_Life
Ksrams,
The first thing I can see is on the first line:
Code:
#!usr/bin/ksh

It should be exactly where the 'ksh' is located in your system.

Generally:
Code:
#!/bin/ksh

Thanks a lot for all your prompt responses Shell_life.
I made the above change and did run the script but its not copied any of the files in input directory to output directory.
Still i got output result as
Quote:
FIle copying COmpleted
its not at all displaying
Quote:
inside loop
message on the screen, i believe its not processing while loop..right?
# 20  
Old 07-26-2007
Jambesh,

I tried your code and its giving me this output

Quote:
[[ : not found
[[ : not found
[[ : not found
[[ : not found
[[ : not found
Any Idea how to correct the above error..
# 21  
Old 07-26-2007
Quote:
Originally Posted by Shell_Life
Code:
timeStmpExpr='_[0-9]\{8\}.[0-9]\{6\}.TXT'

versus:
Code:
timeStmpExpr='_[0-9]\{8\}.[0-9]\{6\}.txt'

File extensions in the input directory are .TXT and i want output file extensions as .txt

Thanks..
 
Login or Register to Ask a Question

Previous Thread | Next Thread

10 More Discussions You Might Find Interesting

1. UNIX for Beginners Questions & Answers

Append pipe | at the end of all the rows except header n trailer for all the files under a directory

Hi Experts Need help... I am looking for a Unix script to append pipe | at the end of all the rows (except header and trailer)in all the files placed under the directory /interfaces/Temp e.g. Header row1 row2 row3 Trailer The script should read all the files under... (3 Replies)
Discussion started by: phani333
3 Replies

2. Shell Programming and Scripting

Verify the header and trailer in file

please see my requirement, I hope I am clear. (9 Replies)
Discussion started by: mirwasim
9 Replies

3. Shell Programming and Scripting

Script to validate file header and trailer

Hi, I need a script that validates a file header/detail/trailer. File layout is: Header - Rec_Type|File_name|File_Date Detail - Rec_Type|field1|field2|field3... Trailder - Rec_Type|File_name|File_Date|Record_count Sample Data: HDR|customer_data.dat|20120709... (7 Replies)
Discussion started by: ash_sh
7 Replies

4. Shell Programming and Scripting

Remove last few characters in a file but keeping Header and trailer intact

Hi All, I am trying write a simple command using AWK and SED to this but without any success. Here is what I am using: head -1 test1.txt>test2.txt|sed '1d;$d' test1.txt|awk '{print substr($0,0,(length($0)-2))}' >>test2.txt|tail -1 test1.txt>>test2.txt Input: Header 1234567 abcdefgh... (2 Replies)
Discussion started by: nvuradi
2 Replies

5. UNIX for Dummies Questions & Answers

Adding header and trailer into a file

Hi, I want to add the below Header to all the files in sequence File1,File2,File3...etc "ABC,<number of chracter in the file>" e,g - If File1 is as below pqrstuvdt abcdefgh then I want to add the above header into it ,So that File1 becomes as below ABC,17 pqrstuvdt abcdefgh ... (9 Replies)
Discussion started by: spari2
9 Replies

6. Shell Programming and Scripting

Identify log files based on time stamp,zip and then copy..HELP

Hi All, PFB is a requirement. I am new to shell scripting. So plz help. It would be highly appreciated. 1. choose all the log files based on a particular date (files location is '/test/domain')--i.e,we should choose all the files that are modified on 29th November, neither 28th nor 30th 2.... (3 Replies)
Discussion started by: skdas_niladri
3 Replies

7. Shell Programming and Scripting

improve performance - replace $\| with $#@ and remove header and trailer records

Hi All, In my file i need to remove header and trailer records which comes in 1st line and last line respectively. After that i need to replace '$\|' with '$#@'. I am using sed command for this and its taking lot of time. Is there any other command which can be used to improve performance? ... (1 Reply)
Discussion started by: HemaV
1 Replies

8. Shell Programming and Scripting

how to copy an alertlog file from a particular time stamp?

Hi, Can any one tell me how to copy an alertlog file from a particular time stamp using shell script? Thanks (3 Replies)
Discussion started by: suman_dba1
3 Replies

9. Shell Programming and Scripting

Merge text files while combining the multiple header/trailer records into one each.

Situation: Our system currently executes a job (COBOL Program) that generates an interface file to be sent to one of our vendors. Because this system processes information for over 100,000 employees/retirees (and growing), we'd like to multi-thread the job into processing-groups in order to... (4 Replies)
Discussion started by: oordonez
4 Replies

10. Shell Programming and Scripting

Remove header(first line) and trailer(last line) in ANY given file

Hi, I need some help in removing the header (first line) and the trailer (last line) in a give file... The data file actually comes in EBCDIC format and I converted it into ASCII.. Now I need to strip off the first line and the last line.. I think we can use sed to do something like this:... (2 Replies)
Discussion started by: madhunk
2 Replies
Login or Register to Ask a Question