Copy all the files with time stamp and remove header,trailer from file


 
Thread Tools Search this Thread
Top Forums UNIX for Dummies Questions & Answers Copy all the files with time stamp and remove header,trailer from file
# 29  
Old 07-27-2007
Ksrams,
As I said before, the shell script must be run using two parameters:
1) Input directory.
2) Output directory.

You must run it as:
Code:
your_shell.sh   your_input_directory   your_output_directory

# 30  
Old 07-27-2007
Quote:
Originally Posted by Shell_Life
Ksrams,
As I said before, the shell script must be run using two parameters:
1) Input directory.
2) Output directory.

You must run it as:
Code:
your_shell.sh   your_input_directory   your_output_directory

Thanks Shell_Life..Now output displays all the files in the input directory with inside loop error can't open file.txt and this 0 byte file.txt copied to the directory one level above the output directory suppiled(i have passed /home/output as output directory and this file copied to /home directory)
Input file(s) permissions are rw-r--r--
Please let me know your thoughts on this..
# 31  
Old 07-30-2007
Quote:
Originally Posted by ksrams
Thanks Shell_Life..Now output displays all the files in the input directory with inside loop error can't open file.txt and this 0 byte file.txt copied to the directory one level above the output directory suppiled(i have passed /home/output as output directory and this file copied to /home directory)
Input file(s) permissions are rw-r--r--
Please let me know your thoughts on this..
shell_life,
could you plase help me on the above error..
# 32  
Old 07-30-2007
Ksrams,
If you do not display exactly what you are entering, we will not get anywhere.

Display exactly how you are running the shell.
# 33  
Old 07-30-2007
Quote:
Originally Posted by Shell_Life
Ksrams,
If you do not display exactly what you are entering, we will not get anywhere.

Display exactly how you are running the shell.
Shell_Life,
Sorry..here is the information..

code for input_cp_output.ksh:

Quote:
$more input_cp_output.ksh
#!/bin/ksh
inDir=$1 #Input Directory
outDir=$2 #output directory
timeStmpExpr='_[0-9]\{8\}.[0-9]\{6\}.txt'
echo 'Just before ls 11111'
ls ${inDir}
echo 'Just before ls-grep 22222'
ls ${inDir} | grep $timeStmpExpr
echo 'Just before ls-grep-while 22222'
ls ${inDir} | grep $timeStmpExpr | \
while read inFile
do
echo "inside loop"
FName=`echo ${inFile} | sed "s/\(.*\)${timeStmpExpr}/\1/"`
outFile=${outDir}${FName}'.txt'
sed '1d;$d' ${inFile} > ${outFile}
rm -f ${inFile}
done
echo "FIle copying COmpleted"
I am executing this script input_cp_output.ksh using the following command
Quote:
$ input_cp_output.ksh /home/dev/input/mhs/iss/cdw_mhs /home/dev/output/mhs/iss/temp
out put is :
Quote:
Just before ls 11111
covmas_20070629_145617.TXT ncamas_20070629_145617.TXT
demfrz_20070629_145617.TXT rcgmas_20070629_145617.TXT
diamas_20070629_145617.TXT rf1mas_20070629_145617.TXT
enbfrz_20070629_145617.TXT rf2mas_20070629_145617.TXT
enpfrz_20070629_145617.TXT rfbmas.txt
mcmmas_20070629_145617.TXT rfbmas_20070629_145617.TXT
mcmmas_20070629_145617.txt rfbmas_20070629_145617.txt
memfrz_20070629_145617.TXT svcmas_20070629_145617.TXT
Just before ls-grep 22222
mcmmas_20070629_145617.txt
rfbmas_20070629_145617.txt
Just before ls-grep-while 22222
inside loop
Can't open mcmmas_20070629_145617.txt
inside loop
Can't open rfbmas_20070629_145617.txt
FIle copying COmpleted
Could you please explain me why its not able open files mcmmas_20070629_145617.txt, rfbmas_20070629_145617.txt
Thanks in advance..
# 34  
Old 07-30-2007
Ksrams,
Your problem is file permissions -- you do not have read permissions in the files
you are trying to read.

Try the following:
Code:
chmod 777 *.txt

Then check the permissions on the '*.txt' files.
# 35  
Old 07-30-2007
Quote:
Originally Posted by Shell_Life
Try the following:
Code:
chmod 777 *.txt

Rather than do that, do it correctly and set only the permissions required, this would give word access to abuse yor files.
 
Login or Register to Ask a Question

Previous Thread | Next Thread

10 More Discussions You Might Find Interesting

1. UNIX for Beginners Questions & Answers

Append pipe | at the end of all the rows except header n trailer for all the files under a directory

Hi Experts Need help... I am looking for a Unix script to append pipe | at the end of all the rows (except header and trailer)in all the files placed under the directory /interfaces/Temp e.g. Header row1 row2 row3 Trailer The script should read all the files under... (3 Replies)
Discussion started by: phani333
3 Replies

2. Shell Programming and Scripting

Verify the header and trailer in file

please see my requirement, I hope I am clear. (9 Replies)
Discussion started by: mirwasim
9 Replies

3. Shell Programming and Scripting

Script to validate file header and trailer

Hi, I need a script that validates a file header/detail/trailer. File layout is: Header - Rec_Type|File_name|File_Date Detail - Rec_Type|field1|field2|field3... Trailder - Rec_Type|File_name|File_Date|Record_count Sample Data: HDR|customer_data.dat|20120709... (7 Replies)
Discussion started by: ash_sh
7 Replies

4. Shell Programming and Scripting

Remove last few characters in a file but keeping Header and trailer intact

Hi All, I am trying write a simple command using AWK and SED to this but without any success. Here is what I am using: head -1 test1.txt>test2.txt|sed '1d;$d' test1.txt|awk '{print substr($0,0,(length($0)-2))}' >>test2.txt|tail -1 test1.txt>>test2.txt Input: Header 1234567 abcdefgh... (2 Replies)
Discussion started by: nvuradi
2 Replies

5. UNIX for Dummies Questions & Answers

Adding header and trailer into a file

Hi, I want to add the below Header to all the files in sequence File1,File2,File3...etc "ABC,<number of chracter in the file>" e,g - If File1 is as below pqrstuvdt abcdefgh then I want to add the above header into it ,So that File1 becomes as below ABC,17 pqrstuvdt abcdefgh ... (9 Replies)
Discussion started by: spari2
9 Replies

6. Shell Programming and Scripting

Identify log files based on time stamp,zip and then copy..HELP

Hi All, PFB is a requirement. I am new to shell scripting. So plz help. It would be highly appreciated. 1. choose all the log files based on a particular date (files location is '/test/domain')--i.e,we should choose all the files that are modified on 29th November, neither 28th nor 30th 2.... (3 Replies)
Discussion started by: skdas_niladri
3 Replies

7. Shell Programming and Scripting

improve performance - replace $\| with $#@ and remove header and trailer records

Hi All, In my file i need to remove header and trailer records which comes in 1st line and last line respectively. After that i need to replace '$\|' with '$#@'. I am using sed command for this and its taking lot of time. Is there any other command which can be used to improve performance? ... (1 Reply)
Discussion started by: HemaV
1 Replies

8. Shell Programming and Scripting

how to copy an alertlog file from a particular time stamp?

Hi, Can any one tell me how to copy an alertlog file from a particular time stamp using shell script? Thanks (3 Replies)
Discussion started by: suman_dba1
3 Replies

9. Shell Programming and Scripting

Merge text files while combining the multiple header/trailer records into one each.

Situation: Our system currently executes a job (COBOL Program) that generates an interface file to be sent to one of our vendors. Because this system processes information for over 100,000 employees/retirees (and growing), we'd like to multi-thread the job into processing-groups in order to... (4 Replies)
Discussion started by: oordonez
4 Replies

10. Shell Programming and Scripting

Remove header(first line) and trailer(last line) in ANY given file

Hi, I need some help in removing the header (first line) and the trailer (last line) in a give file... The data file actually comes in EBCDIC format and I converted it into ASCII.. Now I need to strip off the first line and the last line.. I think we can use sed to do something like this:... (2 Replies)
Discussion started by: madhunk
2 Replies
Login or Register to Ask a Question