Shell Programming and Scripting

The code still not working. May be I am not getting it to work as expected. I will try tweaking the code.

If you can throw some more light with comments and any new code will be helpful.

Thanks

I sense the requirements are still blurry. The files come into current, and then you want to move the prior same-prefix to archive, but if there is already that name in archive, what do you want to do?

I provided a solution based on the original post and it does work as per original requirement.

Then the requirement was changed and it is still not clear.

For instance, are these the only files in the specified directories?

If so, then simply change any references from "File?_extract_*" to "*".

Or if there are other files there and they do not end with a date, then change the file name to "*[01][0-9][0-3][0-9]20[1-9][0-9]".

Dear GURUS,

First of all I am thankful for being patient with me. Let me explain in more detail:

Current will always have the filename with the latest "MMDDYYYY".
Archive will be having the last 6 MMDDYYYY for each of the filenames.

Whenever a file comes with a new MMDDYYYY then only you move the old file from CURRENT to ARCHIVE else you leave the old file in the CURRENT itself.

Say on August 1 is the first day. Both Current and Archive will be empty.
You are getting three files:
File1_extract_08012011.csv
BAXT_INV_08012011.csv
HMIA_CLS_08012011.csv

We will copy all the 3 file to Current folder.

Then next day Aug2, you are getting the following 3 files:
File1_extract_08022011.csv
BAXT_INV_08022011.csv
HMIA_CLS_08022011.csv

Now all the three files with 08012011 will be moved to ARCHIVE and the CURRENT will the 08022011 files.

Now on Aug3, we get only two files:
File1_extract_08032011.csv
BAXT_INV_08032011.csv

Now we should move only File1_extract_08022011.csv and BAXT_INV_08022011.csv to ARCHIVE and keep the HMIA_CLS_08022011.csv in the CURRENt folder. The latest 08032011 files will also be copied to CURRENT.

As of Aug3, ARCHIVE folder will have:

File1_extract_08012011.csv
BAXT_INV_08012011.csv
HMIA_CLS_08012011.csv
File1_extract_08022011.csv
BAXT_INV_08022011.csv

CURRENT folder will have:
File1_extract_08032011.csv
BAXT_INV_08032011.csv
HMIA_CLS_08022011.csv


This continues and at any point of time in future the ARCHIVE should have only the last 6 MMDDYYYY's.

Hope this gives a clear picture of what I am trying to do.

Thanks

So, a file to be moved to archive does not need to worry about overwrite.

Do you want to integrate the archive 6 file limit at the same time?

Code:

#!/usr/bin/ksh
 
cd $CURRENT_DIR
 
for file in *
do
 file_base=${file%_[01][0-9][0-3][0-9]20[0-3][0-9]}
 
 if [ $file_base = "$last_file_base" ]
 then
  mv last_file $ARCHIVE_DIR # one at a time for simplicity
  while (( 6 < $( ls $ARCHIVE_DIR/${file_base}_[01][0-9][0-3][0-9]20[0-3][0-9] 2>/dev/null | wc -l ) ))
  do
    ls -tr $ARCHIVE_DIR/${file_base}_[01][0-9][0-3][0-9]20[0-3][0-9] | read x
    rm -f $x
  done
 fi
 
 last_file=$file  last_file_base=$file_base
done

Yes Please that will be great.

Also if possible if you an include comments that will be informative for a beginner like me.

For example if you can add some comments here:

Code:

while (( 6 < $( ls $ARCHIVE_DIR/${file_base}_[01][0-9][0-3][0-9]20[0-3][0-9] 2>/dev/null | wc -l ) ))

Rather than blindly copying the code, I would like to learn and use it.

Thanks

Well,Try again:

Code:

#!/usr/bin/ksh
 
cd $CURRENT_DIR
 
ls *_[01][0-9][0-3][0-9]20[0-3][0-9] | sed '
  s/\(.*\)_\([01][0-9][0-3][0-9]\)20\([0-3][0-9]\)/\3\2 \1 &/
 ' | sort | while read xxkey file_base file
do
 if [ $file_base = "$last_file_base" ]
 then
  mv last_file $ARCHIVE_DIR # one at a time for simplicity
  while (( 6 < $(
                     ls $ARCHIVE_DIR/${file_base}_[01][0-9][0-3][0-9]20[0-3][0-9] 2>/dev/null | wc -l
                     ) ))
  do
    ls -tr $ARCHIVE_DIR/${file_base}_[01][0-9][0-3][0-9]20[0-3][0-9] | read x
    rm -f $x
  done
 fi
 
 last_file=$file  last_file_base=$file_base
done