UNIX for Dummies Questions & Answers

Hi there,

I need some help with this.

I have large number of files in /edw2/source/emm directory and the files have names like:

Code:

CDRCCN_4004_120223-2342-DCCSCAP-GETSP2-120423-1612-230384_20120420161300

Actually, what they all have that can distinguish them is 20120423 which is a date - 23rd April 2012 and the trailing 6 numbers (161300) of each file is time 16H13:00 so, I'll have different files with different time but of same date.

E.g.:

Code:

1 - CDRCCN_4004_120223-2342-DCCSCAP-GETSP2-120423-1612-230384_20120420161300
2 - CDRCCN_4004_120223-2342-DCCSCAP-GETSP2-120423-1612-230384_20120420151324

and so on till 140,00 files

This is what I'm trying to achieve:

1 - I want to move all files according to their dates in a folder I'll name according to dates. E.g. folder 20apr2012 for all 20th April files.

2 - I want to zip this folder (20apr2012), compress it and move it to another folder on different mount point - /edw2/source/emm2

Any help is much appreciated.

Thanks

Moderator's Comments:

Code tags for code, please.

You could get a list of the files with a specific datenumber sequence by using something like the below:

Code:

for file in $(ls | nawk -F"_" 'substr($NF,1,8) == "20120420"') ; do
mv $file /path/to/new/folder/
done

assuming you start off in the directory containing all the files and you want to move all files from April 20th 2012

Thanks spynappels.

What if I'm starting in another directory?

Because, I want to run this as a cron job.

Try

Code:

for i in /source/dir/*20120420??????; do echo mv $i /target/dir/ ; done; tar czf  /edw2/source/emm2/archivefilename /target/dir

The 6 "?" are to make sure we use the pattern you mentioned, to my knowledge a repetition factor doesn't exist in shell globbing.

Hi,

I really appreciate all your efforts but the above 2 scripts are not working.

I just tested them.

Anyone with more help?

Thanks

You need to be more specific in how they did not work. Did you get error messages? What was the output if any?

I didn't get any errors of any sort.

I changed directories as specified and ran the code the way it was sent and nothing changed.

i.e no files were moved nor zipped


But I came across one that works but this is more of a manual process:

Step 1: This moved all files with _20120630 into target directory
$ find . -name "*_20120630*" -print -exec mv {} /home/oracle/work/target \;

Step 2: Tar the target directory
$ tar -cvf 30jun2012.tar /home/oracle/work/adams_de/target

Step 3: Compress the tar file
$ gzip 30jun2012.tar

This I just tested and it worked perfectly but I want a scenario where I can automate this task and also delete the files that have already been compressed. I want to run this via cron.

Thanks for your effort, I appreciate a lot.