Shell Programming and Scripting

Hello!

I'm having a bit of trouble coming up with a script that can connect to 3 different log boxes and pull down files for that day into a single directory, where the files will all have the same name as per:

Code:

stats_websites_20150801010000-20150801015959.csv.gz
stats_websites_20150801020000-20150801025959.csv.gz
stats_websites_20150801030000-20150801035959.csv.gz
stats_websites_20150801040000-20150801045959.csv.gz
stats_websites_20150801050000-20150801055959.csv.gz
stats_websites_20150801060000-20150801065959.csv.gz
stats_websites_20150801070000-20150801075959.csv.gz
stats_websites_20150802010000-20150802015959.csv.gz
stats_websites_20150802020000-20150802025959.csv.gz
stats_websites_20150802030000-20150802035959.csv.gz
stats_websites_20150802040000-20150802045959.csv.gz
stats_websites_20150802050000-20150802055959.csv.gz
stats_websites_20150802060000-20150802065959.csv.gz
stats_websites_20150802070000-20150802075959.csv.gz

What I'm doing manually at the moment is going to each box and downloading the files for the day. Once the download is complete, I then create a file containing the directory listing as per:

Code:

ls >> dir.tmp

Followed by a loop:

Code:

cat dir.tmp | while read file do; mv $file boxname_$file

I then repeat this for the 2 other boxes I use. As you can see this is a pretty tedious and incredibly inefficient way of doing things.

So I'm looking to try and write a script that will run as a cronjob once a day that will ftp to each box, mget all the logs for the day, adding the boxname (BM, HH or MR) to the local copie's filename so that they will not overwrite each other.

I need them all in the same all in the same directory to be able to run searches and various other scripts across all files.

Any help appreciated.

Thanks
Cludgie

You are not going to get away from some sort of loop:

Code:

ls -1 | xargs mv -I {} mv {} boxname_{}

or

Code:

for file in *; do mv $file boxname_$file; done

now if you can save the files for each system in a subdirectory, then you could do something like:

Code:

for file in */*; do mv $file ${file%%/*}_${file#/*}; done

after all the file transfers are done.

Thanks for getting back to me derekludwig,

Yeah it makes sense now. The second option nails it for me and now I can add that line to the bottom of the script before connecting to the next box.

Thanks again
cludgie