Sponsored Content
Top Forums Shell Programming and Scripting Script to tar/rsync/rm multiple folder names Post 302970883 by bakunin on Wednesday 13th of April 2016 05:10:48 AM
Old 04-13-2016
Quote:
Originally Posted by robertkwild
bear in mind i am really new to bash scripting, the only thing i know how to do is commands in scripts like cd rm tar rsync cp stuff like that
Welcome to the forum. There is no problem with being a beginner. We are here to help you (learn). How about i give you some pointers and you try to fill in the rest?

Quote:
Originally Posted by robertkwild
i have mutiple project folders in the "to_be_archived" folder ie

batman
superman
hulk
spiderman
iron_man
etc etc...

so it makes a tar file of the folder, rsyncs tar file to another folder "archived_projects" and deletes the tar file and folder in "to_be_archived"
I take it, you want a separate tar-file for each folder, i.e. a batman.tar, a superman.tar, and so on, yes?

If so: this is really easy to set up by using a loop. Here is how to do it:

Code:
for DIR in /some/dir/to_be_archived/* ; do
    echo $DIR
done

This will cycle through all directory entries of /some/dir/to_be_archived/* (in scripts it is always better to use absolute paths instead of relative ones) and set the variable "$DIR" to each value for every run through the loop. As it is there is only one command - echo $DIR - but it shows the mechanism.

Because you perhaps want to use the last part of the name for the naming you need to extract this first into another variable and then use this:

Code:
for DIR in /some/dir/to_be_archived/* ; do
    echo full DIR is: $DIR
    echo dir name : ${DIR##*/}
done
full DIR is: /some/dir/to_be_archived/batman
dir name : batman
full DIR is: /some/dir/to_be_archived/superman
dir name : superman
full DIR is: /some/dir/to_be_archived/hulk
dir name : hulk
[....]

Now let us construct some commands around this:
Code:
cd /some/dir/to_be_archived
for DIR in /some/dir/to_be_archived/* ; do
    fSaveDir="${DIR##*/}"
    echo tar cvf /some/dir/to_be_archived/${fSaveDir}.tar ./${fSaveDir}
done
tar /some/dir/to_be_archived/batman.tar ./batman
tar /some/dir/to_be_archived/superman.tar ./superman
tar /some/dir/to_be_archived/hulk.tar ./hulk
[....]

If this is what you want, remove the "echo" so that the command - instead of being displayed - is executed. The same way you can add more commands inside the loop and use "${fSaveDir}" whereever you would enter the directories name.

Quote:
Originally Posted by robertkwild
i want to check before it deletes the folder and tar file in the (to_be_archived) i want to double check if it has rsynced the whole file across to (archived_projects)
This is understandable, but there is a better way to do this: UNIX-commands always set a "return code" upon their exit. This return code is 0 (zero) when the command was successful, something else when not. You can simply check this return code after each command and do something (write an error message, exit the script, ....) if it isn't 0. There is a special variable "$?" for this, but you can use an "if"-statement as well (i suggest you try it out with a few commands). First the command version, then the same within an if-statement:

Code:
# ls /etc/hosts ; echo $?
/etc/hosts
0

# ls /some/file/which/doesnot/exist ; echo $?
/some/file/which/doesnot/exist not found
2

Code:
if <some command> ; then
     echo "this command returned 0."
else
     echo "this command returned non-zero."
fi

This will make your script look like this, with a possible outcome below:

Code:
cd /some/dir/to_be_archived
for DIR in /some/dir/to_be_archived/* ; do
    fSaveDir="${DIR##*/}"
    if tar cvf /some/dir/to_be_archived/${fSaveDir}.tar ./${fSaveDir} ; then
          echo "tar-command for ${fSaveDir} successful"
    else
          echo "tar-command for ${fSaveDir} failed, aborting."
          exit 2
    fi
    if <next-command> ${fSaveDir} ; then
          echo "<next-command> for ${fSaveDir} successful"
    else
          echo "<next-command> for ${fSaveDir} failed, aborting."
          exit 3
    fi
    if
        [....]
    fi
done
tar-command for batman successful
<next-command> for batman successful
<other-command> for batman successful
[...]
tar-command for superman successful
<next-command> for superman successful
<other-command> for superman failed, aborting.

This would not only tell you what exactly worked but also where the script failed.

If you still have questions feel free to ask.

I hope this helps.

bakunin
 

10 More Discussions You Might Find Interesting

1. UNIX for Dummies Questions & Answers

Copying multiple folders to local machine (don't know folder names)

Hi. I'm trying to copy multiple folders from the remote machine to the local machine. I wrote a batch file to run an ftp window. The problem I am having is that the only command to copy files is mget *, and this copies only files, not folders. For example, ftp ts555 cd ts555/test ' test... (5 Replies)
Discussion started by: leenyburger
5 Replies

2. Shell Programming and Scripting

lvm/tar/rsync backup script feedback/criticism

I have written a shell script to perform backups using tar, rsync and optionally utilise lvm snapshots. The script is not finished but is in a working state and comments/descriptions are poor. I would greatly appreciate any criticism and suggestions of the script to help improve my own learning... (0 Replies)
Discussion started by: jelloir
0 Replies

3. Shell Programming and Scripting

Script to move files with similar names to folder

I have in directory /media/AUDIO/WAVE many .mp3 files with names like: my filename_01of02.mp3 my filename_02of02.mp3 Your File_01of06.mp3 Your File_02of06.mp3 etc.... In the same directory, /media/AUDIO/WAVE, I have many folders with names like 9780743579490 9780743579491 etc.. Inside... (7 Replies)
Discussion started by: glev2005
7 Replies

4. Shell Programming and Scripting

editing names of files in multiple folder

I have 1000's of directories which is named as numbers. Each directory contains multiple files. Each of these directories have a file named "att". I need to rename all the att files by adding the directory name followed by "_" then att for each of the directories. Directories 120 att... (2 Replies)
Discussion started by: Lucky Ali
2 Replies

5. Shell Programming and Scripting

tar command to explore multiple layers of tar and tar.gz files

Hi all, I have a tar file and inside that tar file is a folder with additional tar.gz files. What I want to do is look inside the first tar file and then find the second tar file I'm looking for, look inside that tar.gz file to find a certain directory. I'm encountering issues by trying to... (1 Reply)
Discussion started by: bashnewbee
1 Replies

6. UNIX for Dummies Questions & Answers

Do I need to extract the entire tar file to confirm the tar folder is fine?

I would like to confirm my file.tar is been tar-ed correctly before I remove them. But I have very limited disc space to untar it. Can I just do the listing instead of actual extract it? Can I say confirm folder integrity if the listing is sucessful without problem? tar tvf file1.tar ... (1 Reply)
Discussion started by: vivien_chu
1 Replies

7. Shell Programming and Scripting

Script to move one folder to multiple folder...

Hi All, I have to requirement to write a shell script to move file from one folder (A) to another five folder (B,C,D,E,F) and destination folder should be blank. In not blank just skip. This script will run as a scheduler every 2 minutes. It will check number of files in folder A and move 1 to... (9 Replies)
Discussion started by: peekuabc
9 Replies

8. Shell Programming and Scripting

Bash script for printing folder names and their sizes

Good day, everyone! I'm very new to bash scripting. Our teacher gave us a task to create a script that basically does the same job the 'du' command does, with the difference that 'du' command gives an output in the form of <size> <folder name>and what we need is <folder name> <size>As for... (1 Reply)
Discussion started by: UncleIS
1 Replies

9. Homework & Coursework Questions

Bash script for printing folder names and their sizes

1. The problem statement, all variables and given/known data: The task is to create a script that would reproduce the output of 'du' command, but in a different way: what 'du' does is: <size> <folder name>and what is needed is <folder name> <size>We need to show only 10 folders which are the... (3 Replies)
Discussion started by: UncleIS
3 Replies

10. Shell Programming and Scripting

Checking Multiple File existance in a UNIX folder(Note: File names are all different)

HI Guys, I have some 8 files with different name and extensions. I need to check if they are present in a specific folder or not and also want that script to show me which all are not present. I can write if condition for each file but from a developer perspective , i feel that is not a good... (3 Replies)
Discussion started by: shankarpanda003
3 Replies
All times are GMT -4. The time now is 05:35 PM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy