Sponsored Content
Top Forums Shell Programming and Scripting Making a script to copy files not seen before (using md5sum) Post 302850371 by nbsparks on Wednesday 4th of September 2013 02:18:26 PM
Old 09-04-2013
OK... I spoke too soon...

Bummer. My testing routine was not specific enough. And shortly after I posted my "it's all fixed" message, I realized it was probably not.

The "photos-backup" folder is supposed to house the "DCIM" folder from the phone, which in turn has subfolders (i.e. 100MEDIA, 101MEDIA, etc.).

So I put the "set-x" back in the script:
Code:
#!/bin/bash
set -x

# The username variable passed by command line to this script
USER=$1

# The source directory where the photo folder on the phone is mirrored to
SRC=/hd1/home/$USER/.phonesync/photos-backup

# The destination directory where we want to copy only new photos we have copied before
DST=/hd1/home/$USER/.phonesync/photos-new

# The MD5 list file that tracks which files we have copied before
MD5=/hd1/home/$USER/.phonesync/photos-backup.md5

# Check files against the MD5 list and then copy if not previously copied
# Then add the md5 for that file to the MD5 list
cd $SRC
for f in *
do
  FMD5=$(md5sum $f)
  grep -q $FMD5 $MD5
  if [[ $? -ne 0 ]]; then
    cp $f $DST
    md5sum $f >> $MD5
  fi
done

# In case this script gets run as root, redo the file ownership so users can access their photos
chown -R $USER:$USER $DST

And ran it... and here is the output.

Code:
nick@server ~/.phonesync$ ./photos-new.sh nick
+ USER=nick
+ SRC=/hd1/home/nick/.phonesync/photos-backup
+ DST=/hd1/home/nick/.phonesync/photos-new
+ MD5=/hd1/home/nick/.phonesync/photos-backup.md5
+ cd /hd1/home/nick/.phonesync/photos-backup
+ for f in '*'
++ md5sum DCIM
md5sum: DCIM: Is a directory
+ FMD5=
+ grep -q /hd1/home/nick/.phonesync/photos-backup.md5
^C

Had to CTRL+C to stop the script.

The folder structure of photos-backup is...

Code:
nick@server ~/.phonesync$ ls * -a -R -l
-rw-r--r-- 1 nick nick   46 Sep  4 10:42 photos-backup.md5
-rwxr-xr-x 1 nick nick  841 Sep  4 11:11 photos-new.sh

photos-backup:
total 12
drwxr-xr-x 3 nick nick 4096 Sep  4 11:15 .
drwxr-xr-x 4 nick nick 4096 Sep  4 10:42 ..
drwxr-xr-x 3 nick nick 4096 Sep  4 11:09 DCIM

photos-backup/DCIM:
total 12
drwxr-xr-x 3 nick nick 4096 Sep  4 11:09 .
drwxr-xr-x 3 nick nick 4096 Sep  4 11:15 ..
drwxr-xr-x 2 nick nick 4096 Sep  4 11:10 100MEDIA

photos-backup/DCIM/100MEDIA:
total 4080
drwxr-xr-x 2 nick nick    4096 Sep  4 11:10 .
drwxr-xr-x 3 nick nick    4096 Sep  4 11:09 ..
-rw-r--r-- 1 nick nick 1243984 Jun 28  2012 IMAG0001.jpg
-rw-r--r-- 1 nick nick 1551828 Jun 28  2012 IMAG0002.jpg
-rw-r--r-- 1 nick nick 1369884 Jun 28  2012 IMAG0003.jpg

photos-new:
total 8
drwxr-xr-x 2 nick nick 4096 Sep  4 11:15 .
drwxr-xr-x 4 nick nick 4096 Sep  4 10:42 ..

So how do I modify this script for it to carry out the copies for all subfolders of "photos-backup"?
 

10 More Discussions You Might Find Interesting

1. Solaris

making copy of 0 level dump via ufsdump

Hi how do u make "copy" of o level dump taken via ufsdumo in solaris? To elaborate, imagine you have taken a 0 level dump via the following command ufsdump 0ulf /dev/rmt/1n / and then again execute the same command to take a second 0 level dump Now take an incremental dump ufsdump 1ulf... (2 Replies)
Discussion started by: vishalsngh
2 Replies

2. Shell Programming and Scripting

Running md5sum on a list of files

Hello, I would like to run md5sum on a list of files saved in a text file, and save the result in another file. (ie. md5sum `cat list.txt` > md5list.txt) I have tried several things, but I am always confronted to the same problem: some of the filenames have spaces. I have run sed on the... (5 Replies)
Discussion started by: SDelroen
5 Replies

3. UNIX for Dummies Questions & Answers

Making a copy of an Magneto Optical Disk

We are trying to make duplicates of some Magneto Optical Disks that were created in Irix 6.5. The disks are 2.3 gig and the using a scsi MOD drive. Is there possbily a disk copy like in dos or some simple script to do this - any help appreciated. Thanks (0 Replies)
Discussion started by: drew_holm
0 Replies

4. Shell Programming and Scripting

Making script show command (e.g. copy) being executed and variable substitution?

When script is running you only see when some of the commands are not successfull. Is there a way to see which command are executed and to show the substitution of variables as every line is executed ? (3 Replies)
Discussion started by: gr0124
3 Replies

5. Shell Programming and Scripting

Script to check MD5SUM on file

Hi, I currently have a shell script that takes an RPM and scp's it to a set of remote servers and installs it. What I would like to be able to do is make the script get the md5sum of the RPM locally (so get the md5sum of the rpm from where im running the script) and then scp the rpm to the... (0 Replies)
Discussion started by: tb1986
0 Replies

6. Shell Programming and Scripting

PHP Script Help - Making links to files Clickable

Ok so I wrote a php script that outputs the below to users on a webpage. # Download: /home/content/d/i/v/divine1234/eBookDownloads/ScalpRemedy_jablaa12734.zip the php code that outputs the above is: echo ("<li>Download: $download_link</li>\n"); The thing is, I dont want... (1 Reply)
Discussion started by: SkySmart
1 Replies

7. Shell Programming and Scripting

Md5sum script

Hello, I need to download multiple files from an FTP server but occasionally they arrive in error so I need to perform an integrity check. I've been attempting to write a bash script that does the following: Downloads all files including those in sub directories Perform md5sum using... (4 Replies)
Discussion started by: shadyuk
4 Replies

8. Shell Programming and Scripting

Compare files in directories with md5sum

And not to start. I can compare files, that's easy. The problem is that I compare files in a directory, and check if these files exist in another directory. The problem is that the file names are not the same. So I have to compare with "md5sum" or something similar. How I can do? All this in... (7 Replies)
Discussion started by: Jomeaide
7 Replies

9. Shell Programming and Scripting

Need script for making files based on some conditions.

Hi All, I have a text file (code_data.txt) with the followig data. AMAR AB123456 XYZ KIRAN CB789 ABC RAJ CS78890 XYZ KAMESH A33535335 ABC KUMAR MD678894 MAT RITESH SR3535355... (26 Replies)
Discussion started by: ROCK_PLSQL
26 Replies

10. Shell Programming and Scripting

[md5sum] script

I am getting No such file or directory if my variable contains white spaces... Is there a way to fix this? This works x="1.md5" md5sum -c "$x" This, does not x="23\ 5\ 6\ 7\ 8\ 9\ 10.md5" md5sum -c "$x" md5sum: '23\ 5\ 6\ 7\ 8\ 9\ 10.md5': No such file or directory How do I fix... (1 Reply)
Discussion started by: soichiro
1 Replies
irc(n)							    Low Level Tcl IRC Interface 						    irc(n)

NAME
irc - Create IRC connection and interface. SYNOPSIS
package require Tcl package require irc ?0.2? ::irc::connection hostname ::irc::config key value net registerevent event script net connect net user username localhostname userinfo net nick nick net ping net join channel net part channel net privmsg target message net send text who ?address? action target ?index? msg DESCRIPTION
This package provides low-level commands to deal with the IRC protocol (Internet Relay Chat) for immediate and interactive multi-cast com- munication. ::irc::connection hostname The command creates a new object to deal with an IRC connection. Creating this IRC object does not automatically create the network connection. It returns a new irc namespace command which can be used to interact with the new IRC connection. ::irc::config key value Sets configuration key to value. Currently, the only config key defined is the boolean flag debug which, when turned on, makes irc print more information about what is going on. Per-connection Commands In the following list of available connection methods net represents a connection command as returned by ::irc::connection. net registerevent event script Registers a callback handler for the specific event. Events available are those described in the IRC RFC: 1459. In addition, there are several other events defined. defaultcommand adds a command that is called if no other callback is present. EOF is called if the connection signals an End of File condition. script is executed in the connection namespace, which can take advantage of sev- eral commands (see Callback Commands below) to aid in the parsing of data. net connect This causes the socket to be established. ::irc::connection created the namespace and the commands to be used, but did not actually open the socket. This is done here. net user username localhostname userinfo Sends USER command to server. username is the username you want to appear. localhostname is the name of your server, and userinfo is a short description of who you are. net nick nick NICK command. nick is the nickname you wish to use for the particular connection. net ping PING the IRC server. net join channel channel is the IRC channel to join. IRC channels typically begin with a hashmark ("#"). net part channel Makes the client leave channel. net privmsg target message Sends message to target, which can be either a channel, or another user, in which case their nick is used. net send text Sends text to the IRC server. Callback Commands These commands can be used within callbacks who ?address? Returns the nick of the user who performed a command. The optional address keyword causes the command to return the user in the format "username@address". action Returns the action perfomed, such as KICK, PRIVMSG, MODE, etc... Normally not useful, as callbacks are bound to a particular event. target ?index? Returns the target of a particular command, such as the channel or user to whom a PRIVMSG is sent. In the case of multiple targets, the optional index argument may be used to specify which one to return. The default is 0. msg Returns the message portion of the command (the part after the :). SEE ALSO
rfc 1459 KEYWORDS
irc, chat irc 0.2 irc(n)
All times are GMT -4. The time now is 02:07 PM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy