Viewing the progress of diff?


 
Thread Tools Search this Thread
Operating Systems Linux Viewing the progress of diff?
# 1  
Old 02-04-2012
Viewing the progress of diff?

I recently made an rsync backup of a relatively large directory with a lot of subdirectories (around 30GB size in total).
Now I'm trying to see if everything went well and every file is where it should be, so I'm using the diff command (to be more specific, diff -rq /dir_source /dir_dest), but I have no idea when it will finish.

So does anyone know of any way to view the progress of this process, or otherwise any other utility which has this progress function?
I'm using GNU diffutils 3.0

Thanks in advance.
# 2  
Old 02-05-2012
You have to instrument your code as there is no progress bar or something that gives a running count of lines processed. And for what you are doing I would just use a checksum. All you want to know is: did it work okay? Not where some things differ in files, because you will just recopy to fix it.

And. Unless you got errors during copy, the probability of failure is really very low, except if you were ftp-ing from windows to Unix. You were not doing that.

Code:
#!/bin/bash
cd /path/to/oldfiles
export DEST=/path/to/newfiles
cnt=0
for fname in *
do
    old=$(cksum $fname )
    old=${old%% *}
    new=$(cksum $DEST/${fname})
    new=${new%% *}
    cnt=$(( $cnt +  1 ))
    [ $(( $cnt % 5 )) -eq 0 ] && echo "$cnt files processed"
    [ "$old" = "$new" ] && continue  
    echo "failure on file $fname"
done

# 3  
Old 02-05-2012
not sure if pv would work, but it might be worth a shot.
Login or Register to Ask a Question

Previous Thread | Next Thread

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Diff 3 files, but diff only their 2nd column

Guys i have 3 files, but i want to compare and diff only the 2nd column path=`/home/whois/doms` for i in `cat domain.tx` do whois $i| sed -n '/Registry Registrant ID:/,/Registrant Email:/p' > $path/$i.registrant whois $i| sed -n '/Registry Admin ID:/,/Admin Email:/p' > $path/$i.admin... (10 Replies)
Discussion started by: kenshinhimura
10 Replies

2. Tips and Tutorials

Viewing changes in directory

Hi, I have a directory, and there is a job running and constantly writes and removes files from and to this directory. I would like to see somehow these changes without pressing `ls` every second. Kind of `tail -f` command, but for a directory list and not for file content. I thought maybe kind... (5 Replies)
Discussion started by: ilya_dv
5 Replies

3. Shell Programming and Scripting

serach diff filename in diff location using shell scripting

Hi, I am new to shell scripting. please help me to find out the solution. I need a script where we need to read the text file(consists of all file names) and get the file names one by one and append the date suffix for each file name as 'yyyymmdd' . Then search each file if exists... (1 Reply)
Discussion started by: Lucky123
1 Replies

4. Shell Programming and Scripting

.procmailrc and uudeview (put attachments from diff senders to diff folders)

Moderator, please, delete this topic (1 Reply)
Discussion started by: optik77
1 Replies

5. Shell Programming and Scripting

Simulate SVN diff using plain diff

Hi, svn diff does not work very well with 2 local folders, so I am trying to do this diff using diff locally. since there's a bunch of meta files in an svn directory, I want to do a diff that excludes everything EXCEPT *.java files. there seems to be only an --exclude option, so I'm not sure... (3 Replies)
Discussion started by: ackbarr
3 Replies

6. Shell Programming and Scripting

Progress

Maybe someone know how to create something like "*". If someone uses Gentoo he must see this while emerge utility preparing an update. I mean the symbol "/" spins. (2 Replies)
Discussion started by: mirusnet
2 Replies

7. UNIX for Dummies Questions & Answers

Viewing files

I have a file (called CORE) that is a dump created by a crashing process. This file, I believe, is in "binary" form, so when I try to use cat, more, or vi on it, it has a bunch of garbage. Is there anything I can use to "read" or view this file just like I might a non-binary file? I am running... (2 Replies)
Discussion started by: dsimpg1
2 Replies

8. UNIX for Dummies Questions & Answers

pdf viewing

How do I view pdf files on a Solaris 9 environment? Links and such would be grateful. "AAAAHHH!! They're everywhere!!!" - Halo Grunt (3 Replies)
Discussion started by: antalexi
3 Replies

9. UNIX for Dummies Questions & Answers

viewing tables

I have completely blanked out on this and I have done it a million times. I need to modify some tables in unix. What is the command for opening/viewing the tables? Thanks so much. :o (2 Replies)
Discussion started by: itldp
2 Replies

10. Shell Programming and Scripting

diff 2 files; output diff's to 3rd file

Hello, I want to compare two files. All records in file 2 that are not in file 1 should be output to file 3. For example: file 1 123 1234 123456 file 2 123 2345 23456 file 3 should have 2345 23456 I have looked at diff, bdiff, cmp, comm, diff3 without any luck! (2 Replies)
Discussion started by: blt123
2 Replies
Login or Register to Ask a Question