Login or Register to Ask a Question and Join Our Community

Sponsored Content
Full Discussion: data integrity check needed
Top Forums Shell Programming and Scripting data integrity check needed Post 302690941 by methyl on Thursday 23rd of August 2012 03:54:28 PM
Old 08-23-2012
The idea here is to ensure that we get lists of files in exactly the same order, find out the checksum for each file, then compare the two lists. We do the compare on the source computer in case we need to generate a list of files to re-copy.
It is important that we sort the output from find because they will never be the same order after this sort of copy.

This assumes that you have copied the files and need to check that the files are identical.

Code:
# Source computer
cd /source_dir
>/tmp/cksum_source
find . -type f -print | sort | while read filename
do
        cksum "${filename}" >> /tmp/cksum_source
done

# Destination computer
>/tmp/cksum_destination
cd /destination_dir
find . -type f -print | sort | while read filename
do
        cksum "${filename}" >> /tmp/cksum_destination
done


Then copy the destination checksum to the source computer.

cksum /tmp/cksum_source /tmp/cksum_destination
If the two checksums are identical we don't even need to run a diff.

Footnote: I would strongly advise that any file copy method you use preserves the file permissions and timestamps and preserves directory permissions. This can be more difficult than it sounds unless you ensure that the account UID's and GIDs match on both computers. It is impossible to preserve the directory timestamps.
Last edited by methyl; 08-23-2012 at 04:59 PM..
This User Gave Thanks to methyl For This Post:
hk_kamozalwar
 

8 More Discussions You Might Find Interesting

1. Solaris

File Integrity Check

Hi, I have two NFS shares mounted on a solaris system. share1 and share2 , both are from different NFS servers share1 has 500GB of data share 2 is empty. I am copying all the data from share1 to share2. It is like migrating the data from one NFS share to another. Is there... (8 Replies)
Discussion started by: athreyavc
8 Replies

2. Shell Programming and Scripting

Help Needed in arrangind data!

Dear All, Please view the below mentioned text and help me in arranging data in format like DATE TIME Value (2nd-Feild) e.g. 20-JUN-209 00:25:38 69.00 ........... ........... ........... ........... and so on till the file end. 20-JUN-2009 00:25:38, 195.20, ... (10 Replies)
Discussion started by: jojo123
10 Replies

3. Shell Programming and Scripting

Help needed with Sort and uniq data

Hi All, After Sorting directories and files i have got following output as below, now i only want the strings common in them, so the actual output should be as below in the bottom. How do i do that? Thanks -adsi File to be modified:- Common Components for ----> AA... (4 Replies)
Discussion started by: asirohi
4 Replies

4. Shell Programming and Scripting

Help needed to stick on variable data to an output

Hi all, I need help now to stick the value inside $RHAT_PRODUCT and display that in every line in the output. What changes in the code can i do. Please suggest Thanks Adsi #!/bin/sh ECHO=/bin/echo FIND=/bin/find AWK=/bin/awk LS=/bin/ls GREP=/bin/grep ... (1 Reply)
Discussion started by: asirohi
1 Replies

5. Shell Programming and Scripting

Help needed to sort data

Hello All, Today i have been asking lots of question, hope to become good in scripting soon with all the wonderful advices i get. The question is i want to sort data a get uniq string from it. The code i am using to generate the output is:- check_sun() { for i in $SUN_PLATFORM do $ECHO... (0 Replies)
Discussion started by: asirohi
0 Replies

6. UNIX for Advanced & Expert Users

AIX idea needed to check the logs updated date and time

Hi with the help of Gabriel canepa, i have just edited filename only in his code. The help which i got and he helped is 1) I have around 22 logs and each log should be updated in the last 24 hours from the current timestamp. 2) It should check for ERROR message (not error,Error) in the log and... (2 Replies)
Discussion started by: Kalaihari
2 Replies

7. UNIX for Dummies Questions & Answers

Integrity check for the backup

Hello I thought of different ways of integrity check for the backup and look for the fastest approach to start programming. in all these approaches randomness is used. I would appreciate if someone give more suggestions or correct me. 1- Machine Name Check We can check if the machines were... (5 Replies)
Discussion started by: frhling
5 Replies

8. Shell Programming and Scripting

What's the best way to check file permissions before moving files if needed?

Hello, I would like to know if it's a good practice to check the file permissions of the contents of a directory before moving them. For example: mv -- "$directory"/* "$directory"/.* "$directory"/..?* "$destination"The variables $directory and $destination contain the path to an existing... (6 Replies)
Discussion started by: Cacializ
6 Replies

LEARN ABOUT DEBIAN

qssign

QSSIGN(1)							  qssign man page							 QSSIGN(1)

NAME

       qssign - Utility to sign and verify the integrity of log data.

SYNOPSIS

       qssign -s|S <secret> [-e] [-v]

DESCRIPTION

       qssign is a log data integrity check tool. It reads log data from stdin (pipe) and writes the signed data to stdout.

OPTIONS

       -s <secret>
	      Passphrase used to calculate signature.

       -S <program>
	      Specifies a program which writes the passphrase to stdout.

       -e     Writes end marker when stopping data signing.

       -v     Verification mode checking the integrity of signed data.

EXAMPLE

       Sign:

	TransferLog "|./bin/qssign -s password -e |./bin/qsrotate -o /var/log/apache/access_log"

       Verify:

	cat access_log | qssign -s password -v

SEE ALSO

       qsexec(1), qsfilter2(1), qsgeo(1), qsgrep(1), qslog(1), qslogger(1), qspng(1), qsrotate(1), qstail(1)

AUTHOR

       Pascal Buchbinder, http://opensource.adnovum.ch/mod_qos/

mod_qos utilities 10.8						     June 2012								 QSSIGN(1)
All times are GMT -4. The time now is 06:40 PM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy