Login or Register to Ask a Question and Join Our Community

Sponsored Content
Full Discussion: Q: Howto compare 2 files
Top Forums UNIX for Dummies Questions & Answers Q: Howto compare 2 files Post 302696295 by methyl on Tuesday 4th of September 2012 04:26:33 PM
Old 09-04-2012
I like the [awk approach, but bear in mind that it will need the files in the same sorted order too.

The diff is really a non-starter (even with the file sorted) because the output from diff includes the context of the difference.


Assuming:
Database1 = The local database on Computer1 over which you have some control.
Database2 = The rremote database on Computer2 over which you have little control.

The DBA's approach would be to:
1) Extract only the field needed from Database2 to a flat file.
2) Copy the extract file from Computer2 to to Computer1.
3) Load the Database2 extract file into a temporary table in Database1 with the number field as the primary key.
4) Assuming that the same field is an Indexed field in Database1.
Use a basic SQL program to compare the two files. This would only need to "seek" the records and should be very fast.
SQL idea in Post #2 of this thread.
 

10 More Discussions You Might Find Interesting

1. UNIX for Dummies Questions & Answers

Howto Archive Including Hidden Files?

Hi I want to archive the following all the files and directory like listed below: $ ls -a . .. .bash_history .bash_logout .bash_profile .bashrc .emacs .mysql_history public_html .viminfo What I tried is to use the following command $ gtar cvzf allmyfiles.tar.gz * ... (1 Reply)
Discussion started by: monkfan
1 Replies

2. UNIX for Dummies Questions & Answers

Howto removing files with the same inode

Dear all, # ls -li total 16 2623392 drwxrwxrwx 2 root root 512 Apr 10 01:57 10HPA- 8447490 drwxr-xr-x 3 root root 512 Apr 14 05:29 118OQ- 8447490 drwxr-xr-x 3 root root 512 Apr 14 05:29 118OQ-.old 1925572 drwxrwxrwx 2 root root 512... (3 Replies)
Discussion started by: fu4d
3 Replies

3. Shell Programming and Scripting

compare files in two directories and output changed files to third directory

I have searched about 30 threads, a load of Google pages and cannot find what I am looking for. I have some of the parts but not the whole. I cannot seem to get the puzzle fit together. I have three folders, two of which contain different versions of multiple files, dist/file1.php dist/file2.php... (4 Replies)
Discussion started by: bkeep
4 Replies

4. Shell Programming and Scripting

How to compare 2 files & get only few columns based on a condition related to both files?

Hiiiii friends I have 2 files which contains huge data & few lines of it are as shown below File1: b.dat(which has 21 columns) SSR 1976 8 12 13 10 44.00 39.0700 70.7800 7.0 0 0.00 0 2.78 0.00 0.00 0 0.00 2.78 0 NULL ISC 1976 8 12 22 32 37.39 36.2942 70.7338... (6 Replies)
Discussion started by: reva
6 Replies

5. Shell Programming and Scripting

HowTo translate KSH Scripts to DOS Batch Files ?

Hi there, in near future I have to change my work surrounding from HP UNIX to Windows Vista (great to get rid of old hardware :), but bad to loose UNIX :( ). As I heavily use KSH scripts to do my job, I was wondering, if there is any HowTo available, supporting me in re-writing the scripts to... (4 Replies)
Discussion started by: Joe-K7
4 Replies

6. Shell Programming and Scripting

Compare 2 folders to find several missing files among huge amounts of files.

Hi, all: I've got two folders, say, "folder1" and "folder2". Under each, there are thousands of files. It's quite obvious that there are some files missing in each. I just would like to find them. I believe this can be done by "diff" command. However, if I change the above question a... (1 Reply)
Discussion started by: jiapei100
1 Replies

7. Shell Programming and Scripting

Require compare command to compare 4 files

I have four files, I need to compare these files together. As such i know "sdiff and comm" commands but these commands compare 2 files together. If I use sdiff command then i have to compare each file with other which will increase the codes. Please suggest if you know some commands whcih can... (6 Replies)
Discussion started by: nehashine
6 Replies

8. Shell Programming and Scripting

howto monitor a directory for files then sftp them

Morning all I hope I have put this in the correct forum. I have a requirement to monitor a directory on a server for files being sftp'ed in and then to sftp them of to another server. The issues I have though of are making sure the files have completely transferred onto the server before they... (6 Replies)
Discussion started by: ltodd2
6 Replies

9. Shell Programming and Scripting

Compare multiple files, and extract items that are common to ALL files only

I have this code awk 'NR==FNR{a=$1;next} a' file1 file2 which does what I need it to do, but for only two files. I want to make it so that I can have multiple files (for example 30) and the code will return only the items that are in every single one of those files and ignore the ones... (7 Replies)
Discussion started by: castrojc
7 Replies

10. Shell Programming and Scripting

Howto compare the columns of 2 diff tables of 2 different schemas in UNIX shell script

HI All, I am new to Unix shell scripts.. Could you please post the unix shell script for for the below request., There are two different tables(sample1, sample2) in different schemas(s_schema1, s_schema2). Unix shell script to compare the columns of two different tables of two... (2 Replies)
Discussion started by: Rajkumar Gopal
2 Replies

LEARN ABOUT DEBIAN

globus-gram-audit

GLOBUS-GRAM-AUDIT(8)						  GRAM5 Commands					      GLOBUS-GRAM-AUDIT(8)

NAME

       globus-gram-audit - Load GRAM4 and GRAM5 audit records into a database

SYNOPSIS

       globus-gram-audit [--conf CONFIG_FILE] [[--create] | [--update=OLD-VERSION]] [--check] [--delete] [--audit-directory AUDITDIR] [--quiet]

DESCRIPTION

       The globus-gram-audit program loads audit records to an SQL-based database. It reads $GLOBUS_LOCATION/etc/globus-job-manager.conf by
       default to determine the audit directory and then uploads all files in that directory that contain valid audit records to the database
       configured by the globus_gram_job_manager_auditing_setup_scripts package. If the upload completes successfully, the audit files will be
       removed.

       The full set of command-line options to globus-gram-audit consist of:

       --conf CONFIG_FILE
			       Use CONFIG_FILE instead of the default from the
			       configuration file for audit database
			       configuration.
       --check
			       Check whether the insertion of a record was
			       successful by querying the database after
			       inserting the records. This is used in tests.
       --delete 	       Delete audit records from the database right
			       after inserting them. This is used in tests to
			       avoid filling the databse with test records.
       --audit-directory DIR   Look for audit records in DIR, instead of looking
			       in the directory specified in the job manager
			       configuration. This is used in tests to control
			       which records are loaded to the database and then
			       deleted.
       --query SQL	       Perform the given SQL query on the audit
			       database. This uses the database information from
			       the configuration file to determine how to
			       contact the database.
       --quiet		       Reduce the amount of output for common
			       operations.

FILES

       The globus-gram-audit uses the following files (paths relative to $GLOBUS_LOCATION.

       etc/globus-gram-job-manager.conf
					  GRAM5 job manager configuration. It includes the
					  default path to the audit directory
       etc/globus-gram-audit.conf
					  Audit configuration. It includes the information
					  needed to contact the audit database.

University of Chicago						    08/30/2011						      GLOBUS-GRAM-AUDIT(8)
All times are GMT -4. The time now is 01:08 PM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy