09-04-2012
I like the [awk approach, but bear in mind that it will need the files in the same sorted order too.
The diff is really a non-starter (even with the file sorted) because the output from diff includes the context of the difference.
Assuming:
Database1 = The local database on Computer1 over which you have some control.
Database2 = The rremote database on Computer2 over which you have little control.
The DBA's approach would be to:
1) Extract only the field needed from Database2 to a flat file.
2) Copy the extract file from Computer2 to to Computer1.
3) Load the Database2 extract file into a temporary table in Database1 with the number field as the primary key.
4) Assuming that the same field is an Indexed field in Database1.
Use a basic SQL program to compare the two files. This would only need to "seek" the records and should be very fast.
SQL idea in Post #2 of this thread.
10 More Discussions You Might Find Interesting
1. UNIX for Dummies Questions & Answers
Hi
I want to archive the following all the files and directory like listed below:
$ ls -a
. .. .bash_history .bash_logout .bash_profile .bashrc .emacs .mysql_history public_html .viminfo
What I tried is to use the following command
$ gtar cvzf allmyfiles.tar.gz *
... (1 Reply)
Discussion started by: monkfan
1 Replies
2. UNIX for Dummies Questions & Answers
Dear all,
# ls -li
total 16
2623392 drwxrwxrwx 2 root root 512 Apr 10 01:57 10HPA-
8447490 drwxr-xr-x 3 root root 512 Apr 14 05:29 118OQ-
8447490 drwxr-xr-x 3 root root 512 Apr 14 05:29 118OQ-.old
1925572 drwxrwxrwx 2 root root 512... (3 Replies)
Discussion started by: fu4d
3 Replies
3. Shell Programming and Scripting
I have searched about 30 threads, a load of Google pages and cannot find what I am looking for. I have some of the parts but not the whole. I cannot seem to get the puzzle fit together.
I have three folders, two of which contain different versions of multiple files, dist/file1.php dist/file2.php... (4 Replies)
Discussion started by: bkeep
4 Replies
4. Shell Programming and Scripting
Hiiiii friends
I have 2 files which contains huge data & few lines of it are as shown below
File1: b.dat(which has 21 columns)
SSR 1976 8 12 13 10 44.00 39.0700 70.7800 7.0 0 0.00 0 2.78 0.00 0.00 0 0.00 2.78 0 NULL
ISC 1976 8 12 22 32 37.39 36.2942 70.7338... (6 Replies)
Discussion started by: reva
6 Replies
5. Shell Programming and Scripting
Hi there,
in near future I have to change my work surrounding from HP UNIX to Windows Vista (great to get rid of old hardware :), but bad to loose UNIX :( ). As I heavily use KSH scripts to do my job, I was wondering, if there is any HowTo available, supporting me in re-writing the scripts to... (4 Replies)
Discussion started by: Joe-K7
4 Replies
6. Shell Programming and Scripting
Hi, all:
I've got two folders, say, "folder1" and "folder2".
Under each, there are thousands of files.
It's quite obvious that there are some files missing in each. I just would like to find them. I believe this can be done by "diff" command.
However, if I change the above question a... (1 Reply)
Discussion started by: jiapei100
1 Replies
7. Shell Programming and Scripting
I have four files, I need to compare these files together.
As such i know "sdiff and comm" commands but these commands compare 2 files together. If I use sdiff command then i have to compare each file with other which will increase the codes.
Please suggest if you know some commands whcih can... (6 Replies)
Discussion started by: nehashine
6 Replies
8. Shell Programming and Scripting
Morning all
I hope I have put this in the correct forum.
I have a requirement to monitor a directory on a server for files being sftp'ed in and then to sftp them of to another server. The issues I have though of are making sure the files have completely transferred onto the server before they... (6 Replies)
Discussion started by: ltodd2
6 Replies
9. Shell Programming and Scripting
I have this code
awk 'NR==FNR{a=$1;next} a' file1 file2
which does what I need it to do, but for only two files. I want to make it so that I can have multiple files (for example 30) and the code will return only the items that are in every single one of those files and ignore the ones... (7 Replies)
Discussion started by: castrojc
7 Replies
10. Shell Programming and Scripting
HI All,
I am new to Unix shell scripts..
Could you please post the unix shell script for for the below request.,
There are two different tables(sample1, sample2) in different schemas(s_schema1, s_schema2).
Unix shell script to compare the columns of two different tables of two... (2 Replies)
Discussion started by: Rajkumar Gopal
2 Replies
LEARN ABOUT DEBIAN
mysql-schema-diff
MYSQLDIFF(1p) User Contributed Perl Documentation MYSQLDIFF(1p)
NAME
mysql-schema-diff - compare MySQL database schemas
SYNOPSIS
mysql-schema-diff [B<options>] B<database1> B<database2>
mysql-schema-diff --help
DESCRIPTION
mysql-schema-diff is a Perl script front-end to the CPAN <http://www.perl.com/CPAN> module MySQL::Diff
<http://search.cpan.org/search?module=MySQL::Diff> which compares the data structures (i.e. schema / table definitions) of two MySQL
<http://www.mysql.com/> databases, and returns the differences as a sequence of MySQL commands suitable for piping into mysql which will
transform the structure of the first database to be identical to that of the second (c.f. diff and patch).
Database structures can be compared whether they are files containing table definitions or existing databases, local or remote.
N.B. The program makes no attempt to compare any of the data which may be stored in the databases. It is purely for comparing the table
definitions. I have no plans to implement data comparison; it is a complex problem and I have no need of such functionality anyway.
However there is another program coldiff <http://rossbeyer.net/software/mysql_coldiff/> which does this, and is based on an older program
called datadiff which seems to have vanished off the 'net.
For PostgreSQL there are similar tools such as pgdiff <http://pgdiff.sourceforge.net/> and apgdiff <http://apgdiff.startnet.biz/>.
EXAMPLES
# compare table definitions in two files
mysql-schema-diff db1.mysql db2.mysql
# compare table definitions in a file 'db1.mysql' with a database 'db2'
mysql-schema-diff db1.mysql db2
# interactively upgrade schema of database 'db1' to be like the
# schema described in the file 'db2.mysql'
mysql-schema-diff -A db1 db2.mysql
# compare table definitions in two databases on a remote machine
mysql-schema-diff --host=remote.host.com --user=myaccount db1 db2
# compare table definitions in a local database 'foo' with a
# database 'bar' on a remote machine, when a file foo already
# exists in the current directory
mysql-schema-diff --host2=remote.host.com --password=secret db:foo bar
OPTIONS
More details to come; for now run "mysql-schema-diff --help".
INTERNALS
For both of the database structures being compared, the following happens:
o If the argument is a valid filename, the file is used to create a temporary database which "mysqldump -d" is run on to obtain the table
definitions in canonicalised form. The temporary database is then dropped. (The temporary database is named
"test_mysqldiff_temp_something" because default MySQL permissions allow anyone to create databases beginning with the prefix "test_".)
o If the argument is a database, "mysqldump -d" is run directly on it.
o Where authentication is required, the hostname, username, and password given by the corresponding options are used (type
"mysql-schema-diff --help" for more information).
o Each set of table definitions is now parsed into tables, and fields and index keys within those tables; these are compared, and the
differences outputted in the form of MySQL statements.
BUGS, DEVELOPMENT, CONTRIBUTING
See <http://software.adamspiers.org/wiki/mysqldiff>.
COPYRIGHT AND LICENSE
Copyright (c) 2000-2011 Adam Spiers. All rights reserved. This program is free software; you can redistribute it and/or modify it under the
same terms as Perl itself.
SEE ALSO
MySQL::Diff, MySQL::Diff::Database, MySQL::Diff::Table, MySQL::Diff::Utils, mysql, mysqldump, mysqlshow
AUTHOR
Adam Spiers <mysqldiff@adamspiers.org>
perl v5.14.2 2012-04-06 MYSQLDIFF(1p)