06-10-2010
Solution for the Massive Comparison Operation
Hi
We have 50 million records in mainframes DB2. We have a requirement to Record the Change Data Capture(CDC) records.
i.e New Records or Updated Records that were added into the DB2.
Unfortunately we dont have any column indicators to give the details of the changes made to the records.
So we decided to import the same into flat files into UNIX box everyday and then compare the previous day's file and get the changed rows using UNIX text processing functionalities.
The problem is everyday huge data changes happen approx 40 million
So can anyone give me a solution for better handling of the same or even the hardware requirement for UNIX Server for faster processing of the huge data comparison.
Thanks
5 More Discussions You Might Find Interesting
1. Shell Programming and Scripting
- I am looking for different kind of awk solution which I don't think is mentioned before in these forums.
Number of rows in the file are fixed
Their are two columns in file1.txt
1 1
2 2
3 3
4 4
5 5
6 6
7 7
8 8
9 9
10 10
I am looking for 3... (1 Reply)
Discussion started by: softwarekids23
1 Replies
2. Shell Programming and Scripting
I have a txt file with several columns and i want to peform an operation on two columns and output it to a new txt file .
file.txt
900.00000 1 1 1
500.00000
500.00000
100000.000
4
4
1.45257346E-07 899.10834 ... (4 Replies)
Discussion started by: shashi792
4 Replies
3. Homework & Coursework Questions
Hi all! I need help to do a few things with a .txt file using egrep.
1. I need to list all sequences where the vowel letters 'a, e, i, o, u' occur in that order, possibly separated by characters other than a, e, i, o, u; consisting of one or more complete words, possibly including punctuation.
... (1 Reply)
Discussion started by: dindiqotu
1 Replies
4. Shell Programming and Scripting
I have a script that I am using to copy around 40-70k files to a NFS NAS.
I have posted my code below in hopes that someone can help me figure out a faster way of achieving this.
At the end of the script i need to have all the files in the list, copied over to the nas with source directory... (8 Replies)
Discussion started by: nitrobass24
8 Replies
5. Shell Programming and Scripting
friends
good morning
FTP works perfect but I have a doubt
if I want to transport 10 files, I imagine that I should not open 10 connections as I can transfer more than 1 file?
ftp -n <<!EOF
open caburga
user ephfact ephfact
cd /users/efactura/docONE/entrada
bin
mput EPH`date... (16 Replies)
Discussion started by: tricampeon81
16 Replies
answer(1) General Commands Manual answer(1)
NAME
answer - phone message transcription system
SYNOPSIS
DESCRIPTION
The interactive program helps you to transcribe telephone (and other) messages into electronic mail.
The program uses your personal alias database and the system alias database, allowing you to use aliases to address the messages.
Options
supports the following options:
Prompt for phone-slip-type message fields.
Allow addresses that are not aliases.
Operation
begins with the prompt. Enter a one-word alias or a two-word user name ("Words" are separated by spaces.) The user name is converted to
an alias in the form where f is the first character of the first word, lastword is the second word, and all letters are shifted to lower-
case. For example, is converted to the alias
Without the option, the specified or converted alias must exist in the alias databases. With the option, if the processed "alias" is not
in the alias databases, it is used for the address as is.
The fully expanded address is displayed.
With the option, you are asked for typical message slip data:
Enter the appropriate data. You can put just an or nothing after the pertinent dash prompts, or you can type longer comments. Whatever
you enter becomes part of the message. Lines with no added text are omitted from the message.
Finally, you are prompted for a message. Enter a message, if any, ending with a blank line. The message is sent and the prompt is
repeated.
To end the program, enter any one of or at the prompt.
EXAMPLES
User input is in normal type.
With No Options
This example shows a valid alias, an invalid user name, and a valid user name. In the invalid case, the converted alias is displayed in
square brackets.
With the -u Option
If you enter the previous error is treated differently.
With the -p Option
If you enter the phone-slip prompts are added. The three lines with no added text are deleted from the message.
FILES
User alias database data table
User alias database directory table
User alias database hash table
User alias source text
System alias database data table
System alias database directory table
System alias database hash table
System alias source text
Outbound mail message edit buffer
AUTHOR
was developed by HP.
SEE ALSO
elm(1), newalias(1).
answer(1)