04-15-2010
Creating DELTA file in UNIX
I have a fixed length file (854 characters file).
Our project will start getting this file soon. On the first day this file will have 100000 records. From the next day the file will have all the records from previous day + some new records (there will be few additions + few changes in day1 file records).
Now from day 2 onwards we want to create delta file from the incoming file. This means we only want records which are changed or are totally new.
We can keep the first day file as shadow file and day 2 onward we can perform a daily activity which compares records in day2 file with day1 file and only additions/modifications are written into new file.
Could someone please suggest how to achieve this in UNIX?
10 More Discussions You Might Find Interesting
1. Shell Programming and Scripting
Hi All,
My requirement is create an unix script to parse the xml file and display the values of the Elements/value between the tags on console. Like say, I would like to fetch the value of errorCode from the below xml which is 'U007' and display it. Can we use SED command for this? I have tried... (10 Replies)
Discussion started by: Anil.Wmg
10 Replies
2. OS X (Apple)
I've seen the executable open in the application OmniOutliner, can I create an executable with this app? I'd like to be able to create the unix executable and insert it into terminal, but I'm not sure if the Omni app will allow me to create it.
Any one have any ideas or possibly familiar with... (10 Replies)
Discussion started by: unimachead
10 Replies
3. UNIX for Dummies Questions & Answers
Hi,
I am a beginner in scripting...I have to do a script where I have to read a file which has list of job names, line by line and for every line execute a dsjob command to find the log details of the job and extract only the start time of the job, if it is greater than jan 01 2008 and create... (1 Reply)
Discussion started by: Vijay81
1 Replies
4. Shell Programming and Scripting
I am new in shell scripting. currently i am using cygwin. My problem is
i created a profile file in my own folder. file name is first.profile in which i gave following values to variable
export a=10
now i am executing this profile file by below command
./.first.profile
it executed... (4 Replies)
Discussion started by: pratikjain998
4 Replies
5. Shell Programming and Scripting
first i created a profile file(my_var.profile) which contains
export my_var=20
after that i created shell scripts(my_var.sh) which contains
#!/bin/bash
. ./my_var.profile
echo '$my_var='$my_var
but when i am executing sh my_var.sh it is showing error that no such file/directory .profile.... (6 Replies)
Discussion started by: pratikjain998
6 Replies
6. Shell Programming and Scripting
Hello,
I need to compare two flat files (ASCII format), say file OLD and file NEW. Both have similar structure. These files are | delimitted files and have around few million of records (lines) each. Each file has same set columns and same set of key columns (i.e. the 3rd and 5th column of the... (7 Replies)
Discussion started by: manubatham20
7 Replies
7. UNIX for Dummies Questions & Answers
I have a flat file that contains dynamic list of variables like
a=1
b=2
c=3
.
..
z=26
I need to convert the above into a csv file having the format below:
a,b,c,..,z
1,2,3,..,26
Please note, I do not want a comma separating the last variable.
I tried to refer the post... (4 Replies)
Discussion started by: vkumbhakarna
4 Replies
8. Shell Programming and Scripting
Hi All,
I have two xml files.
One is having below input
<NameValuePair>
<name>Daemon</name>
<value>tcp:7474</value>
</NameValuePair>
<NameValuePair>
<name>Network</name>
<value></value>
</NameValuePair>
... (2 Replies)
Discussion started by: sharsour
2 Replies
9. Shell Programming and Scripting
Thanks of your suggestions i was able to calculate the delta between some numbers in a column file with .
awk 'BEGIN{last=0}{delta=$1-last; last=$1; print $0" "delta}'
the file was like
499849120.00
500201312.00
500352416.00
500402784.00
500150944.00
499849120.00
500150944.00... (3 Replies)
Discussion started by: Board27
3 Replies
10. UNIX for Beginners Questions & Answers
Delete
---- Original post, restored by mod after being deleted by abhilashnair ----
I have a requirement where, I need to create a control file which will have 3 columns in the header row as below:
Filename
Count
Checksum
This above control file has to contain metadata as above... (2 Replies)
Discussion started by: abhilashnair
2 Replies
LEARN ABOUT DEBIAN
blockdiag
BLOCKDIAG(1) General Commands Manual BLOCKDIAG(1)
NAME
blockdiag - generate block-diagram image file from spec-text file.
SYNOPSIS
blockdiag [options] file
DESCRIPTION
This manual page documents briefly the blockdiag commands.
blockdiag is a program that generate block-diagram image file from spec-text file.
OPTIONS
These programs follow the usual GNU command line syntax, with long options starting with two dashes (`-'). A summary of options is
included below. For a complete description, see the SEE ALSO.
--version
show program's version number and exit
-h, --help
Show summary of options
-a, --antialias
Pass diagram image to anti-alias filter
-c FILE, --config=FILE
read configurations from FILE
-o FILE
write diagram to FILE
-f FONT, --font=FONT
use FONT to draw diagram
--fontmap=FONT
use FONTMAP file to draw diagram
-s, --separate
Separate diagram images for each group
-T TYPE
Output diagram as TYPE format
--nodoctype
Do not output doctype definition tags (SVG only)
--no-transparency
do not make transparent background of diagram (PNG only)
SEE ALSO
The programs are documented fully by
http://tk0miya.bitbucket.org/blockdiag/build/html/index.html
AUTHOR
blockdiag was written by Takeshi Komiya <i.tkomiya@gmail.com>
This manual page was written by Kouhei Maeda <mkouhei@palmtb.net>, for the Debian project (and may be used by others).
May 9, 2011 BLOCKDIAG(1)