03-03-2011
@vgresh99 .... how do i modify urs to get the info from file1 as it is .. even if column 1 from file 1 does not exist in file2 ...thx
10 More Discussions You Might Find Interesting
1. Shell Programming and Scripting
Hi Guys,
I wonder whether is possible to merge two files using awk. I have two files one with 7 columns and another one with 9 columns and the first column on both files is identical so will be my key to merge the files. Any ideas.Thanks in advance.
Harby. (2 Replies)
Discussion started by: hariza
2 Replies
2. Shell Programming and Scripting
hi,
i am facing a problem in merging two files using awk,
the problem is as stated below,
file1:
A|B|C|D|E|F|G|H|I|1
M|N|O|P|Q|R|S|T|U|2
AA|BB|CC|DD|EE|FF|GG|HH|II|1
....
....
....
file2 :
1|Mn|op|qr (2 Replies)
Discussion started by: shashi1982
2 Replies
3. Shell Programming and Scripting
Hi, guys. I have one question:
I have two files: passwd and shadow (the number of records in these files are not equal)the contents of them are below:
passwd:
**************
ftp:x:24:24:
sshd:x:71:65:
uucp:x:10:14:
brownj:x:5005:1000:
sherrys: x :5006:1000:
...
*************
... (2 Replies)
Discussion started by: daikeyang
2 Replies
4. Shell Programming and Scripting
Hello,
I'm new to awk. I've 2 files where H stands for header and T for trailer. The number following T gives the record count in a file.
file 1 looks like this:
H|A|B|C
1|2|3
1|2|4
2|3|5
T|3
file 2 looks like this:
H|A|B|C
4|5|6
7|8|9
T|2
Need to merge the above 2 files such... (2 Replies)
Discussion started by: skumre
2 Replies
5. Shell Programming and Scripting
I have 2 files pipe delimted and want to merge them based on a key
e.g file 1
123$aaa$yyy$zzz
345$xab$yzy$zyz
456$sss$ttt$foo
799$aaa$ggg$dee
file 2
123$hhh
345$ddd
456$xxx
888$zzz
so if the key is the first field, and the result should be the common key between file 1 and 2 (6 Replies)
Discussion started by: loloAix
6 Replies
6. Shell Programming and Scripting
I have two file like follows. I want to merge them according the first field of file1. The separator of file1 is tab, while the second one is ",". I tried some code, but can't get the results.
File1:
AABB 6072 28 5922
BBCC 316 147 162
CCDD 907 71 231
File2:
CCDD,hTRBV12-4,hTRBJ2-3,319895... (7 Replies)
Discussion started by: xshang
7 Replies
7. Shell Programming and Scripting
Dear Awk experts!
I have been trying to get a one liner for a match and merge operation, but having difficulties as I'm an awk newb. I always get stuck on the match and merge with 2 files.
I have 2 files as follows:
File 1:
field 1,field 2,field 3,field 4,field 5,field 6,field 7,field... (6 Replies)
Discussion started by: landossa
6 Replies
8. Shell Programming and Scripting
file1
AAA3:WWW1:DDD1:XXX8:DDD2:XXX9
AAA6:WWW2:FFF1:XXX130:FFF1:XXX104:FFF1:XXX16
AAA7:WWW3:ZZZ1:XXX4:ZZZ2:XXX5:ZZZ3:XXX6:ZZZ4:XXX7file2
XXX8:EEE1:EEE2
XXX9:KKK1:KKK2
XXX130:OOO1:OOO2
XXX104:PPP1:PPP2
XXX16:RRR1:RRR1
XXX4:UUU1:UUU2
XXX5:III1:III2
XXX7:JJJ1:JJJ2Result... (2 Replies)
Discussion started by: vikus
2 Replies
9. Shell Programming and Scripting
Hi,
i have two files like these:
FILE 1
00:0f:35:1b:0c:00 1402691094.750049000 00:0f:35:1b:0c:00 1402691087.474893000
44:d3:ca:fd:a2:08 1402691091.865127000
30:e4:db:c1:df:de 1402691090.192464000
FILE 2_
00:0F:35 Cisco Systems, Inc
30:E4:DB Cisco Systems, Inc
I need a file 3, that... (5 Replies)
Discussion started by: bertiko
5 Replies
10. Shell Programming and Scripting
I have two csv files : say a.csv, b.csv
a.csv looks like this :
property1,property2,100
property3,property4,200
In a.csv, the combination of column1 and column2 will be unique
b.csv looks like this
property1,property2, 300, t1
property1,property2, 400,t2
property3, property4,800,t1... (2 Replies)
Discussion started by: Lakshmikumari
2 Replies
LEARN ABOUT DEBIAN
bup-margin
bup-margin(1) General Commands Manual bup-margin(1)
NAME
bup-margin - figure out your deduplication safety margin
SYNOPSIS
bup margin [options...]
DESCRIPTION
bup margin iterates through all objects in your bup repository, calculating the largest number of prefix bits shared between any two
entries. This number, n, identifies the longest subset of SHA-1 you could use and still encounter a collision between your object ids.
For example, one system that was tested had a collection of 11 million objects (70 GB), and bup margin returned 45. That means a 46-bit
hash would be sufficient to avoid all collisions among that set of objects; each object in that repository could be uniquely identified by
its first 46 bits.
The number of bits needed seems to increase by about 1 or 2 for every doubling of the number of objects. Since SHA-1 hashes have 160 bits,
that leaves 115 bits of margin. Of course, because SHA-1 hashes are essentially random, it's theoretically possible to use many more bits
with far fewer objects.
If you're paranoid about the possibility of SHA-1 collisions, you can monitor your repository by running bup margin occasionally to see if
you're getting dangerously close to 160 bits.
OPTIONS
--predict
Guess the offset into each index file where a particular object will appear, and report the maximum deviation of the correct answer
from the guess. This is potentially useful for tuning an interpolation search algorithm.
--ignore-midx
don't use .midx files, use only .idx files. This is only really useful when used with --predict.
EXAMPLE
$ bup margin
Reading indexes: 100.00% (1612581/1612581), done.
40
40 matching prefix bits
1.94 bits per doubling
120 bits (61.86 doublings) remaining
4.19338e+18 times larger is possible
Everyone on earth could have 625878182 data sets
like yours, all in one repository, and we would
expect 1 object collision.
$ bup margin --predict
PackIdxList: using 1 index.
Reading indexes: 100.00% (1612581/1612581), done.
915 of 1612581 (0.057%)
SEE ALSO
bup-midx(1), bup-save(1)
BUP
Part of the bup(1) suite.
AUTHORS
Avery Pennarun <apenwarr@gmail.com>.
Bup unknown- bup-margin(1)