I have a text file with hundreds of 32-character hash codes in it, each terminated with a linefeed (/l, or ^M).
...... etc.
I want to create a file for each hash code, with the .txt extension.
I ran a test shell script called test1.sh to see if I could pull out each line in the file and create a file name from it:
What I got was
How can I create these file names without the ^M?
It seems if I remove the ^M and replace it with a carriage return (/r) then the while loop won't work.
Teledon
Last edited by vbe; 12-13-2011 at 01:32 PM..
Reason: code tags
Hello everybody
I have a very annoying problem on my Solaris (Unix in general) servers. When I open a shell and press the backspace button, it results in a ^H character being printed on screen. I can resolve it by typing stty erase <backspace>, but does anyone know how I can prevent the... (3 Replies)
I have to process a data file in Ab Initio. This data file is pipe delimited. BUt the file may have a Disclaimer line at the end. So before picking it for processing, I need to check if this line is there I need to remove it. ANy suggestions.
Thanks
Shalu (1 Reply)
Hello,
I'm able to trim down the log message to "192.168.1.0.", but can't get rid off the last period.
Can any one help me on the syntax to get rid of the last period?
Basically, I want "192.168.1.0" instead of "192.168.1.0."
Thanks, (4 Replies)
ok the assignment question:
That English paper you were writing on the works of Lewis Carroll is due in a few hours and you have forgeotten the name of the text file in which you has written a number of quotations to use in your paper. Luckily, you know that the file is somewhere in your... (1 Reply)
Hi All,
Im selecting a large record from a table and putting it in a file in the unix box. The file has a hidden character "^[[D " present in it. Can any one help me in getting rid of the character
Thanks in advance, (4 Replies)
hi,
I want to get rid of ' from my variable value in ksh, and I also want to read the value on the right hand side of = into a variable
thanks (10 Replies)
Hello I am working aon script, that tells me how many users or on the system when i run it.
The script is
#!/bin/bash
w | cut -f 1 -d ' ' |sort -u | wc -l
When ran it shows 16 users including myself and a line of white space.
I was wondering what I need to add to remove my user... (2 Replies)
ex: I have list of files in a folder.
abc_def_geh_.txt
abc_.txt
abc_def_geh_12345_.txt
ab134c_d345345ef_444geh_12345_.txt
i need to rename all files to get rid of the _ before .txt
result should look like this:
abc_def_geh.txt
abc.txt
abc_def_geh_12345.txt... (2 Replies)
Hi all,
I am new to unix....pls help me with this.
I have a binary file generating output by passing arguments in bash.when i open the output file in VI i can see that ^m is included in between most of lines,as a result when i pass this file to my java application it dosent parse the data... (3 Replies)
Hi
We are doing the migration of DMX3 disks to DMX4 disks using migratepv. We are not using GPFS but we have gpfs disks present in the server. Can anyone advise how to get rid of GPFS in both the servers cbspsrdb01 and cbspsrdb02. I will do migratepv for the other disks present in the servers... (2 Replies)
Discussion started by: newtoaixos
2 Replies
LEARN ABOUT DEBIAN
bup-margin
bup-margin(1) General Commands Manual bup-margin(1)NAME
bup-margin - figure out your deduplication safety margin
SYNOPSIS
bup margin [options...]
DESCRIPTION
bup margin iterates through all objects in your bup repository, calculating the largest number of prefix bits shared between any two
entries. This number, n, identifies the longest subset of SHA-1 you could use and still encounter a collision between your object ids.
For example, one system that was tested had a collection of 11 million objects (70 GB), and bup margin returned 45. That means a 46-bit
hash would be sufficient to avoid all collisions among that set of objects; each object in that repository could be uniquely identified by
its first 46 bits.
The number of bits needed seems to increase by about 1 or 2 for every doubling of the number of objects. Since SHA-1 hashes have 160 bits,
that leaves 115 bits of margin. Of course, because SHA-1 hashes are essentially random, it's theoretically possible to use many more bits
with far fewer objects.
If you're paranoid about the possibility of SHA-1 collisions, you can monitor your repository by running bup margin occasionally to see if
you're getting dangerously close to 160 bits.
OPTIONS --predict
Guess the offset into each index file where a particular object will appear, and report the maximum deviation of the correct answer
from the guess. This is potentially useful for tuning an interpolation search algorithm.
--ignore-midx
don't use .midx files, use only .idx files. This is only really useful when used with --predict.
EXAMPLE
$ bup margin
Reading indexes: 100.00% (1612581/1612581), done.
40
40 matching prefix bits
1.94 bits per doubling
120 bits (61.86 doublings) remaining
4.19338e+18 times larger is possible
Everyone on earth could have 625878182 data sets
like yours, all in one repository, and we would
expect 1 object collision.
$ bup margin --predict
PackIdxList: using 1 index.
Reading indexes: 100.00% (1612581/1612581), done.
915 of 1612581 (0.057%)
SEE ALSO bup-midx(1), bup-save(1)BUP
Part of the bup(1) suite.
AUTHORS
Avery Pennarun <apenwarr@gmail.com>.
Bup unknown-bup-margin(1)