04-11-2018
Hi amvip,
Your requirements are still a little bit ambiguous...
If there are one or more spaces before the 1st pipe symbol or after the last pipe symbol and there are no characters other than spaces in those fields; are those spaces supposed to be removed, are they supposed to be changed to a single zero character, or are they to be left unchanged? Of your three rules, the first two rules do not apply because the data field is not "between delimiters" and the third rule doesn't apply because there are no characters in the field other than spaces.
The code RudiC suggested in post #4 will turn leading and trailing fields containing only spaces into empty fields. Is that what you want?
10 More Discussions You Might Find Interesting
1. Shell Programming and Scripting
Hello all,
i have a problem.
please help me to remove the white spaces and tabs betweeen line.
i.e.,
file1 contains some text..
text starts_hdsffdsd
sdfsddssdds********
sdfsdsd***********
sdfsdsdfsdsdfsdsds***
****fsd_test_ends
one or 2 blank lines
(* indicates white spaces or tabs)
... (5 Replies)
Discussion started by: kumar1
5 Replies
2. Shell Programming and Scripting
Hi Everybody,
I need some help on formatting the files coming into unix box on the fly.
I get a file some thing like this in a single line.
ISA^M00^M ^M00^M ^M14^M006929681900 ^M01^M095449419 ... (5 Replies)
Discussion started by: ntekupal
5 Replies
3. UNIX for Dummies Questions & Answers
Hello all,
I am a unix dummy. I am trying to remove spaces between fields. I have the file in the following format
12332432, 2345 , asdfsdf ,100216 , 9999999
12332431, 2341 , asdfsd2 ,100213 , 9999999
&... (2 Replies)
Discussion started by: nitinbjoshi
2 Replies
4. Shell Programming and Scripting
Hi All,
I need to modify a script to remove spaces from a csv file.
The csv file is delimited by the '~' character and I need to remove the spaces which appear before this character.
i.e
Sample input:
LQ001 SWAT 11767727 ~9104 ~001 ~NIRSWA TEST 18 ~2 ~Standard Test ~0011
Desired... (5 Replies)
Discussion started by: SRyan84
5 Replies
5. Shell Programming and Scripting
Hello,
I need to replace the comma to something else between the single quote:
1aaa,bbb,'cc,cc','ddd',1
2aaa,bbb,'ccc','d,d',0
to
1aaa,bbb,'cc<comma>cc','ddd',1
2aaa,bbb,'ccc','d<comma>d',0
Can someone help? Thanks. (2 Replies)
Discussion started by: bgirl
2 Replies
6. Shell Programming and Scripting
I assume removing whitespaces in the n first characters of a string would be an easy task for sed? If so, how? (7 Replies)
Discussion started by: KidCactus
7 Replies
7. Shell Programming and Scripting
hy all,
i need case with input like this
1::||10334|11751|
2::10324|17541|||
i want output like this
1::||1033411751|
2::1032417541|||
how i can do that for get like output
thx before your advice (3 Replies)
Discussion started by: zvtral
3 Replies
8. UNIX for Dummies Questions & Answers
I have input file like this
551|552|553|554|555|556|557|558|559|560
I need any one offset need to be blank for eg.
551|552|553||555|556|557|558|559|560
My Shell is csh (1 Reply)
Discussion started by: nsuresh316
1 Replies
9. UNIX for Dummies Questions & Answers
Hi ,
I have file like this..
aaa|bbbb|cccc|dddd|fff|dsaaFFDFD|
Adsads|sas|sa|as|asa|saddas|dsasd|sdad|
dsas|dss|sss|sss|ddd|dssd|rrr|fddf|
www|fff|refd|dads|fsdf|00sd|
5fgdg|dfs00|d55f|sfds55|445fsd|55ds|sdf|
so I do no have any fix pattern and I want to remove extra... (11 Replies)
Discussion started by: pankajchaudhari
11 Replies
10. UNIX for Advanced & Expert Users
Hello All,
we have some 10 files wherein we are using the ASCII NULL as separator which is nothing but '^@' and we need to change it to pipe delimited file before loading to database. Most of the data seems to be fine but there are instances where this separator tends to appear in the middle of... (9 Replies)
Discussion started by: dJHa
9 Replies
LEARN ABOUT DEBIAN
bup-margin
bup-margin(1) General Commands Manual bup-margin(1)
NAME
bup-margin - figure out your deduplication safety margin
SYNOPSIS
bup margin [options...]
DESCRIPTION
bup margin iterates through all objects in your bup repository, calculating the largest number of prefix bits shared between any two
entries. This number, n, identifies the longest subset of SHA-1 you could use and still encounter a collision between your object ids.
For example, one system that was tested had a collection of 11 million objects (70 GB), and bup margin returned 45. That means a 46-bit
hash would be sufficient to avoid all collisions among that set of objects; each object in that repository could be uniquely identified by
its first 46 bits.
The number of bits needed seems to increase by about 1 or 2 for every doubling of the number of objects. Since SHA-1 hashes have 160 bits,
that leaves 115 bits of margin. Of course, because SHA-1 hashes are essentially random, it's theoretically possible to use many more bits
with far fewer objects.
If you're paranoid about the possibility of SHA-1 collisions, you can monitor your repository by running bup margin occasionally to see if
you're getting dangerously close to 160 bits.
OPTIONS
--predict
Guess the offset into each index file where a particular object will appear, and report the maximum deviation of the correct answer
from the guess. This is potentially useful for tuning an interpolation search algorithm.
--ignore-midx
don't use .midx files, use only .idx files. This is only really useful when used with --predict.
EXAMPLE
$ bup margin
Reading indexes: 100.00% (1612581/1612581), done.
40
40 matching prefix bits
1.94 bits per doubling
120 bits (61.86 doublings) remaining
4.19338e+18 times larger is possible
Everyone on earth could have 625878182 data sets
like yours, all in one repository, and we would
expect 1 object collision.
$ bup margin --predict
PackIdxList: using 1 index.
Reading indexes: 100.00% (1612581/1612581), done.
915 of 1612581 (0.057%)
SEE ALSO
bup-midx(1), bup-save(1)
BUP
Part of the bup(1) suite.
AUTHORS
Avery Pennarun <apenwarr@gmail.com>.
Bup unknown- bup-margin(1)