02-11-2013
Both awk and sed can read the next line or additional lines into the buffer so you can evaluate if you want to preserve the linfeed between those lines. I once wrote a sed to take whole pages and turn them into lines by reversing the new line and form feed. Then another sed could turn the pages into insert statements. Finally, I turned the form feeds back into new lines, so the displayed page from the db would be correct. The DB allowed 32k char().
10 More Discussions You Might Find Interesting
1. Shell Programming and Scripting
Is there any way to remove carriage retuns between the records?
These carriage returns are created in an excel cell by using Alt+enter, this is similar to new line...
We have input records separated by TABS and have carriage returns as below:
123 456 789 ABC "1952.00" 678 "abcdef
ghik... (5 Replies)
Discussion started by: acheepi
5 Replies
2. UNIX for Dummies Questions & Answers
Hi,
I have learned some of the Unix commands a way back and not sure of how to code them when needed in certain way, especially sed command. Here is my situation. I have an xml file with several tags. most of the tags start on the same line and end on the same line. However, data for some tags... (8 Replies)
Discussion started by: girish312
8 Replies
3. UNIX for Dummies Questions & Answers
i want to delete the line which is not started with numeric in vim.
vim temp.txt
Volume in drive D is DATA
Volume Serial Number is 8C52-2055
Directory of D:\data\notes
02/16/2010 03:09 PM <DIR> .
02/16/2010 03:09 PM <DIR> ..
09/11/1999 03:03 AM ... (5 Replies)
Discussion started by: Manabhanjan
5 Replies
4. Shell Programming and Scripting
Hello Friends,
Input File looks as follows:
>FASTA Header1
line1
line2
line3
linen
>FASTA Header2
Line1
Line2
linen
>FASTA Header3
and so on
.......
Output:
Want something as:
>FASTA Header1
line1line2line3linen
>FASTA Header2 (5 Replies)
Discussion started by: Deep9000
5 Replies
5. Shell Programming and Scripting
Hi,
I have input file contains sql queries i need to eliminate newlines from it.
when i open it vi text editor and runs
:%s/'\n/'/g
it provides required result. but when i run sed command from shell prompt it doesn't impact outfile is still same as inputfile.
shell] sed -e... (6 Replies)
Discussion started by: mirfan
6 Replies
6. Shell Programming and Scripting
I have
a='123, abc, def, ghi'
var1=`echo $a | awk -F", " '{print RS $1}'`
echo "something: $var1"
which outputs
something
123
how can I tell awk not to put a newline between fields? I want it to output:
something: 123 (4 Replies)
Discussion started by: unclecameron
4 Replies
7. Shell Programming and Scripting
input:
donkey
monkey
dance
drink
output should be:
donkey
monkey (8 Replies)
Discussion started by: cola
8 Replies
8. UNIX for Dummies Questions & Answers
Hello all. I am a beginner UNIX user who is using UNIX to work on a bioinformatics project for my university.
I have a bit of a complicated issue in trying to use sed (or awk) to "find and replace" bases (letters) in a genetics data spreadsheet (converted to a text file, can be either... (3 Replies)
Discussion started by: Mince
3 Replies
9. Shell Programming and Scripting
I was trying to simplify this from what I'm actually doing, but I started getting even more confused so I gave up. Here is the content of my input file:
Academic year,Term,Course name,Period,Last name,Nickname
2012-2013,First Semester,English 12,7th Period,Davis,Lucille
When I do this:
... (3 Replies)
Discussion started by: nextyoyoma
3 Replies
10. UNIX for Dummies Questions & Answers
I want to create a header with awk like this:
gawk 'BEGIN {print "List of Events"}
Desired output:
List of Events
Tennis
Baseball
But I am at a loss on how to do this. I can make a list like this:
List of Events
Tennis
Baseball
But I can't get a space to appear. I have... (4 Replies)
Discussion started by: newbie2010
4 Replies
LEARN ABOUT DEBIAN
bup-margin
bup-margin(1) General Commands Manual bup-margin(1)
NAME
bup-margin - figure out your deduplication safety margin
SYNOPSIS
bup margin [options...]
DESCRIPTION
bup margin iterates through all objects in your bup repository, calculating the largest number of prefix bits shared between any two
entries. This number, n, identifies the longest subset of SHA-1 you could use and still encounter a collision between your object ids.
For example, one system that was tested had a collection of 11 million objects (70 GB), and bup margin returned 45. That means a 46-bit
hash would be sufficient to avoid all collisions among that set of objects; each object in that repository could be uniquely identified by
its first 46 bits.
The number of bits needed seems to increase by about 1 or 2 for every doubling of the number of objects. Since SHA-1 hashes have 160 bits,
that leaves 115 bits of margin. Of course, because SHA-1 hashes are essentially random, it's theoretically possible to use many more bits
with far fewer objects.
If you're paranoid about the possibility of SHA-1 collisions, you can monitor your repository by running bup margin occasionally to see if
you're getting dangerously close to 160 bits.
OPTIONS
--predict
Guess the offset into each index file where a particular object will appear, and report the maximum deviation of the correct answer
from the guess. This is potentially useful for tuning an interpolation search algorithm.
--ignore-midx
don't use .midx files, use only .idx files. This is only really useful when used with --predict.
EXAMPLE
$ bup margin
Reading indexes: 100.00% (1612581/1612581), done.
40
40 matching prefix bits
1.94 bits per doubling
120 bits (61.86 doublings) remaining
4.19338e+18 times larger is possible
Everyone on earth could have 625878182 data sets
like yours, all in one repository, and we would
expect 1 object collision.
$ bup margin --predict
PackIdxList: using 1 index.
Reading indexes: 100.00% (1612581/1612581), done.
915 of 1612581 (0.057%)
SEE ALSO
bup-midx(1), bup-save(1)
BUP
Part of the bup(1) suite.
AUTHORS
Avery Pennarun <apenwarr@gmail.com>.
Bup unknown- bup-margin(1)