06-25-2010
So - I set this running, though its been 24 hours and its still running - is that normal for such a large file?
Edit: to check if this was working, I ran it with a smaller file but my outfile is 0kb big - which indicates nothing has worked... what could I be doing wrong???
10 More Discussions You Might Find Interesting
1. Shell Programming and Scripting
Hi,
I have a small requirement in chainging the rows to columns. The below example.txt contains info as shown
Name:Person1
Age:30
Name:Person2
Age:40
Name:Person3
Age:50
I want to make it displayed as hown below
Name:Person1 Age:30
Name:person2 Age:40
Name:Person3 Age:50
I... (4 Replies)
Discussion started by: oracle123
4 Replies
2. Shell Programming and Scripting
Friends,
I have text file with 700,000 rows.
Once I load this file to our database via our cutom process, it logs the row number for rejected rows.
How do I delete rows from a Large text file based on the Row Number?
Thanks,
Prashant (8 Replies)
Discussion started by: ppat7046
8 Replies
3. Shell Programming and Scripting
Hi I have an input file and I want to transpose it but I need to take care that if any field is missing for a record it should be popoulated with space for that field - using a shell script
INFILE
----------
emp=1
sal=2
loc=abc
emp=2
sal=21
sal=22
loc=xyz
emp=5
loc=abc
OUTFILE... (10 Replies)
Discussion started by: 46019
10 Replies
4. Shell Programming and Scripting
Hi Guys,
I need help in modifying a large text file containing more than 1-2 lakh rows of data using unix commands. I am quite new to the unix language
the text file contains data in a pipe delimited format
sdfsdfs
sdfsdfsd
START_ROW
sdfsd|sdfsdfsd|sdfsdfasdf|sdfsadf|sdfasdf... (9 Replies)
Discussion started by: manish2009
9 Replies
5. UNIX for Dummies Questions & Answers
Hi,
I have a data file that contains 61 columns. I want to delete all the columns except columns, 3,6 and 8. The columns are tab de-limited. How would I achieve this on the terminal?
Thanks (2 Replies)
Discussion started by: lost.identity
2 Replies
6. Shell Programming and Scripting
Hello,
I have a huge tab delimited file with around 40,000 columns and 900 rows I want to convert columns to a row.
INPUT file look like this.
the first line is a headed of a file.
ID marker1 marker2 marker3 marker4
b1 A G A C ... (5 Replies)
Discussion started by: ryan9011
5 Replies
7. Shell Programming and Scripting
Hi, I have a large file with number of records in there. I need some help to find only first row based on a key and ignore other rows with the same key. I tried few things but file is huge(30 million rows). So need some solution that is very efficient.
e.g
Junk|Apple|7|Random|data|here...... (2 Replies)
Discussion started by: ran123
2 Replies
8. Shell Programming and Scripting
Hi Friends,
I have come across some files where some of the columns don not have data.
Key, Data1,Data2,Data3,Data4,Data5
A,5,6,,10,,
A,3,4,,3,,
B,1,,4,5,,
B,2,,3,4,,
If we see the above data on Data5 column do not have any row got filled. So remove only that column(Here Data5) and... (4 Replies)
Discussion started by: ks_reddy
4 Replies
9. UNIX for Dummies Questions & Answers
Hi everyone. I have a file with ~500 columns and I would like to perform a simple calculation on every two columns. The file looks like this:
$cat input
id A B C D E F.....X
1 2 4 2 3 4 1 n
2 4 6 4 6 4 5 n
3 4 7 5 2 2 3 n
4 ... (5 Replies)
Discussion started by: torchij
5 Replies
10. UNIX for Dummies Questions & Answers
Dear all,
I want to extract around 300 columns from a very large file with almost 2million columns. There are no headers, but I can find out which column numbers I want. I know I can extract with the function 'cut -f2' for example just the second column but how do I do this for such a large... (1 Reply)
Discussion started by: fndijk
1 Replies
LEARN ABOUT DEBIAN
bup-bloom
bup-bloom(1) General Commands Manual bup-bloom(1)
NAME
bup-bloom - generates, regenerates, updates bloom filters
SYNOPSIS
bup bloom [-d dir] [-o outfile] [-k hashes] [-c idxfile] [-f] [--ruin]
DESCRIPTION
bup bloom builds a bloom filter file for a bup repository. If one already exists, it checks the filter and updates or regenerates it as
needed.
OPTIONS
--ruin destroy bloom filters by setting the whole bitmask to zeros. you really want to know what you are doing if run this and you want to
delete the resulting bloom when you are done with it.
-f, --force
don't update the existing bloom file; generate a new one from scratch.
-d, --dir=directory
the directory, containing .idx files, to process. Defaults to $BUP_DIR/objects/pack
-o, --outfile=outfile
the file to write the bloom filter to. defaults to $dir/bup.bloom
-k, --hashes=hashes
number of hash functions to use only 4 and 5 are valid. defaults to 5 for repositories < 2 TiB, or 4 otherwise. See comments in
git.py for more on this value.
-c, --check=idxfile
checks the bloom file (counterintuitively outfile) against the specified the .idx. Does not write anything and ignores the -k
option.
BUP
Part of the bup(1) suite.
AUTHORS
Brandon Low <lostlogic@lostlogicx.com>.
Bup unknown- bup-bloom(1)