09-07-2011
Well, I've never dealt with data files of such sizes.
Before starting to code try to find all possible information about processing this kind of data. The best of course if you could find someone who really worked with huge matrices stored in text files.
This User Gave Thanks to yazu For This Post:
10 More Discussions You Might Find Interesting
1. Shell Programming and Scripting
Hi guys I want to print the values by using this script but its giving the no of rows and columns as input instead of values
Would you plz help me on this
FILE- chr1.txt
1981 1
1971 1
1961 1
1941 1
perl script
#!/usr/bin/perl -w
$infile1 = 'chr1.txt';
$outfile3 = 'out3.txt';
... (3 Replies)
Discussion started by: nogu0001
3 Replies
2. Shell Programming and Scripting
Hello guys,
Please help me to solve this problem. I have tried some awk commands but couldn't succeed.
I have a tab delimited file where each record is separated by ------ and 4th column of each record is same.
<INPUT FILE>
------
peon 53931587 53931821 ... (12 Replies)
Discussion started by: sam_2921
12 Replies
3. Shell Programming and Scripting
Hi
My pipe delimited .txt file contains rows with 10 columns.
Can anyone advise how I output to file only those rows with the letters ‘ci'
as the first 2 characters in the 3rd column ?
Many thanks (4 Replies)
Discussion started by: malts18
4 Replies
4. Shell Programming and Scripting
Hello,
I want to extract several columns and rows from a huge tab delimited file
for example: I want to print from from column 3 to 68 till row number 30.
I have tried using cut command but it was extracting whole 3rd and 68th column.
Please suggest a solution.
Ryan (8 Replies)
Discussion started by: ryan9011
8 Replies
5. Shell Programming and Scripting
Hi all,
I have a large matrix of 720 x 25. I want to get sum of range of rows and columns. Like, I need sum of all columns and row number 2 to 21, then leaving 22nd row, again sum of all columns and row number 23 to 42 again leaving 43rd row and then sum of 44th to 63. Means I want to add all... (4 Replies)
Discussion started by: CAch
4 Replies
6. Shell Programming and Scripting
Hi I have a matrix with n rows and m columns like below example. i want to extract all the pairs with values <200.
Input
A B C D
A 100 206 51 300
B 206 100 72 48
C 351 22 100 198
D 13 989 150 100
Output format
A,A:200
A,C:51
B,B:100... (2 Replies)
Discussion started by: anurupa777
2 Replies
7. Shell Programming and Scripting
Hi all, I'm pretty much a newbie to UNIX. I would appreciate any help with UNIX coding on comparing two large csv files (greater than 10 GB in size), and output a file with matching columns.
I want to compare file1 and file2 by 'id' and 'chain' columns, then extract exact matching rows'... (5 Replies)
Discussion started by: bkane3
5 Replies
8. Shell Programming and Scripting
Hallo,
I would need to extract only rows which has different value in the second and third column.
Thank you very much for any advices
Input:
A 0 0
B 0 1
C 1 1
D 1 3
Output
B 0 1
D 1 3 (4 Replies)
Discussion started by: kamcamonty
4 Replies
9. UNIX for Beginners Questions & Answers
I have a dateset like this:
Gly1 Gly2 2 1 0
Gly3 Gly4 3 4 5
Gly3 Gly5 1 3 2
Gly2 Gly1 3 6 2
Gly4 Gly3 2 2 1
Gly6 Gly4 4 2 1what I expected is:
Gly1 Gly2 2 1 0
Gly2 Gly1 3 6 2
Gly3 Gly4 3 4 5
Gly4 Gly3 2 2 1
A vs B, or B vs A are the same... (7 Replies)
Discussion started by: nengcheng
7 Replies
10. Shell Programming and Scripting
Hello
I have a file like this:
> cat examplefile
ghi|NN603762|eee
mno|NN607265|ttt
pqr|NN613879|yyy
stu|NN615002|uuu
jkl|NN607265|rrr
vwx|NN615002|iii
yzA|NN618555|ooo
def|NN190486|www
BCD|NN628717|ppp
abc|NN190486|qqq
EFG|NN628717|aaa
HIJ|NN628717|sss
>
I can sort the file by... (5 Replies)
Discussion started by: CHoggarth
5 Replies
LEARN ABOUT OPENSOLARIS
lookbib
lookbib(1) User Commands lookbib(1)
NAME
lookbib - find references in a bibliographic database
SYNOPSIS
lookbib database
DESCRIPTION
A bibliographic reference is a set of lines, constituting fields of bibliographic information. Each field starts on a line beginning with
a `%', followed by a key-letter, then a blank, and finally the contents of the field, which may continue until the next line starting with
`%'.
The lookbib utility uses an inverted index made by indxbib to find sets of bibliographic references. It reads keywords typed after the `>'
prompt on the terminal, and retrieves records containing all these keywords. If nothing matches, nothing is returned except another `>'
prompt.
It is possible to search multiple databases, as long as they have a common index made by indxbib(1). In that case, only the first argument
given to indxbib is specified to lookbib.
If lookbib does not find the index files (the .i[abc] files), it looks for a reference file with the same name as the argument, without the
suffixes. It creates a file with a .ig suffix, suitable for use with fgrep (see grep(1)). lookbib then uses this fgrep file to find refer-
ences. This method is simpler to use, but the .ig file is slower to use than the .i[abc] files, and does not allow the use of multiple
reference files.
FILES
x.ia
x.ib
x.ic index files
x.ig reference file
ATTRIBUTES
See attributes(5) for descriptions of the following attributes:
+-----------------------------+-----------------------------+
| ATTRIBUTE TYPE | ATTRIBUTE VALUE |
+-----------------------------+-----------------------------+
|Availability |SUNWdoc |
+-----------------------------+-----------------------------+
SEE ALSO
addbib(1), grep(1), indxbib(1), refer(1), roffbib(1), sortbib(1), attributes(5)
BUGS
Probably all dates should be indexed, since many disciplines refer to literature written in the 1800s or earlier.
SunOS 5.11 14 Sep 1992 lookbib(1)