Search Results

Yes, I have considered that. I'm trying to figure out how to upload large files into sql. I was desperate that is why I tried your code and the other codes suggested here. But, yes the performance...

jsmithstl;

Thank you for all your help. I tried your code, it seems to work. It has been running for more than 10 hours already. However, the columns are not preserved like this.

23 tab...

I had made a mistake.

Now your code is running, BUT the output is just the column numbers for file2 repeated thousands of times (probably 1411 times) It does not fetch the information underneath...

This much memory:

31284140

But, I tried running that code and gave me this: Out of memory!

jsmithstl;

#!/usr/bin/perl

use strict;

my @a_column;
my $outline;
my $line;
my $key;

open COLFILE, "<column.lst"
or die "can't open file: $!";

while(<COLFILE>)
{
chomp($_);...

Hi,

I have 2 files

File 1:


1 2 3 4 5 6 .......etc until column 300K
1 23 21 24 12 22
1 23 21 24 12 22
1 23 21 24 12 22
1 23 21 24 12 22
1 23 21 24 12 22
1 23 21 24 12 22
1 23 21 24...

thegeek;

It works. Thank you. Now, I'm trying to use grep to fetch only the columns from file 1 (now that has a column no. header) with the column numbers listed in file2:


file="file2"
while...

Hi;

I've been searching posts to find a solution to what I'm trying to do, but I've have NOT found anything yet.

I have a file (file1) with 300K columns and 1411 rows, the columns don't have a...

mark54g and apsprabhu;

You were very helpful. THANK YOU!. This code works:

file="file1.txt"
while read line
do
grep $line file2 >> file3
done < $file

mark54g:
Could it be that grep is limited to certain line numbers. When I had close to 1/2 million columns I did not have a problem. BUT, now that I have that many rows, grep does not seem to...

thegeek (https://www.unix.com/members/302060163.html);

Thank you for trying to help me, but grep -f file1 file2 > file3
DOES NOT WORK.


---------- Post updated 09-25-09 at 03:56 PM ----------...

-F does not work only either.

Hi :)

I have 2 files

file1:

SNP_A-2208459
SNP_A-4215188
SNP_A-2012248
SNP_A-1882998


file2:

CHR SNP UNADJ BONF HOLM * * * etc.
19 ...

I already tried that grep code and did not work either. I don't know if it is because of the file extension of file2.ped (ped is text file that can handle millions of columns)

---------- Post...

Both files have no headings

input of file1.txt (has one 1 column, as shown below):

MXY2344
MXY2455
.
.
.
.
.
.
.
MXY9150 <--- row #364



input of file2.ped (this file has more...

Both files have no headings

input of file 1 (has one 1 column, as shown below):

MXY2344
MXY2455
.
.
.
.
.
.
.
MXY9150 <--- row #364



input of file 2 (this file has 2,498,588...

I used this:

grep -A1 -A1 -f file1.txt file2 > file3

but it is taking forever and I don't know if it is going to be correct at the end
I don't know what -A1 -A1 mean (I'm assuming that is col1...

Hello,

I have a 1.6 GB file that I would like to modify by matching some ids in col1 with the ids in col 1 of file2.txt and save the results into a 3rd file.

For example:

File 1 has 1411...

Hi

I have two files, one is 1.6 GB. I would like to add one extra column of information to the large file at a specific location (after its 2nd column).

For example:

File 1 has two columns...

Hi

I have two files, one is 1.6 GB. I would like to add one extra column of information to the large file at a specific location. After its 2nd column.

For example:

File 1 has two columns...

Hi

I have two files, one is 1.6 GB, I would like to add one extra column of information to the large file at a specific location. After the 3rd column.

For example:

File 1 has two columns...