06-30-2009
Match col 1 of File 1 with col 1 File 2 and create a 3rd file
Hello,
I have a 1.6 GB file that I would like to modify by matching some ids in col1 with the ids in col 1 of file2.txt and save the results into a 3rd file.
For example:
File 1 has 1411 rows, I ignore how many columns it has (thousands)
File 2 has 311 rows, 1 column
Would like to create
File 3 with 311 rows (thousands of columns)
What is the fastest way to do this without consuming too much memory?
Thank you!
10 More Discussions You Might Find Interesting
1. Shell Programming and Scripting
Hi
I have an file which looks like
country address phone amount
sweden |address |phone | 10 |
Singapo |address |phone | 20 |
Italy-N |address |phone | 30 |
denmar |address |phone | 40 |
Here i need to do the sum(amount), how to do this in shell scripting
Thanks
Babu (11 Replies)
Discussion started by: ksmbabu
11 Replies
2. Shell Programming and Scripting
Dear All,
I am a newbie to shell scripting so this one is really over my head.
I have a text file with five fields as below:
76576.867188 6232.454102 2.008904 55.000000 3
76576.867188 6232.454102 3.607231 55.000000 4
76576.867188 6232.454102 1.555146 65.000000 3
76576.867188 6232.454102... (19 Replies)
Discussion started by: Ghetz
19 Replies
3. Shell Programming and Scripting
Hi,
I have two different files, one has two columns and other has only one column. I would like to compare the first column in the first file with the data in the second file and write a third file with the data that is not present is not common to them.
First file:... (26 Replies)
Discussion started by: swame_sp
26 Replies
4. Shell Programming and Scripting
Hi,
My first file has
592155 9 rs16916098 1
592156 19 rs7249604 1
592157 4 rs885156 1
592158 5 rs350067 12nd file has
9 rs16916098 0 113228129 2 4
19 rs7249604 0 58709070 4 2
2 rs17042833 0 113558750 4 2... (2 Replies)
Discussion started by: genehunter
2 Replies
5. Shell Programming and Scripting
Hi, Experts,
I have a requirement as following:
my source file:
a
a
a
b
b
c
c
c
c
I need add one more colume as following:
1 a
2 a
3 a
1 b
2 b
1 c
2 c (4 Replies)
Discussion started by: ken002
4 Replies
6. UNIX for Advanced & Expert Users
Hello everyone,
I am writing a script to process data from the ATP world tour.
I have a file which contains:
t=540 y=2011 r=1 p=N409
t=540 y=2011 r=2 p=N409
t=540 y=2011 r=3 p=N409
t=540 y=2011 r=4 p=N409
t=520 y=2011 r=1 p=N409
t=520 y=2011 r=2 p=N409
t=520 y=2011 r=3 p=N409
The... (4 Replies)
Discussion started by: imahmoud
4 Replies
7. Shell Programming and Scripting
Hello,
I have some tab delimited data and I need to move the last col. I could hard code it,
awk '{ print $1,$NF,$2,$3,$4,etc }' infile > outfile
but it would be nice to know the syntax to print a range cols.
I know in cut you can do,
cut -f 1,4-8,11-
to print fields 1,... (8 Replies)
Discussion started by: LMHmedchem
8 Replies
8. Shell Programming and Scripting
Hi Friends,
This is the only solution to my task. So, any help is highly appreciated.
I have a file
cat input1.bed
chr1 100 200 abc
chr1 120 300 def
chr1 145 226 ghi
chr2 567 600 unix
Now, I have another file by name
input2.bed (This file is a binary file not readable by the... (7 Replies)
Discussion started by: jacobs.smith
7 Replies
9. Shell Programming and Scripting
Hi,
Please help with this.
I have several excel files (with and .xlsx format) with 10-15 columns each.
They all have the same type of data but the columns are not ordered in the same way.
Here is a 3 column example. What I want to do add the alphabet
from column 2 to column 3, provided... (9 Replies)
Discussion started by: newbie83
9 Replies
10. Shell Programming and Scripting
hello,
i have a undelimited file which contains 229 byte records. i want to change column 23 - 26 with a new value and also change the sign of the data in colulmn 30 - 70. i've tried SED for the first change, but nothing happens:
sed 's/\(^.\{22\}\).\{4\}\(.*\)/\0603\2/' inputfile
heres an... (8 Replies)
Discussion started by: blt123
8 Replies
pfscut(1) General Commands Manual pfscut(1)
NAME
pfscut - Extract a rectangle out of a frame in PFS stream
SYNOPSIS
pfscut [--left <columns>] [--right <columns>] [--top <rows>] [--bottom <rows>] [--width <new_width>] [--height <new_height>] [--help] [x_ul
y_ul x_br y_br]
DESCRIPTION
Extract a rectangle out of each frame in PFS stream. You can either specify x and y coordinates of upper left and lower right corner (the
coordinates start with 0 and rise in the left-to-right and up-to-botton directions) or give a combination of the options listed below.
OPTIONS
--left <columns>, -l <columns>
Number of columns to be cut out from the left edge of an image.
--right <columns>, -r <columns>
Number of columns to be cut out from the right edge of an image.
--top <rows>, -t <rows>
Number of rows to be cut out from the top edge of an image.
--bottom <rows>, -b <rows>
Number of rows to be cut out from the bottom edge of an image.
--width <new_width>, -W <new_width>
Width of an output image. Note that --width can be mixed with either --left or --right option.
--height <new_height>, -H <new_height>
Height of an output image. Note that --height can be mixed with either --top or --bottom option.
--help, -h
Print a list of commandline options.
EXAMPLES
pfsin image.hdr | pfscut --left 20 --top 5 | pfsout out.hdr
Cut out 20 columns from the left and 5 rows from the top edge of image.hdr and save frame as out.hdr.
pfsin image.hdr | pfscut --left 20 --width 400 | pfsout out.hdr
Cut out 20 columns from the left edge of image.hdr, and create output image 400 pixels in width.
pfsin image.hdr | pfscut 0 0 511 511 | pfsout out.hdr
Cut left-upper part of the image of the size 512x512 (note that coordinates start with 0 and 512 is the last row/column that is
included in the resulting image).
SEE ALSO
pfsin(1) pfsout(1)
BUGS
Please report bugs and comments to Dorota Zdrojewska <dzdrojewska@wi.ps.pl>.
pfscut(1)