Login or Register to Ask a Question and Join Our Community


Shell Programming and Scripting

How to extract information a file according key id in another file?

Login to Discuss or Reply to this Discussion in Our Community

 
Thread Tools Search this Thread
Top Forums Shell Programming and Scripting How to extract information a file according key id in another file?
# 1  
Old 08-18-2014
How to extract information a file according key id in another file?
hi, i have a large file containing the detailed information of a bunch of keys like this:

Code:
JAT_0001  contig102_342_3_n2 contig102_342  atgcacgacta  30 50  20 taaaatcgaggaagtaaatttctaatttttgtaatagtctaatttatatattgtcatatgtaaggacttcactaccttcctgtgaaatttcgagtctagggatgtatgctgaacagatctggccaaactagccactggcttctccttgcgcggattgtgaaatcgtcatccgatttttgattggaagtatccgactgttctaatgacggcgagaccccaggaggccgctgaactcgattcaacagatggacgaccaacgg  E-06  sljfd   difelsels  20  40

JAT_0002  singlet48_2_n2 singlet48  atgdfslfefeta  300 506  20 taaaatcgaggaagtaaatttctaatttttgtaataggccaaactagccactggcttctccttgcgcggattgtgaaatcgtcatccgatttttgattggaagtatccgactgttctaatgacggcgagaccccaggaggccgctgaactcgattcaacagatggacgaccaacgg  E-09  s3ewret   gjghg  40  100

JAT_0003  contig1_34_n2 contig1_34  atgcasfdgfgdcgacta  56 992  15 gtaatagtctaatttatatattgtcatatgtaaggacttcactaccttcctgtgaaatttcgagtctagggatctgttctaatgacggcgagaccccaggtcatccgatttttgattggaagtatccgacggtaaaatcgaggaagtaaatttctaattttttaaaatcgaggaaaggccgctgaactcgattcaacagatggacgaccaagtatgctgaacagatctggccaaactagccactggcttctccttgcgcggattgtgaaatcggtaaatttctaattttt  E-06  sljfdfdfdfdsf   difelsels  565  74

.....

And i have a B file containing the key ids with interests, like
Code:
JAT_0001
JAT_0003
JAT_0100
...

How could i get a file containing only the detailed information of the key ids in B file?

Thaks a lot!!
# 2  
Old 08-18-2014
What have you tried?

How large is the key file?

A fast answer with a very slow way with a large key file:

Code:
grep -f keyfile bigfile  | cut -f 2- >> resultfile

# 3  
Old 08-18-2014
Hi, jim.
Thanks for your response. However, when i tried your code, the resultfile is exactly same as the bigfile.

There are about 4500 keys in the key file.
I haven't tried other methods because i'm really new to linux.


Quote:
Originally Posted by jim mcnamara
What have you tried?

How large is the key file?

A fast answer with a very slow way with a large key file:

Code:
grep -f keyfile bigfile  | cut -f 2- >> resultfile

# 4  
Old 08-18-2014
try this with awk:

Code:
awk 'NR==FNR{a[$1];next}$1 in a{for(i=2;i<=NF;i++){printf "%s ", $i};printf "\n"}' keyfile bigfile

# 5  
Old 08-18-2014
Hi, protocomm,

Thanks, however, I didn't get anything using your code.


Quote:
Originally Posted by protocomm
try this with awk:

Code:
awk 'NR==FNR{a[$1];next}$1 in a{for(i=2;i<=NF;i++){printf "%s ", $i};printf "\n"}' keyfile bigfile

# 6  
Old 08-18-2014
Quote:
Originally Posted by the_simpsons
Hi, protocomm,

Thanks, however, I didn't get anything using your code.
if you want to try this on a Solaris/SunOS system, change awk to
Code:
/usr/xpg4/bin/awk

,
Code:
/usr/xpg6/bin/awk

, or
Code:
nawk

.
# 7  
Old 08-18-2014
I'm using a mac. It probably is not the awk problem.

Quote:
Originally Posted by protocomm
if you want to try this on a Solaris/SunOS system, change awk to
Code:
/usr/xpg4/bin/awk

,
Code:
/usr/xpg6/bin/awk

, or
Code:
nawk

.
Login or Register to Ask a Question

Previous Thread | Next Thread

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Extract information from file

In a particular directory, there can be 1000 files like below. filename is job901.ksh #!/bin/ksh cront -x << EOJ submit file=$PRODPATH/scripts/genReport.sh maxdelay=30 &node=xnode01 tname=job901 &pfile1=/prod/mldata/data/test1.dat ... (17 Replies)
Discussion started by: vedanta
17 Replies

2. Shell Programming and Scripting

Extract information from file

Gents, If is possible please help. I have a big file (example attached) which contends exactly same value in column, but from column 2 to 6 these values are diff. I will like to compile for all records all columns like the example attached in .csv format (output.rar ).. The last column in the... (11 Replies)
Discussion started by: jiam912
11 Replies

3. Shell Programming and Scripting

Extract information from txt file

Hello! I need help :) I have a file like this: AA BC FG RF TT GH DD FF HH (a few number of rows and three columns) and I want to put the letters of each column in a variable step by step in order to give them as input in another script. So I would like to obtain: for the 1° loop:... (11 Replies)
Discussion started by: edekP
11 Replies

4. Shell Programming and Scripting

How to extract information from a file?

Hi, i have a file like this: <Iteration> <Iteration_iter-num>3</Iteration_iter-num> <Iteration_query-ID>lcl|3_0</Iteration_query-ID> <Iteration_query-def>G383C4U01EQA0A length=197</Iteration_query-def> <Iteration_query-len>197</Iteration_query-len> ... (9 Replies)
Discussion started by: the_simpsons
9 Replies

5. Shell Programming and Scripting

Extract various information from a log file

Hye ShamRock If you can help me with this difficult task for me then it will save my day Logs : ================================================================================================================== ... (4 Replies)
Discussion started by: SilvesterJ
4 Replies

6. Shell Programming and Scripting

extract information from a log file (last days)

I'm still new to bash script , I have a log file and I want to extract the items within the last 5 days . and also within the last 10 hours the log file is like this : it has 14000 items started from march 2002 to january 2003 awk '{print $4}' < *.log |uniq -c|sort -g|tail -10 but... (14 Replies)
Discussion started by: matarsak
14 Replies

7. Shell Programming and Scripting

Create shell script to extract unique information from one file to a new file.

Hi to all, I got this content/pattern from file http.log.20110808.gz mail1 httpd: Account Notice: close igchung@abc.com 2011/8/7 7:37:36 0:00:03 0 0 1 mail1 httpd: Account Information: login sastria9@abc.com proxy sid=gFp4DLm5HnU mail1 httpd: Account Notice: close sastria9@abc.com... (16 Replies)
Discussion started by: Mr_47
16 Replies

8. Shell Programming and Scripting

Extract information from Log file formatted

Good evening! Trying to make a shell script to parse log file and show only required information. log file has 44 fields and alot of lines, each columns separated by ":". log file is like: first_1:3:4:5:6:1:3:4:5:something:notinterested second_2:3:4:3:4:2 first_1:3:4:6:6:7:8 I am interested... (3 Replies)
Discussion started by: dummie55
3 Replies

9. Shell Programming and Scripting

extract and format information from a file

Hi, Following is sample portion of the file; <JDBCConnectionPool DriverName="oracle.jdbc.OracleDriver" MaxCapacity="10" Name="MyApp_DevPool" PasswordEncrypted="{3DES}7tXFH69Xg1c=" Properties="user=MYAPP_ADMIN" ShrinkingEnabled="false" ... (12 Replies)
Discussion started by: sujoy101
12 Replies

10. Shell Programming and Scripting

How to extract a piece of information from a huge file

Hello All, I need some assistance to extract a piece of information from a huge file. The file is like this one : database information ccccccccccccccccc ccccccccccccccccc ccccccccccccccccc ccccccccccccccccc os information cccccccccccccccccc cccccccccccccccccc... (2 Replies)
Discussion started by: Marcor
2 Replies
Login or Register to Ask a Question