Login or Register to Ask a Question and Join Our Community


UNIX for Beginners Questions & Answers

Pattern matching using awk from a file

Login to Discuss or Reply to this Discussion in Our Community

 
Thread Tools Search this Thread
Top Forums UNIX for Beginners Questions & Answers Pattern matching using awk from a file
# 1  
Old 03-30-2020
Pattern matching using awk from a file
Hello, I have a very large file (DB_file.txt) with coordinate positions, example:


example for the DB_file.txt
Code:
chr1    1000    2000    chr1    10000    11000    3    281    0    0.459585414218248    0    0    0    1218    1    1.88650643678468    0    0    0    0.000000425582664277006    3.87833663319237    0.000000425597761316606    0.201115300038799    0.743522481235195    0.822936566866982
chr1    1000    2000    chr1    11000    12000    4    281    0    0.459585414218248    0    0    0    459    1    0.710924839477969    0    0    0    0.000000355375953311341    1.75327208538672    0.000000192399150742434    0.068194541602096    0.101318817290739    0.81707019750747
chr1    1000    2000    chr1    12000    13000    5    281    0    0.459585414218248    0    0    0    1415    1    2.19163104109222    0    0    0    0.000000310867653966458    3.44281554060217    0.000000377804900731428    0.128881860609444    0.263803805858084    0.81707019750747
chr1    1000    2000    chr1    13000    14000    1    281    0    0.459585414218248    0    0    0    437    1    0.676850010570529    0    0    0    0.000000285200375223444    1.49690344452761    0.000000164265976667856    0.335040184988013    0.776177861586765    0.837324774202159
chr1    1000    2000    chr1    14000    15000    1    281    0    0.459585414218248    0    0    0    530    1    0.820893605497437    0    0    0    0.000000271516726063383    1.60662404023105    0.000000176306406449545    0.322230259464951    0.799436461434159    0.850447555722604
chr1    1000    2000    chr1    16000    17000    1    281    0    0.459585414218248    0    0    0    490    1    0.758939371120272    0    0    0    0.000000253854147173018    1.41695624386548    0.000000155492795574155    0.343542270137564    0.75754917047966    0.828368055880824
 chr1    1000    2000   chr1    18000    19000    2    281    0    0.459585414218248    0    0    0    130    1    0.201351261725787    0    0    0    0.000000231422263301451    0.691389012939271    0.0000000758710869983566    0.119714987783608    0.152817308925748    0.81707019750747

I have a pattern file with the following:


Code:
chr1    1000    2000    chr1    10000    11000
chr1    1000    2000    chr1    11000    12000
chr1    1000    2000    chr1    12000    13000

For a single query, I am using the command:
Code:
awk '{if ($1 == "chr1" && $2 == "1000" && $3 == "2000" && $4 == "chr1" && $5 == "38000" && $6 == "39000") print $0}'  DB_file.txt

How can I do for all the patterns in a file ?
# 2  
Old 03-31-2020
Hi
try this
Code:
awk '
NR == FNR    {A[$1$2$3$4$5$6]; next}
$1$2$3$4$5$6 in A
' pattern.txt DB_file.txt

--- Post updated at 12:41 ---

in the same format pattern and db
Code:
awk '
NR == FNR    {A[$0]; len=length; next}
substr($0, 1, len) in A
' pattern.txt DB_file.txt

# 3  
Old 03-31-2020
Hello, Thanks for the reply. With the above code, only the last line of the pattern file got printed. Can you kindly check?



Code:

chr1    1000    2000    chr1    12000    13000    5    281    0    0.459585414218248    0    0    0    1415    1    2.19163104109222    0    0    0 0.000000310867653966458    3.44281554060217    0.000000377804900731428    0.128881860609444    0.263803805858084    0.81707019750747

# 4  
Old 03-31-2020
cat pattern.txt
Code:
chr1    1000    2000    chr1    10000    11000
chr1    1000    2000    chr1    11000    12000
chr1    1000    2000    chr1    12000    13000

cat DB_file.txt
Code:
chr1    1000    2000    chr1    10000    11000    3    281    0    0.459585414218248    0    0    0    1218    1    1.88650643678468    0    0    0    0.000000425582664277006    3.87833663319237    0.000000425597761316606    0.201115300038799    0.743522481235195    0.822936566866982
chr1    1000    2000    chr1    11000    12000    4    281    0    0.459585414218248    0    0    0    459    1    0.710924839477969    0    0    0    0.000000355375953311341    1.75327208538672    0.000000192399150742434    0.068194541602096    0.101318817290739    0.81707019750747
chr1    1000    2000    chr1    12000    13000    5    281    0    0.459585414218248    0    0    0    1415    1    2.19163104109222    0    0    0    0.000000310867653966458    3.44281554060217    0.000000377804900731428    0.128881860609444    0.263803805858084    0.81707019750747
chr1    1000    2000    chr1    13000    14000    1    281    0    0.459585414218248    0    0    0    437    1    0.676850010570529    0    0    0    0.000000285200375223444    1.49690344452761    0.000000164265976667856    0.335040184988013    0.776177861586765    0.837324774202159
chr1    1000    2000    chr1    14000    15000    1    281    0    0.459585414218248    0    0    0    530    1    0.820893605497437    0    0    0    0.000000271516726063383    1.60662404023105    0.000000176306406449545    0.322230259464951    0.799436461434159    0.850447555722604
chr1    1000    2000    chr1    16000    17000    1    281    0    0.459585414218248    0    0    0    490    1    0.758939371120272    0    0    0    0.000000253854147173018    1.41695624386548    0.000000155492795574155    0.343542270137564    0.75754917047966    0.828368055880824
 chr1    1000    2000   chr1    18000    19000    2    281    0    0.459585414218248    0    0    0    130    1    0.201351261725787    0    0    0    0.000000231422263301451    0.691389012939271    0.0000000758710869983566    0.119714987783608    0.152817308925748    0.81707019750747

cat test1.sh
Code:
#!/bin/bash
awk '
NR == FNR    {A[$1$2$3$4$5$6];next}
$1$2$3$4$5$6 in A
' pattern.txt DB_file.txt

Code:
./test1.sh
chr1    1000    2000    chr1    10000    11000    3    281    0    0.459585414218248    0    0    0    1218    1    1.88650643678468    0    0    0    0.000000425582664277006    3.87833663319237    0.000000425597761316606    0.201115300038799    0.743522481235195    0.822936566866982
chr1    1000    2000    chr1    11000    12000    4    281    0    0.459585414218248    0    0    0    459    1    0.710924839477969    0    0    0    0.000000355375953311341    1.75327208538672    0.000000192399150742434    0.068194541602096    0.101318817290739    0.81707019750747
chr1    1000    2000    chr1    12000    13000    5    281    0    0.459585414218248    0    0    0    1415    1    2.19163104109222    0    0    0    0.000000310867653966458    3.44281554060217    0.000000377804900731428    0.128881860609444    0.263803805858084    0.81707019750747

cat test2.sh
Code:
#!/bin/bash
awk '
NR == FNR    {A[$0]; len=length; next}
substr($0, 1, len) in A
' pattern.txt DB_file.txt

Code:
./test2.sh
chr1    1000    2000    chr1    10000    11000    3    281    0    0.459585414218248    0    0    0    1218    1    1.88650643678468    0    0    0    0.000000425582664277006    3.87833663319237    0.000000425597761316606    0.201115300038799    0.743522481235195    0.822936566866982
chr1    1000    2000    chr1    11000    12000    4    281    0    0.459585414218248    0    0    0    459    1    0.710924839477969    0    0    0    0.000000355375953311341    1.75327208538672    0.000000192399150742434    0.068194541602096    0.101318817290739    0.81707019750747
chr1    1000    2000    chr1    12000    13000    5    281    0    0.459585414218248    0    0    0    1415    1    2.19163104109222    0    0    0    0.000000310867653966458    3.44281554060217    0.000000377804900731428    0.128881860609444    0.263803805858084    0.81707019750747

This User Gave Thanks to nezabudka For This Post:
Sanchari
Login or Register to Ask a Question

Previous Thread | Next Thread

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Big pattern file matching within another pattern file in awk or shell

Hi I need to do a patten match between files . I am new to shell scripting and have come up with this so far. It take 50 seconds to process files of 2mb size . I need to tune this code as file size will be around 50mb and need to save time. Main issue is that I need to search the pattern from... (2 Replies)
Discussion started by: nitin_daharwal
2 Replies

2. Shell Programming and Scripting

Awk: Matching Pattern From other file with length

Hi, I have input file whose first column needs(match.txt) to be matched with the first column of the input file with min & max length as defined in match.txt. But conditions are not matching. Please help on the changes in the code below as for multiple enteries in match.txt complete match.txt will... (3 Replies)
Discussion started by: siramitsharma
3 Replies

3. Shell Programming and Scripting

awk pattern matching

I have two files, want to compare file1 data with file2 second column and print line which are not matching. Need help in matching the pattern, file2 second column number can be leading 0 or 00 or 000. Example: file1 1 2 3 file2 a,0001 b,02 c,000 d,01 e,2 f,0005 Expected output:... (20 Replies)
Discussion started by: vegasluxor
20 Replies

4. Shell Programming and Scripting

Pattern matching using awk

Hi I am trying to find a pattern match with column one containing 3 numbers. input file tmp.lst abcd456|1|23123|123123|23423 kumadff|a|dadfadf|adfd|adfadfadf xxxd999|d|adfdfs|adfadf|adfdasfadf admin|a|dafdf|adfadfa||| output file tmp4.lst abcd456|1|23123|123123|23423... (3 Replies)
Discussion started by: vamsekumar
3 Replies

5. Shell Programming and Scripting

awk pattern matching

can somebody provide me with some ksh code that will return true if my the contents in my variable match anyone of these strings ORA|ERROR|SP2 variable="Error:ORA-01017: Invalid username/password; logon denied\nSP2-0640:Not connected" I tried this and it does not seem to work for me ... (3 Replies)
Discussion started by: BeefStu
3 Replies

6. Shell Programming and Scripting

awk - writing matching pattern to a new file and deleting it from the current file

Hello , I have comma delimited file with over 20 fileds that i need to do some validations on. I have to check if certain fields are null and then write the line containing the null field into a new file and then delete the line from the current file. Can someone tell me how i could go... (2 Replies)
Discussion started by: goddevil
2 Replies

7. UNIX for Dummies Questions & Answers

awk - pattern matching?

Hello all, I am trying to sort thru a database and print all the customers whose first names are only four characters. I just want to pull the first name only from the database. the database records appear like this in file: Mike Harrington:(510) 548-1278:250:100:175; first is name Mike... (4 Replies)
Discussion started by: citizencro
4 Replies

8. Shell Programming and Scripting

AWK pattern matching

Hi, How can I tell awk to print all lines/columns if column number 5 contains the word Monday? I have tried nawk -F, '$5==Monday' OFS=, myfile > outputfile but that doesn't work (I am a newb!!) Thanks, (7 Replies)
Discussion started by: keenboy100
7 Replies

9. Shell Programming and Scripting

pattern matching using awk.

Dear Team, How do we match two patterns on the same line using awk?Are there any logical operators which i could use in awk like awk '\gokul && chennai\' <filename> Eg: Input file: gokul,10/11/1986,coimbatore. gokul,10/11/1986,bangalore. gokul,12/04/2008,chennai.... (2 Replies)
Discussion started by: gokulj
2 Replies

10. Shell Programming and Scripting

AWK pattern matching, first and last

In a nutshell, I need to work out how to return the last matching pattern from an awk //,// search. I can bring back the first, but am unsure how to obtain the last, and a simple tail won't work as the match could be over multiple lines. Secondly I would like some way of pattern matching, a... (10 Replies)
Discussion started by: smb_uk
10 Replies
Login or Register to Ask a Question