Login or Register to Ask a Question and Join Our Community


Shell Programming and Scripting

awk pattern matching

Login to Discuss or Reply to this Discussion in Our Community

 
Thread Tools Search this Thread
Top Forums Shell Programming and Scripting awk pattern matching
# 1  
Old 10-08-2014
IBM awk pattern matching
I have two files, want to compare file1 data with file2 second column and print line which are not matching. Need help in matching the pattern, file2 second column number can be leading 0 or 00 or 000.
Example:

file1
Code:
1
2
3

file2
Code:
a,0001
b,02
c,000
d,01
e,2
f,0005

Expected output:
Code:
c,000
f,0005

Awk statement I am using is :
Code:
awk -F ',' 'FNR==NR{a[$0];next}!($2 in a)'   file1 file2

But this is not handling leading zero. Please advise. Thanks!
Last edited by Franklin52; 10-08-2014 at 11:36 AM.. Reason: Adding code tags for data
# 2  
Old 10-08-2014
Quote:
Originally Posted by vegasluxor
I have two files, want to compare file1 data with file2 second column and print line which are not matching. Need help in matching the pattern, file2 second column number can be leading 0 or 00 or 000.
Example:

file1
1
2
3

file2
a,0001
b,02
c,000
d,01
e,2
f,0005

Expected output:
c,000
f,0005

Awk statement I am using is :
Code:
awk -F ',' 'FNR==NR{a[$0];next}!($2 in a)'   file1 file2

But this is not handling leading zero. Please advise. Thanks!
Hi vegasluxor,

Following may help in same.

Code:
awk -F, 'FNR==NR{A[$1]=$1;next} {match($2,/.*0[1-9]/);V=$2;gsub(/0/,X,V);gsub(/^$/,0,V);} !(V in A) {print $0}' file1 file2

Output will be as follows.
Code:
c,000
f,0005

EDIT: Also my code will work if file1doesn't have any digits which are starting from 0.

Thanks,
R. Singh
Last edited by RavinderSingh13; 10-08-2014 at 04:43 AM.. Reason: Added a information for user about code
This User Gave Thanks to RavinderSingh13 For This Post:
vegasluxor
# 3  
Old 10-08-2014
Quote:
Originally Posted by RavinderSingh13
Hi vegasluxor,

Following may help in same.

Code:
awk -F, 'FNR==NR{A[$1]=$1;next} {match($2,/.*0[1-9]/);V=$2;gsub(/0/,X,V);gsub(/^$/,0,V);} !(V in A) {print $0}' file1 file2

Output will be as follows.
Code:
c,000
f,0005

EDIT: Also my code will work if file1doesn't have any digits which are starting from 0.

Thanks,
R. Singh


It can be simplified by just adding zero, no need of match and gsub

Code:
[akshay@nio tmp]$ cat f1
1
2
3

[akshay@nio tmp]$ cat f2
a,0001
b,02
c,000
d,01
e,2
f,0005

[akshay@nio tmp]$ awk 'FNR==NR{a[$1];next}!($2+0 in a)' f1 FS=',' f2
c,000
f,0005

This User Gave Thanks to Akshay Hegde For This Post:
vegasluxor
# 4  
Old 10-08-2014
Thanks for you inputs !!
I am not sure why its not working for below numbers

my data:
Code:
f1:
971507520787

f2:
Code:
1,2,0971507520787
2,2,333

-------
Code:
awk 'FNR==NR{a[$1];next}!($3+0 in a)' f1 FS=',' f2

output:
Code:
1,2,0971507520787
2,2,333

Please help !!!
Last edited by Franklin52; 10-08-2014 at 11:37 AM.. Reason: Adding code tags for data
# 5  
Old 10-08-2014
Quote:
Originally Posted by vegasluxor
Thanks for you inputs !!
I am not sure why its not working for below numbers

my data:
f1:
971507520787

f2:
1,2,0971507520787
2,2,333
-------
Code:
awk 'FNR==NR{a[$1];next}!($3+0 in a)' f1 FS=',' f2

output:
1,2,0971507520787
2,2,333

Please help !!!
I receive this o/p, run dos2unix before inputing files
Code:
[akshay@nio tmp]$ awk 'FNR==NR{a[$1];next}!($3+0 in a)' f1 FS=',' f2
2,2,333

---------- Post updated at 03:59 PM ---------- Previous update was at 03:53 PM ----------

OR try this

Code:
awk '{ sub("\r$", "") } FNR==NR{a[$1];next}!($3+0 in a)' f1 FS=',' f2

This User Gave Thanks to Akshay Hegde For This Post:
vegasluxor
# 6  
Old 10-08-2014
Still no luck Smilie
Don't know why its not working on AIX
# 7  
Old 10-08-2014
Quote:
Originally Posted by vegasluxor
Still no luck Smilie
Don't know why its not working on AIX
With sample files its working please post your real input sample using codetags
Login or Register to Ask a Question

Previous Thread | Next Thread

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Pattern matching using awk

Hi I am trying to find a pattern match with column one containing 3 numbers. input file tmp.lst abcd456|1|23123|123123|23423 kumadff|a|dadfadf|adfd|adfadfadf xxxd999|d|adfdfs|adfadf|adfdasfadf admin|a|dafdf|adfadfa||| output file tmp4.lst abcd456|1|23123|123123|23423... (3 Replies)
Discussion started by: vamsekumar
3 Replies

2. Shell Programming and Scripting

awk pattern matching name in records

Hi, I'm very new to these forums. I was wondering if someone could help an AWK beginner with a pattern matching an actor to his appearance in movies, which would be stored as records. Let's say we have a database of 4 movies (each movie a record with name, studio + year, and actor fields with... (2 Replies)
Discussion started by: Jill Ceke
2 Replies

3. Shell Programming and Scripting

awk pattern matching

can somebody provide me with some ksh code that will return true if my the contents in my variable match anyone of these strings ORA|ERROR|SP2 variable="Error:ORA-01017: Invalid username/password; logon denied\nSP2-0640:Not connected" I tried this and it does not seem to work for me ... (3 Replies)
Discussion started by: BeefStu
3 Replies

4. Shell Programming and Scripting

AWK pattern matching on loop

Hi, I am still a beginner on shell scripting so please bear with me. What i am trying to do is filter my logfile based on some ID on field 24 which is defined in array. The filter result output will be moved to my log folder with the same name. The problem is when not using loop, this command... (2 Replies)
Discussion started by: howielim
2 Replies

5. UNIX for Dummies Questions & Answers

awk - pattern matching?

Hello all, I am trying to sort thru a database and print all the customers whose first names are only four characters. I just want to pull the first name only from the database. the database records appear like this in file: Mike Harrington:(510) 548-1278:250:100:175; first is name Mike... (4 Replies)
Discussion started by: citizencro
4 Replies

6. Shell Programming and Scripting

AWK:- matching pattern search

Dear Friends, I have a flat file. To pick certain details we have written an awk where we are facing difficulty. Sample of flat file. line 1 line 2 line 3 line 4 line 5 line 6 line 7 line 8 line 9 line 10 line 11 line 12 line 13 line 14 (Matching pattern "Lkm_i-lnr:"can be... (4 Replies)
Discussion started by: anushree.a
4 Replies

7. Shell Programming and Scripting

Awk -simple pattern matching

Find bumblebee and Megatron patterns (input2) in input1. If it is + read input1 patterns from Left to Right if it is - read input1 patterns from Right to Left Y= any letter (A/B/C/D) input1 c1 100 120 TF01_X1 + AABDDAAABDDBCADBDABC c2 100 120 TF02_X2 - AABDDAAABDDBCBACDBBC... (2 Replies)
Discussion started by: bumblebee_2010
2 Replies

8. Shell Programming and Scripting

AWK pattern matching

Hi, How can I tell awk to print all lines/columns if column number 5 contains the word Monday? I have tried nawk -F, '$5==Monday' OFS=, myfile > outputfile but that doesn't work (I am a newb!!) Thanks, (7 Replies)
Discussion started by: keenboy100
7 Replies

9. Shell Programming and Scripting

pattern matching using awk.

Dear Team, How do we match two patterns on the same line using awk?Are there any logical operators which i could use in awk like awk '\gokul && chennai\' <filename> Eg: Input file: gokul,10/11/1986,coimbatore. gokul,10/11/1986,bangalore. gokul,12/04/2008,chennai.... (2 Replies)
Discussion started by: gokulj
2 Replies

10. Shell Programming and Scripting

AWK pattern matching, first and last

In a nutshell, I need to work out how to return the last matching pattern from an awk //,// search. I can bring back the first, but am unsure how to obtain the last, and a simple tail won't work as the match could be over multiple lines. Secondly I would like some way of pattern matching, a... (10 Replies)
Discussion started by: smb_uk
10 Replies
Login or Register to Ask a Question