print contents of file2 for matching pattern in file1

Sponsored Content

Top Forums UNIX for Advanced & Expert Users print contents of file2 for matching pattern in file1 - AWK Post 302349403 by i.scientist on Tuesday 1st of September 2009 02:00:18 AM

09-01-2009

Registered User

print contents of file2 for matching pattern in file1 - AWK

File1 row is same as column 2 in file 2.
Also file 2 will either start with A, B or C.
And 3rd column in file 2 is always F2.

When column 2 of file 2 matches file1 column, print all those rows into a separate file.

Here is an example.

file 1:

Code:

file 2:

Code:

A|100|F2|hello
B|100|F2|djhbsdhjf
B|100|F2|dksadbkdfd
C|100|F2|djsbdjinldf
A|101|F2|hellodfd
B|101|F2|djhbsdhjdff
B|101|F2|dksadbkdfgd
C|101|F2|djsbdjinlgfg
A|102|F2|hellodfgfd
B|102|F2|djhbsdhjfgf
C|102|F2|djsbdjinlhgf
A|103|F2|hellohggg
B|103|F2|djhbsdhjhjhj
B|103|F2|dksadbkdfdr
C|103|F2|djsbdjinlfgf
A|104|F2|hellofg
B|104|F2|djhbsdhjfgf
B|104|F2|dksadbkhfgg
C|104|F2|djsbdjinlhgh
A|105|F2|hellohgh
B|105|F2|djhbsdhjdsgh
B|105|F2|dksadbkds
C|105|F2|djsbdjinlds
A|108|F2|hello
B|108|F2|djhbsdhj
B|108|F2|dksadbk
C|108|F2|djsbdjinl

OUTPUT:

Code:

A|100|F2|hello
B|100|F2|djhbsdhjf
B|100|F2|dksadbkdfd
C|100|F2|djsbdjinldf
A|103|F2|hellohggg
B|103|F2|djhbsdhjhjhj
B|103|F2|dksadbkdfdr
C|103|F2|djsbdjinlfgf
A|104|F2|hellofg
B|104|F2|djhbsdhjfgf
B|104|F2|dksadbkhfgg
C|104|F2|djsbdjinlhgh
A|108|F2|hello
B|108|F2|djhbsdhj
B|108|F2|dksadbk
C|108|F2|djsbdjinl

I am trying awk...but no luck...here is what i am trying

Code:

awk -v i="1" 'BEGIN { FS="|" }
FR==NR
{
a[i]=$2
if (a[i]==a[i-1]) {  h[$2,i]=$0; i++ }
else { if (i==1) { h[$2,i]=$0; i++;   } 
       if (i!=1) { h[$2,i]=$0; i=1; ; }
       }
       next
}
{
         for (j=1;j<1000;j++) 
         {
         if (h[$0,j]!="") { print h[$0,j]
                          }
          }
          next
                  }' file2 file1   >  ouputfile

************************************************************
i do not want to use for/while unix loops as it is nt efiicient ..........

Last edited by vgersh99; 09-07-2009 at 08:11 PM.. Reason: code tags, PLEASE!

i.scientist

View Public Profile for i.scientist

Find all posts by i.scientist

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

awk/sed search lines in file1 matching columns in file2

Hi All, as you can see I'm pretty new to this board. :D I'm struggling around with small script to search a few fields in another file. Basically I have file1 looking like this: 15:38:28 sz:10001 pr:14.16 15:38:28 sz:10002 pr:18.41 15:38:29 sz:10003 pr:19.28 15:38:30 sz:10004...

2. UNIX for Dummies Questions & Answers

if matching strings in file1 and file2, add column from file1 to file2

I have very limited coding skills but I'm wondering if someone could help me with this. There are many threads about matching strings in two files, but I have no idea how to add a column from one file to another based on a matching string. I'm looking to match column1 in file1 to the number...

3. Shell Programming and Scripting

Pattern Matching & replacing of content in file1 with file2

I have file 1 & file 2 with content mentioned below. I want to get the output as shown in file3. Requirement: check the content of column 1 & column 2, if value of column 1 in file1 matches with first column of file2 then remaining columns(2&3) of file2 should get replaced, also if value of...

4. Shell Programming and Scripting

Based on column in file1, find match in file2 and print matching lines

file1: file2: I need to find matches for any lines in file1 that appear in file2. Desired output is '>' plus the file1 term, followed by the line after the match in file2 (so the title is a little misleading): This is honestly beyond what I can do without spending the whole night on it, so I'm...

5. Shell Programming and Scripting

Compare file1 for matching line in file2 and print the difference in matching lines

Hello, I have two files file 1 and file 2 each having result of a query on certain database tables and need to compare for Col1 in file1 with Col3 in file2, compare Col2 with Col4 and output the value of Col1 from File1 which is a) not present in Col3 of File2 b) value of Col2 is different from...

6. Shell Programming and Scripting

awk read in file1, gsub in file2, print to file3

I'm trying to use awk to do the following. I have file1 with many lines, each containing 5 fields describing an individual set. I have file2 which is a template config file with variable space holders to be replaced by the values in file1. I would like to substitute each set of values in file1 with...

7. UNIX for Dummies Questions & Answers

Compare file1 and file2, print matching lines in same order as file1

I want to print only the lines in file2 that match file1, in the same order as they appear in file 1 file1 file2 desired output: I'm getting the lines to match awk 'FNR==NR {a++}; FNR!=NR && a' file1 file2 but they are in sorted order, which is not what I want: Can anyone...

8. Shell Programming and Scripting

awk to search field2 in file2 using range of fields file1 and using match to another field in file1

I am trying to use awk to find all the $2 values in file2 which is ~30MB and tab-delimited, that are between $2 and $3 in file1 which is ~2GB and tab-delimited. I have just found out that I need to use $1 and $2 and $3 from file1 and $1 and $2of file2 must match $1 of file1 and be in the range...

9. Shell Programming and Scripting

awk to update field using matching value in file1 and substring in field in file2

In the awk below I am trying to set/update the value of $14 in file2 in bold, using the matching NM_ in $12 or $9 in file2 with the NM_ in $2 of file1. The lengths of $9 and $12 can be variable but what is consistent is the start pattern will always be NM_ and the end pattern is always ;...

10. Shell Programming and Scripting

Awk- Indexing a list of numbers in file2 to print certain rows in file1

Hi Does anyone know of an efficient way to index a column of data in file2 to print the coresponding row in file1 which corresponds to the data in file2 AND 30 rows preceding and after the row in file1. For example suppose you have a list of numbers in file2 (single column) as follows:...

LEARN ABOUT NETBSD

ascii

ASCII(7)					       BSD Miscellaneous Information Manual						  ASCII(7)

NAME

     ascii -- octal, hexadecimal and decimal ASCII character sets

DESCRIPTION

     The octal set:

     000 nul  001 soh  002 stx	003 etx  004 eot  005 enq  006 ack  007 bel
     010 bs   011 ht   012 nl	013 vt	 014 np   015 cr   016 so   017 si
     020 dle  021 dc1  022 dc2	023 dc3  024 dc4  025 nak  026 syn  027 etb
     030 can  031 em   032 sub	033 esc  034 fs   035 gs   036 rs   037 us
     040 sp   041  !   042  "	043  #	 044  $   045  %   046	&   047  '
     050  (   051  )   052  *	053  +	 054  ,   055  -   056	.   057  /
     060  0   061  1   062  2	063  3	 064  4   065  5   066	6   067  7
     070  8   071  9   072  :	073  ;	 074  <   075  =   076	>   077  ?
     100  @   101  A   102  B	103  C	 104  D   105  E   106	F   107  G
     110  H   111  I   112  J	113  K	 114  L   115  M   116	N   117  O
     120  P   121  Q   122  R	123  S	 124  T   125  U   126	V   127  W
     130  X   131  Y   132  Z	133  [	 134     135  ]   136	^   137  _
     140  `   141  a   142  b	143  c	 144  d   145  e   146	f   147  g
     150  h   151  i   152  j	153  k	 154  l   155  m   156	n   157  o
     160  p   161  q   162  r	163  s	 164  t   165  u   166	v   167  w
     170  x   171  y   172  z	173  {	 174  |   175  }   176	~   177 del

     The hexadecimal set:

     00 nul   01 soh   02 stx	03 etx	 04 eot   05 enq   06 ack   07 bel
     08 bs    09 ht    0a nl	0b vt	 0c np	  0d cr    0e so    0f si
     10 dle   11 dc1   12 dc2	13 dc3	 14 dc4   15 nak   16 syn   17 etb
     18 can   19 em    1a sub	1b esc	 1c fs	  1d gs    1e rs    1f us
     20 sp    21  !    22  "	23  #	 24  $	  25  %    26  &    27	'
     28  (    29  )    2a  *	2b  +	 2c  ,	  2d  -    2e  .    2f	/
     30  0    31  1    32  2	33  3	 34  4	  35  5    36  6    37	7
     38  8    39  9    3a  :	3b  ;	 3c  <	  3d  =    3e  >    3f	?
     40  @    41  A    42  B	43  C	 44  D	  45  E    46  F    47	G
     48  H    49  I    4a  J	4b  K	 4c  L	  4d  M    4e  N    4f	O
     50  P    51  Q    52  R	53  S	 54  T	  55  U    56  V    57	W
     58  X    59  Y    5a  Z	5b  [	 5c  	  5d  ]    5e  ^    5f	_
     60  `    61  a    62  b	63  c	 64  d	  65  e    66  f    67	g
     68  h    69  i    6a  j	6b  k	 6c  l	  6d  m    6e  n    6f	o
     70  p    71  q    72  r	73  s	 74  t	  75  u    76  v    77	w
     78  x    79  y    7a  z	7b  {	 7c  |	  7d  }    7e  ~    7f del

     The decimal set:

       0 nul	1 soh	 2 stx	  3 etx    4 eot    5 enq    6 ack    7 bel
       8 bs	9 ht	10 nl	 11 vt	  12 np    13 cr    14 so    15 si
      16 dle   17 dc1	18 dc2	 19 dc3   20 dc4   21 nak   22 syn   23 etb
      24 can   25 em	26 sub	 27 esc   28 fs    29 gs    30 rs    31 us
      32 sp    33  !	34  "	 35  #	  36  $    37  %    38	&    39  '
      40  (    41  )	42  *	 43  +	  44  ,    45  -    46	.    47  /
      48  0    49  1	50  2	 51  3	  52  4    53  5    54	6    55  7
      56  8    57  9	58  :	 59  ;	  60  <    61  =    62	>    63  ?
      64  @    65  A	66  B	 67  C	  68  D    69  E    70	F    71  G
      72  H    73  I	74  J	 75  K	  76  L    77  M    78	N    79  O
      80  P    81  Q	82  R	 83  S	  84  T    85  U    86	V    87  W
      88  X    89  Y	90  Z	 91  [	  92      93  ]    94	^    95  _
      96  `    97  a	98  b	 99  c	 100  d   101  e   102	f   103  g
     104  h   105  i   106  j	107  k	 108  l   109  m   110	n   111  o
     112  p   113  q   114  r	115  s	 116  t   117  u   118	v   119  w
     120  x   121  y   122  z	123  {	 124  |   125  }   126	~   127 del

FILES

     /usr/share/misc/ascii

HISTORY

     An ascii manual page appeared in Version 7 AT&T UNIX.

BSD
								   June 5, 1993 							       BSD

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

awk/sed search lines in file1 matching columns in file2

Discussion started by: floripoint

2. UNIX for Dummies Questions & Answers

if matching strings in file1 and file2, add column from file1 to file2

Discussion started by: pathunkathunk

3. Shell Programming and Scripting

Pattern Matching & replacing of content in file1 with file2

Discussion started by: siramitsharma

4. Shell Programming and Scripting

Based on column in file1, find match in file2 and print matching lines

Discussion started by: pathunkathunk

5. Shell Programming and Scripting

Compare file1 for matching line in file2 and print the difference in matching lines

Discussion started by: RasB15

6. Shell Programming and Scripting

awk read in file1, gsub in file2, print to file3

Discussion started by: msmehaffey

7. UNIX for Dummies Questions & Answers

Compare file1 and file2, print matching lines in same order as file1

Discussion started by: pathunkathunk

8. Shell Programming and Scripting

awk to search field2 in file2 using range of fields file1 and using match to another field in file1

Discussion started by: cmccabe

9. Shell Programming and Scripting

awk to update field using matching value in file1 and substring in field in file2

Discussion started by: cmccabe

10. Shell Programming and Scripting

Awk- Indexing a list of numbers in file2 to print certain rows in file1

Discussion started by: Geneanalyst

LEARN ABOUT NETBSD

ascii