Login or Register to Ask a Question and Join Our Community

Sponsored Content
Full Discussion: how to fgrep -f two files and get only one instance of each matched line
Top Forums Shell Programming and Scripting how to fgrep -f two files and get only one instance of each matched line Post 302574301 by rdcwayx on Thursday 17th of November 2011 04:42:28 AM
Old 11-17-2011
Quote:
Originally Posted by smarones
Hi rdcwayx,
I think your solution is what I need however my lines are a bit more complicated than the example I gave and your solution is based on that which is my fault. But I was looking for something general and it seems like there is not something you can apply to everycase.

the expressions I want is more like this:
Code:
 
Network=XXX,Context=GG123,Element=1

and I want what ever comes after the second equal sign before the last comma, in this case would be GG123.


Hi funksen,

I have thousands of lines not sure if while would be a good idea as you mentioned.
Ok, my understand, your file1 will be something like:

Code:
GG123
GG124
XX123

file2
Code:
Network=XXX,Context=GG123,Element=1
Network=XXX,Context=GG123,Element=2
Network=XXX,Context=XX123,Element=1
Network=XXX,Context=GG124,Element=1
Network=XXX,Context=GG123,Element=1

Code:
awk -F , 'NR==FNR{a[$1];next} {split($2,b,"=");if (b[2] in a){print;delete a[b[2]]}}' file1 file2

 

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

How to get a next line of a matched word?

Hi , If I match a word in a file, I want to pick the next line of that matched word. My file is a below format- The ntrag trace has auditError Line5005 contains transaction Ntrag data ------------ Here I wanted if I match a word auditError, I need to get the next line "Line5005... (10 Replies)
Discussion started by: Muktesh
10 Replies

2. Shell Programming and Scripting

replace first instance(not first instance in line)

Alright, I think I know what I am doing with sed(which probably means I don't). But I cant figure out how to replace just the first occurance of a string. I have tried sed, ed, and grep but can't seem to figure it out. If you have any suggestions I am open to anything! (3 Replies)
Discussion started by: IronHorse7
3 Replies

3. Shell Programming and Scripting

awk script to move a line after the matched pattern line

I have the following text format in a file which lists the question first and then 5 choices after that the explanantion and finally the answer. 1.The amount of time it takes for most of a worker’s occupational knowledge and skills to become obsolete has been declining because of the... (2 Replies)
Discussion started by: nanchil_guy
2 Replies

4. Shell Programming and Scripting

Append instance count to each line

Hello forum, I need help with a script for displaying the number of instances/times a particular line appears in a tab-delimited file and append that number to the end of the line. Example text file: aaa bbb ccc ddd ggg hhh kkk nnn aaa bbb ccc ddd aaa bbb ccc ddd ppp qqq nnn sss ggg... (1 Reply)
Discussion started by: jaysean
1 Replies

5. Shell Programming and Scripting

awk get matched line's previous line

hi everyone, a b in c d e f in g output is: a e so awk search for "in", then print out the matched line's previuos line. Please advice. (11 Replies)
Discussion started by: jimmy_y
11 Replies

6. Shell Programming and Scripting

Replace all but skip first instance in a line

I have a record like the one given below. 010000306551~IN ~N~ |WINDWARD PK|Alpharetta| If ~ is present more than instance in a line,then I need to delete those instances. Any ideas? I am working in Solaris (7 Replies)
Discussion started by: prasperl
7 Replies

7. Shell Programming and Scripting

Using sed can you specify the last instance of a character on a line?

I was told a way to do this with awk earlier today but is there a way with sed to specify the last instance of a character on a line? You will know what character you're looking for but there could be none or one hundred instances of it on a line say and you ONLY want to specify the last one for... (3 Replies)
Discussion started by: Bashingaway
3 Replies

8. Shell Programming and Scripting

Help required on joining one line above & below to the pattern matched string line.

Hi Experts, Help needed on joining one line above & below to the pattern matched string line. The input file, required output is mentioned below Input file ABCD DEFG5 42.0.1-63.38.31 KKKK iokl IP Connection Available ABCD DEFG5 42.0.1-63.38.31 ... (7 Replies)
Discussion started by: krao
7 Replies

9. Shell Programming and Scripting

awk line instance counter

I Have a text file with several thousand lines of text. Occasionally there will be a "sysAlive" line of text (every so often) What would be an awk command to print every line of text, and to put in incrementing counter ONLY on the "sysAlive" lines For example: >cat file.txt lineAAA a b c d... (4 Replies)
Discussion started by: ajp7701
4 Replies

10. Shell Programming and Scripting

How to print previous line of multiple pattern matched line?

Hello, I have below format log file, Comparing csv_converted_files/2201/9747.1012H67126.5077292103609547345.csv and csv_converted_files/22019/97447.1012H67126.5077292103609547345.csv Comparing csv_converted_files/2559/9447.1012H67126.5077292103609547345.csv and... (6 Replies)
Discussion started by: arvindshukla81
6 Replies

LEARN ABOUT OSX

perlko5.12

PERLKO(1)						 Perl Programmers Reference Guide						 PERLKO(1)

NAME

       perlko - PerlX XXX XXX

DESCRIPTION

       PerlX XXX XX XX XXXXX !

       PerlX 5.8.0XXX XXXX/ISO 10646X XX XXXX XXX XXX.	XXXX XXX XXXX XXXX XXX XX XXXX XXXX XXX XX XXX XXX XX XXX XX XXX XXXX XXXXX.  XXXXX X XXXX
       XXX XX XXX XX XX XX - XXX XX XXX, XX XXX, XXX XXX, XXX XX XXXX XXX XX XXXX, XX XX, XXX XX, XXXX XX, XXXX XX, XXXX XX, XX XXXX XX XX X-X
       XXXX XX XXX XX XX XXX XXX XXX  X XX X XX XXX XX XXX XXX XX XXX XXXX X X XX XX XXX XXXX  XX XX XXXX XXXX XX XX XX XX XXX	XXXX XXXX.

       PerlX XXXXX XXXXX XX XXX XX XXXXX. XX XXXXX XXX Perl XXXX XXX  UTF-8 XXXX X X XX, XX XXX XXX(XX XX, XXX, index, substr)X XXX XX XX XXXX XX
       XXX XXXXX. (X XXX XX perlunicode XXXX XXXXXX.) XXXXX XX XXXX XX XX XXX XXX, XXX XX XXX XX XX/X XXX XXXXX XXXX XX XX XXXXX X XXXX XXX XXX XX
       XX XX 'Encode'X	XXXXX. XXXX 'Encode'X  XX XXX XXX XXX XXX XX X X XXXX.

       'Encode'X XXX XX XXX XXXX XXXXX.

       euc-kr
	     US-ASCIIX KS X 1001X XX XX XXXXX XXX (XX XXXXXX
	     XX.) KS X 2901X RFC 1557 XX.

       cp949
		   MS-Windows 9x/MEXX XXX XX XXX.  euc-krX 8,822XX
		   XX XXX XX XX.  aliasX uhc, windows-949, x-windows-949,
		   ks_c_5601-1987. X XXX XXX XXXX XX XXXXX, Microsoft
		   XXXX CP949X XXX XXX XX.

       johab
		   KS X 1001:1998 XX 3XX XXX XXX.  XX XXXXX cp949X
		   XXXXX US-ASCIIX  KS X 1001X 8,822XX XX XXX XX XX.
		   XXX XXX XX XX.

       iso-2022-kr
		   RFC 1557XX XXX XXX XXX XX XXX XXXXX US-ASCIIX
		   KS X 1001X XXXXX XX XXX euc-krX XXX XXX XXX XX.
		   1997-8X XXX XXXX X XX XX XXX XXX XX.

       ksc5601-raw
		   KS X 1001(KS C 5601)X GL(X, MSBX 0XX X XX) X XXX XX
		   XXX. US-ASCIIX XXXX XX XXXX XXX XX X11 XXX XX
		   XXX (ksc5601.1987-0. '0'X GLX XXX.)XX XXX XX XXXXX
		   XX XX. KS C 5601X 1997X KS X 1001X XXX XXXX.  1998XXX  X
		   XX (XXX XXX XX XX XX)X XXXX.

	X XX XX XXX XXX XXXX.

       XX XX, euc-kr XXXXX X XXX UTF-8X XXXXX XXX XX XX XXX.

	   perl -Mencoding=euc-kr,STDOUT,utf8 -pe1  < file.euckr > file.utf8

       XXXX XXX XX X X XXXX.

	   perl -Mencoding=utf8,STDOUT,euc-kr -pe1  < file.utf8  > file.euckr

	 XX XXX XX XXXX X X XXX Encode XXX XX
       XXXX PerlXX XX piconvX PerlX XX XXXX.
       X XXXX X X XXX piconvX UnixX XX iconvX
       XXX X XXXX. X XXXX XXX XXXX.

	  piconv -f euc-kr -t utf8 < file.euckr > file.utf8
	  piconv -f utf8 -t euc-kr < file.utf8 > file.euckr

	 X, 'PerlIO::encoding' XXX XX XXX XXXX XXX XX XX
       (XXX XXX XXX) XXX XX X X XXXX.

	 #!/path/to/perl

	 use encoding 'euc-kr', STDIN => 'euc-kr',
				STDOUT-> 'euc-kr', STDERR=>'euc-kr';

	 print length("XX");	    # 2  (X XXXX XX XX XXX XX)
	 print length('XX');	    # 4  (XX XXXX XXX XX XXX XX)
	 print index("XX, XXX", "X");	# -1 ('X'X XX)
	 print index('XX, XXX', 'X');	# 7 (8XXX 9XX XXXX 'X'X
						   XXXX XXX.)

   X XXX XX XXX...
	 PerlX XXXX  XXX XXX XXX XX XX XX, X XXX XX
       Perl XX X XXX XXXX XX, EncodeX XXX XX XX XX
       XX X XXXX.  XX X XXX XX XX XXX XX XXXX.

   Perl XX XX
       XXX XXX	XX XXX XXX XX XXX XXXX. X XXX XX XXX XX XXX XX XXXX XX XX XXXX.

       <http://www.perl.com/>
	      O'ReillyX Perl X XXX

       <http://www.cpan.org/>
		   Comprehensive Perl Archive Network

       <http://lists.perl.org/>
	     Perl XXX XXX. XX XXX XXX
	     perl-unicodeXX 'Encode'X XX XXX.

   PerlX X XX XXXXX XXX X X XX XXX XX XXX
       <http://www.perl.or.kr/>
	     Perl XX XXX XX

       <news:han.comp.lang.perl/>
	     XXX Perl XX XX

       <http://www.hanb.co.kr/search/searchResult.php?keyword=perl>
	     O'ReillyXX XX XXX Perl XX XX

       <http://www.perlschool.net/>
	     Perl XX XX X XX, XX XX, XX XX XXX XX

       <http://www.perl.co.kr>
	     PerlX XXX CGI, DB, XX XX XX  XX X XX XX

   XXXX X XXX XXX XX XX
       <http://www.unicode.org/>
	     XXXX XXXX.

       <http://std.dkuug.dk/JTC1/SC2/WG2>
	   XXXXX UnicodeX XX ISO XXX  ISO/IEC 10646 UCS(Universal Character Set)X XXX  ISO/IEC JTC1/SC2/WG2X X XXX.

       <http://www.cl.cam.ac.uk/~mgk25/unicode.html>
	     XXX/XXXXX XXXXX UTF-8 XXX XX XXX(FAQ)

       http://kldp.org/Translations/html/UTF8-Unicode-KLDP/UTF8-Unicode-KLDP.html <http://kldp.org/Translations/html/UTF8-Unicode-
       KLDP/UTF8-Unicode-KLDP.html>
	     XXX/XXXXX XXXXX UTF-8 XXX XX XXX(FAQ)X  XXX XX

SEE ALSO

       Encode, Encode::KR, encoding, perluniintro, perlunicode

AUTHORS

       Jarkko Hietaniemi <jhi@iki.fi> XXX <jshin@mailaps.org>

perl v5.12.5							    2012-11-03								 PERLKO(1)
All times are GMT -4. The time now is 03:26 PM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy