print line if 2nd field exists in text


 
Thread Tools Search this Thread
Top Forums Shell Programming and Scripting print line if 2nd field exists in text
# 8  
Old 05-27-2009
hey using your field separator " [|][|][|] ", there is just one pipe in my script ^^

Code:
while read line ; do grep -qw "$(echo $line | awk -F " [|][|][|] " '{print $2}')" file2 && echo $line ; done < file1

but I agree with you, yours is much faster
# 9  
Old 05-27-2009
Quote:
Originally Posted by funksen
hey using your field separator " [|][|][|] ", there is just one pipe in my script ^^

Code:
while read line ; do grep -qw "$(echo $line | awk -F " [|][|][|] " '{print $2}')" file2 && echo $line ; done < file1

but I agree with you, yours is much faster
with this method , you have to call grep+awk 500 times if there are 500 lines in file1. further adding to the inefficiency is if there are many lines in file2 (x500 times).
# 10  
Old 05-27-2009
Hey,

First of all, thanks a bunch, that script is allowing me to get rid of a lot of unnecessary data in my files. I've been using the script from ghostdog74 and it works great for the most part but it gets stuck when the expression has reserved signs like the ones listed below (and probably some others).

? | + -

Any way to force those characters to be considered as text?
# 11  
Old 05-28-2009
I'm thinking about just changing all special characters by adding a "\" before them, and then undo that change when the processing is done. Is that optimal?
# 12  
Old 05-28-2009
Quote:
Originally Posted by FrancoisCN
Hey,

First of all, thanks a bunch, that script is allowing me to get rid of a lot of unnecessary data in my files. I've been using the script from ghostdog74 and it works great for the most part but it gets stuck when the expression has reserved signs like the ones listed below (and probably some others).

? | + -

Any way to force those characters to be considered as text?
your sample file doesn't contain those special characters right? then show one that does.
# 13  
Old 05-28-2009
1st file
1 ||| 123/ eb ||| 513
2 ||| k + 12 ||| 51
3 ||| | ||| 5
4 ||| a ) ||| 7
5 ||| bla ? ||| 123
6 ||| foobar ||| 543
7 ||| foobar2 ||| 12346

2nd file (text)
bla bla k + 12 bla jkl bla | bla bla
def foo test 123/ eb . abc kek a )
bla ? abcdefg

Expected output
1 ||| 123/ eb ||| 513
2 ||| k + 12 ||| 51
3 ||| | ||| 5
4 ||| a ) ||| 7
5 ||| bla ? ||| 123
# 14  
Old 05-28-2009
Code:
awk   'BEGIN{FS=" [|][|][|] ";s="";}
FNR==NR{
 for ( i=1;i<=NF;i++){
  s=s $i
 } 
 next
}
{
  s2=$2
  gsub("+","\\+",s2) #escape special chars
  gsub("?","\\?",s2)
}
match(s,s2 ) 
' file2 file1

Login or Register to Ask a Question

Previous Thread | Next Thread

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

awk to print unique text in field

I am trying to use awk to print the unique entries in $2 So in the example below there are 3 lines but 2 of the lines match in $2 so only one is used in the output. File.txt chr17:29667512-29667673 NF1:exon.1;NF1:exon.2;NF1:exon.38;NF1:exon.4;NF1:exon.46;NF1:exon.47 703.807... (5 Replies)
Discussion started by: cmccabe
5 Replies

2. Shell Programming and Scripting

Command/script to match a field and print the next field of each line in a file.

Hello, I have a text file in the below format: Source Destination State Lag Status CQA02W2K12pl:D:\CAQA ... (10 Replies)
Discussion started by: pocodot
10 Replies

3. Shell Programming and Scripting

Use two field separator in the same line and print them

Hi Guys, I have the file --- HOST_NAME,data_coleta,data_carga,CPU_util,CPU_idle,run_queue,memory,MEMORY_SYSTEM,MEMORY_TOTAL,MEMORY_SWAPIN,MEMORY_SWAPOUT,DISK_READ,DISK_WRITE,DISK_IO,NET_IN_PACKET, NET_OUT_PACKET... (4 Replies)
Discussion started by: antoniorajr
4 Replies

4. Shell Programming and Scripting

awk to compare 2nd and 3rd field and print the differences

need a one liner to compare 2nd and 3rd field and print values that are not matched in 2nd field Input col 2 col 3 1.1.1.1 11.11.11.11 8.8.8.8 0.0.0.0 3.3.3.3 2.2.2.2 7.7.7.7 3.3.3.3 5.5.5.5 1.1.1.1 4.4.4.4 6.6.6.6 9.9.9.9 output 7.7.7.7 ... (12 Replies)
Discussion started by: chidori
12 Replies

5. Shell Programming and Scripting

print whole line if the 1st field contains...

i want to print lines in a file that the 1st field of each line has a Date shape such: yy/mm/dd or on the other hand contains slash "/" . (1 Reply)
Discussion started by: oreka18
1 Replies

6. Shell Programming and Scripting

Print a field from the previous line

plz help me!! I have this file , 3408 5600 3796 6035 4200 6285 4676 0 40 1554 200 1998 652 2451 864 2728 1200 0 I want it like if $2==0,replace it with field from the previous line+500 say here the o/p would be like 3408 5600 3796 6035 4200 6285... (16 Replies)
Discussion started by: Indra2011
16 Replies

7. Shell Programming and Scripting

only print line if 3rd field is 01

Similar question... I have a space delimited text file and I want to only print the lines where the 3rd word/field/column is equal to "01" awk '{if $3 = "01" print $0}' something like this. I meant to say: only print line IF 3rd field is 01 (2 Replies)
Discussion started by: ajp7701
2 Replies

8. Shell Programming and Scripting

How to print line if field matches?

Hi all, I got several lines line this a b c d e 1 e a 1 c d e 3 f a b c 1 e 8 h a b c d e 1 w a 1 c d e 2 w a b c d e 1 t a b c d e 7 4 How can I print the line if 1 is the field one before the last field? Basicly this 2 field ? a b c d e 1 e a b c d e 1 t The file I got is... (7 Replies)
Discussion started by: stinkefisch
7 Replies

9. Shell Programming and Scripting

how to print field n of line m

Hi everyone, I have a basic csh/awk question. How do I print a given field from a given line in a given file? Thanks in advance! (11 Replies)
Discussion started by: Deanne
11 Replies

10. Shell Programming and Scripting

How to print the lines after 2nd line from text file

Hi All, I need to print the lines after 2nd line irrespective of the number of lines in file if the file contents are like below ---------- root:!:0:0::/root:/usr/bin/ksh daemon:!:1:1::/etc: bin:!:2:2::/bin: sys:!:3:3::/usr/sys: adm:!:4:4::/var/adm: uucp:!:5:5::/usr/lib/uucp:... (6 Replies)
Discussion started by: ram1729
6 Replies
Login or Register to Ask a Question