Login or Register to Ask a Question and Join Our Community


Shell Programming and Scripting

How to search for keywords in subsequent lines

Login to Discuss or Reply to this Discussion in Our Community

 
Thread Tools Search this Thread
Top Forums Shell Programming and Scripting How to search for keywords in subsequent lines
# 1  
Old 08-10-2009
How to search for keywords in subsequent lines
Hi all,
I am looking for a coomand to search for the keywords in susequenct lines. Keyword1 in a line and Keyword2 in the very next line.
Once i found the combination ineed to print the lines with patterns and the line above and one below.

I am giving an example here: Keywords are :ERROR and Found Path

Input data :
Code:
aaaaaaaa bbbbbbbbb vvvvvvvv
(:ERROR)  ccccccccc dddddddddddd eeeeeeeee kkkkk
Found Path: rrrrrr bbbb
cccccccccccc vvvvvvvvvvv kkkk rrrrrrrrr
aaaaaaaa bbbbbbbbb vvvvvvvv fffffffff 
(:ERROR)  aaaaaaaaaaa bnbbbbbbbbbbb ccccccc
ggggggggg hhhhhhhhhhhhhh rrrrrrrr
xxxxxxxxxx yyyyyyyyyyyyy zzzzzzzzzzzz
(:ERROR)  rrrrrrrrrrrr ssssssss tttttttt
Found Path: ggghhhhh sshshshshs
pppppppppp qqqqqqqq rrrrrrrrrrr

Output expected:
Code:
aaaaaaaa bbbbbbbbb vvvvvvvv
(:ERROR)  ccccccccc dddddddddddd eeeeeeeee kkkkk
Found Path: rrrrrr bbbb
cccccccccccc vvvvvvvvvvv kkkk rrrrrrrrr
xxxxxxxxxx yyyyyyyyyyyyy zzzzzzzzzzzz
(:ERROR)  rrrrrrrrrrrr ssssssss tttttttt
Found Path: ggghhhhh sshshshshs
pppppppppp qqqqqqqq rrrrrrrrrrr

Last edited by zaxxon; 08-10-2009 at 07:33 AM.. Reason: CODE tag optimization ;)
# 2  
Old 08-10-2009
As a start here you have the code to get the lines that have both patterns following up including the subsequent lines.
To get the line above and below these blocks you can give a try yourself maybe. But I guess someone comes up with a complete solution soon Smilie

Code:
$> awk '/^\(:ERROR\)/ { a=$0; getline; if($0 ~ /^Found Path:/) {print a"\n"$0; z=1} else{z=0; next} } z==1 && !/^Found Path/ {print}' z=0 infile
(:ERROR)  ccccccccc dddddddddddd eeeeeeeee kkkkk
Found Path: rrrrrr bbbb
cccccccccccc vvvvvvvvvvv kkkk rrrrrrrrr
aaaaaaaa bbbbbbbbb vvvvvvvv fffffffff
(:ERROR)  rrrrrrrrrrrr ssssssss tttttttt
Found Path: ggghhhhh sshshshshs
pppppppppp qqqqqqqq rrrrrrrrrrr

# 3  
Old 08-10-2009
Try this:

Code:
awk '/(:ERROR)/{err=$0;getline;if($0 ~ /^Found Path/){print prev RS err RS $0;getline; print}}{prev=$0}' file

Regards
# 4  
Old 08-10-2009
Save the below code say get_output
HTML Code:
#!/usr/bin/awk -f
BEGIN {
        prev_line_text=$0;
        next_line_of_error=0;
        cur_line=0
        error_found_line_no=cur_line;
        found_path_line_no=cur_line;
        }

        {
                cur_line++;
        }

!/ERROR/ && !/Found Path/ {
                if ( (found_path_line_no - error_found_line_no ) ==  1 )
                {
                        printf( "%s\n%s\n%s\n%s\n", prev_line_text, found_error_text, found_path_text, $0);
                }
                prev_line_text=$0;
                error_found_line_no=cur_line;
                found_path_line_no=cur_line;
        }
/ERROR/ {
        found_error_text=$0;
        next_line_of_error=1;
        error_found_line_no=cur_line;
        }

!/ERROR/ && /Found Path/ {
            if ( (error_found_line_no + 1 ) == cur_line )
            {
                found_path_text=$0;
                found_path_line_no=cur_line
            }
        }
run the script as get_output <input file_name>.

I did a quick check it is working.. Let us me know if any one know better approach then this.
# 5  
Old 08-10-2009
Thank you all for the inputs.

Franklin52, your code is working perfectly.

Apart from printing,Can i have the code for the deleteion of those lines from the input file?
# 6  
Old 08-10-2009
Quote:
Originally Posted by rdhanek
Thank you all for the inputs.

Franklin52, your code is working perfectly.

Apart from printing,Can i have the code for the deleteion of those lines from the input file?
Redirect the output to another file and replace the original file with it:

Code:
awk '..' file > newfile
mv newfile file

# 7  
Old 08-10-2009
Franklin52, I need the details of the lines with pattern,next line and the line above in a seperate file. For that i am re-directing the output of the command you provided.

Also need the remaining file, once we seperate the details mentioned above.

Regardingyour command, it doesn't print the the line above the first occurrence of the sequence.

Output expected is

---------- Post updated at 08:04 AM ---------- Previous update was at 08:03 AM ----------

Code:
aaaaaaaa bbbbbbbbb vvvvvvvv
(:ERROR)  ccccccccc dddddddddddd eeeeeeeee kkkkk
Found Path: rrrrrr bbbb
cccccccccccc vvvvvvvvvvv kkkk rrrrrrrrr
xxxxxxxxxx yyyyyyyyyyyyy zzzzzzzzzzzz
(:ERROR)  rrrrrrrrrrrr ssssssss tttttttt
Found Path: ggghhhhh sshshshshs
pppppppppp qqqqqqqq rrrrrrrrrrr

first line is not coming with your code.Please help
Login or Register to Ask a Question

Previous Thread | Next Thread

9 More Discussions You Might Find Interesting

1. UNIX for Advanced & Expert Users

Need command for grepping pattern lines with subsequent lines

Hi, I have a requirement like, I have a list of pattens in a file say pattern.txt, PHC111 PHC113 and in another file called master.lst i have entries like, PHC111 a b PHC112 a PHC113 b c PHC114 d e (5 Replies)
Discussion started by: rbalaj16
5 Replies

2. Shell Programming and Scripting

Perl - use search keywords from array and search a file and print 3rd field when matched

Hi , I have been trying to write a perl script to do this job. But i am not able to achieve the desired result. Below is my code. my $current_value=12345; my @users=("bob","ben","tom","harry"); open DBLIST,"<","/var/tmp/DBinfo"; my @input = <DBLIST>; foreach (@users) { my... (11 Replies)
Discussion started by: chidori
11 Replies

3. Shell Programming and Scripting

awk - use fields from subsequent lines

I've run into a problem getting exactly what I want out of awk - some folks may recognize this as an output from Amazon's ec2-describe-instances: Given the following: INSTANCE i-4960f321 BLOCKDEVICE Line2Var2 TAG instance i-4960f321 Name web1 TAG instance i-4960f321... (2 Replies)
Discussion started by: colinjohnson
2 Replies

4. Shell Programming and Scripting

Search a file with keywords

Hi All I have a file of format asdf asf first sec endi asdk rt 123 ferf dfg ijglkp (7 Replies)
Discussion started by: mailabdulbari
7 Replies

5. Shell Programming and Scripting

Find pattern, and then last field from subsequent lines

I've got a log file, of the format Name: network1 Dropped packets: 15618 Dropped packets for IPv6: 27 Dropped packets: 74 Dropped packets for IPv6: 0 Failed RADIUS Authentication procedures: 0 Failed RADIUS Accounting procedures: 0 Name: network2 Dropped packets: 1117 ... (18 Replies)
Discussion started by: Yorkie99
18 Replies

6. Shell Programming and Scripting

Grep and fetch subsequent lines also

Hi, I need to grep a pattern and fetch subsequent lines till end of the data-set. E.g., i have a file like: AA 1111 23 34 BB 45 56 78 CC 22 44 AA 2222 78 34 56 BB 22 56 67 68 23 CC 56 78 DD 33 55 77 AA 3333 46 BB 58 79 In above file i have 3-data sets where each set starts with... (6 Replies)
Discussion started by: prvnrk
6 Replies

7. Shell Programming and Scripting

search for keyword in subsequent lines and delete the second line

I have my data something like this I need to search for the keyword yyyy in the susequent lines and if it is present, delete the second line with keyword. In other words, if a keywords is found in two subsequent lines delete the second line. input data: aaaa bbbbb cccc dddd xxxx... (4 Replies)
Discussion started by: rdhanek
4 Replies

8. Shell Programming and Scripting

How to extract a substring and append to subsequent lines

Hi all,I am really new to Shell Scripting.I have the following doubt. Let us assume the one sample file which contains the below data HEADERCARMENTRACIE1555090414 PERIOD0905090501090531 DETAIL0645693037023073836 GROUNDAV 090501 01 GROUNDAV 090502 01 TRIP 0091282542 0905084101... (5 Replies)
Discussion started by: jaligamasriniva
5 Replies

9. Shell Programming and Scripting

replace only 1st word of a line if it comes in the subsequent lines at same postion.

I have a file like this.. Maharastra Mumbai worli Maharastra Mumbai navy maharatra Pune Maharastra Nagpur Karnataka Bangalore Karnataka Mysore Karnataka Mangalore Punjab Amritsar punjab Jalandar my expected outcome should be like this Maharastra Mumbai worli ---------- ... (9 Replies)
Discussion started by: geeko
9 Replies
Login or Register to Ask a Question