Login or Register to Ask a Question and Join Our Community


Shell Programming and Scripting

Search in a set of lines using perl

Login to Discuss or Reply to this Discussion in Our Community

 
Thread Tools Search this Thread
Top Forums Shell Programming and Scripting Search in a set of lines using perl
# 1  
Old 04-13-2010
Search in a set of lines using perl
Hi Experts,

i am beginner in perl and need your help to find a solution.. I have a block of multiple lines like below say module 1 to module 100

Code:
***** MAKING >    module1 **************
kvmfkvmmfdv
svksmnvlksmfvks dcsdvcs
sddvcsv ssvsdvdf error: abcdefghi
wrw wvsv dsvds sdvsd
error: xyzknnlmlmmk sds
odicnsocnslmkd dsa
***** MAKING >    module2 **************
dvsv error: dcsacscscz dfsdvcsv
dadsacdsvsv vsvsda dcs dfs
error: sdvserewllkk dssdva
dklcnsldknv  lknskdnjv nknsdknj 
dascs  error: dcscosjndovcj lsdnvos dnjns
slkdvsokj nsnvos o nnoknmod

Like the above lines, i have multiple Making scenarios.. I would need to read the block of lines from making to making and list out number of errors and the error message per module.. Can someone please help to achieve this using perl..

Sample output:
Code:
MODULE      No. of Errors   Error Message
Module1             2            sddvcsv ssvsdvdf error: abcdefghi
                                      error: xyzknnlmlmmk sds

Module2             3             dvsv error: dcsacscscz dfsdvcsv
                                      error: sdvserewllkk dssdva
                                      dascs  error: dcscosjndovcj lsdnvos dnjns

Last edited by Scott; 04-13-2010 at 06:16 PM.. Reason: Code tags, please...
# 2  
Old 04-13-2010
Scanning Blocks of Error Messages: Perl
Code:
#! /usr/bin/perl

use strict;
use warnings;

open ( F, "yourfile.txt" ) || die "$!\n";
my ( $state, $blocknum, $errnum );

while (<F>) {

    if ( /^(.*error\:.+)$/ ) { $state->{$blocknum}->{++$errnum} = $1; }
    if ( /MAKING/ ) { ++$blocknum; $errnum = 0; }

}

close F;

for my $block ( keys %{$state} ) {

    printf "MODULE %d\n", $block;

    for my $err ( keys %{$state->{$block}} ) {
        printf "%d: %s\n", $err, $state->{$block}->{$err}
    }

}

The Output header is not quite as you requested, but all the data is there. This should give you a good place to start.

HTH
# 3  
Old 04-14-2010
thanks for ur timely help deindorfer.. i will try this out and keep you posted..

---------- Post updated at 10:29 AM ---------- Previous update was at 07:59 AM ----------

Hi deindorfer,
Works good, but can you please help to print the exact module name as in the input txt file file.. In real, the module names, module1, module2 would be different names..

MODULE 1
1: sddvcsv ssvsdvdf error: abcdefghi
2: error: xyzknnlmlmmk sds
MODULE 2
1: dvsv error: dcsacscscz dfsdvcsv
3: dascs error: dcscosjndovcj lsdnvos dnjns
2: error: sdvserewllkk dssdva
# 4  
Old 04-14-2010
Code Adjusted for Unique Module Names
Code:
#! /usr/bin/perl

use strict;
use warnings;

my ( $modname, $state, $blocknum, $errnum );

open ( F, "yourfile.txt" ) || die "$!\n";

while (<F>) {

    if ( /^(.*error\:.+)$/ ) { $state->{$blocknum}->{++$errnum} = $1; }
    if ( /MAKING >\s*(.+?)\*/ ) { ++$blocknum; $modname->{$blocknum} = $1; $errnum = 0; }

}

close F;

for my $block ( sort { $a <=> $b } keys %{$state} ) {

    printf "%s\n", $modname->{$block};

    for my $err ( sort { $a <=> $b } keys %{$state->{$block}} ) {

        printf "%d: %s\n", $err, $state->{$block}->{$err}
    }

}

There you go. The code assumes that [module name] will appear in between exactly this pattern: MAKING, one space, one greater-than symbol, zero or more spaces, the name of the module ( can be arbitrarily along ), up until we find an asterisk.

That is true in the example output. If it is not true in your real output the code will not work.

I have also added a numeric sort, such that the errors will appear in the order they were encountered. This is necessary because Perl's Hash ordering is internally arranged by Perl so the contents might not appear in numeric or insertion order.

HTH
Last edited by deindorfer; 04-14-2010 at 05:45 AM.. Reason: Fixed Misspelling
# 5  
Old 04-15-2010
thanks much.. works great.. thanks again..
# 6  
Old 04-16-2010
Code:
my ($module,$error,$cnt);
local $/="\n*****";
while(<DATA>){
	$cnt=0;
	$error="";
	my @tmp = split("\n",$_);
	foreach(@tmp){
		if(/.*(module[0-9]+)/){
			$module=$1;
			next;
		}
		if(/error/){
			if($error eq ""){
				$error=$_;
			}
			else{
				$error=$error."\n			".$_;
			}
			$cnt++;
		}
	}
	print $module,"  ",$cnt,"  ",$error,"\n";
}
__DATA__
***** MAKING >    module1 **************
kvmfkvmmfdv
svksmnvlksmfvks dcsdvcs
sddvcsv ssvsdvdf error: abcdefghi
wrw wvsv dsvds sdvsd
error: xyzknnlmlmmk sds
odicnsocnslmkd dsa
***** MAKING >    module2 **************
dvsv error: dcsacscscz dfsdvcsv
dadsacdsvsv vsvsda dcs dfs
error: sdvserewllkk dssdva
dklcnsldknv  lknskdnjv nknsdknj 
dascs  error: dcscosjndovcj lsdnvos dnjns
slkdvsokj nsnvos o nnoknmod

Login or Register to Ask a Question

Previous Thread | Next Thread

9 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Search pattern on logfile and search for day/dates and skip duplicate lines if any

Hi, I've written a script to search for an Oracle ORA- error on a log file, print that line and the .trc file associated with it as well as the dateline of when I assumed the error occured. In most it is the first dateline previous to the error. Unfortunately, this is not a fool proof script.... (2 Replies)
Discussion started by: newbie_01
2 Replies

2. Shell Programming and Scripting

Help needed with shell script to search and replace a set of strings among the set of files

Hi, I am looking for a shell script which serves the below purpose. Please find below the algorithm for the same and any help on this would be highly appreciated. 1)set of strings need to be replaced among set of files(directory may contain different types of files) 2)It should search for... (10 Replies)
Discussion started by: Amulya
10 Replies

3. Shell Programming and Scripting

Perl - start search by using search button or by pressing the enter key

#Build label and text box $main->Label( -text => "Input string below:" )->pack(); $main->Entry( -textvariable => \$text456 )->pack(); $main->Button( -text => "Search", -command => sub { errchk ($text456) ... (4 Replies)
Discussion started by: popeye
4 Replies

4. Shell Programming and Scripting

Perl - use search keywords from array and search a file and print 3rd field when matched

Hi , I have been trying to write a perl script to do this job. But i am not able to achieve the desired result. Below is my code. my $current_value=12345; my @users=("bob","ben","tom","harry"); open DBLIST,"<","/var/tmp/DBinfo"; my @input = <DBLIST>; foreach (@users) { my... (11 Replies)
Discussion started by: chidori
11 Replies

5. Shell Programming and Scripting

Search and swap multiple lines in file using Perl

Hi all, I have a vcd file with a bunch of lines containing an array, like this $var wire 1 b a $end $var wire 1 c a $end $var wire 1 d a $end $var wire 1 e a $end $var wire 1 f b $end $var wire 1 g b $end $var wire 1 h b $end $var wire 1 i b $end I want it like this: $var wire 1 e a... (12 Replies)
Discussion started by: veerabahu
12 Replies

6. Linux

Perl program to print previous set of lines once a pattern is matched

Hi all, I have a text data file. My aim here is to find line called *FIELD* AV for every record and print lines after that till *FIELD* RF. But here I want first 3 to four lines for very record as well. FIELD AV is some where in between for very record. SO I am not sure how to retrieve lines in... (2 Replies)
Discussion started by: kaav06
2 Replies

7. Shell Programming and Scripting

search and replace, when found, delete multiple lines, add new set of lines?

hey guys, I tried searching but most 'search and replace' questions are related to one liners. Say I have a file to be replaced that has the following: $ cat testing.txt TESTING AAA BBB CCC DDD EEE FFF GGG HHH ENDTESTING This is the input file: (3 Replies)
Discussion started by: DeuceLee
3 Replies

8. Shell Programming and Scripting

Perl to Search through next lines

I have log file that I need to extract time difference occurance when two events happend, between first occurance of TV and when W_NO happend. also read the value=, below example...I can only read the next line but not able to seach all the next lines untill i see W_NO.. Thanks for your help.... (6 Replies)
Discussion started by: bataf
6 Replies

9. Shell Programming and Scripting

Perl: Search for string on line then search and replace text

Hi All, I have a file that I need to be able to find a pattern match on a line, search that line for a text pattern, and replace that text. An example of 4 lines in my file is: 1. MatchText_randomNumberOfText moreData ReplaceMe moreData 2. MatchText_randomNumberOfText moreData moreData... (4 Replies)
Discussion started by: Crypto
4 Replies
Login or Register to Ask a Question