Login or Register to Ask a Question and Join Our Community

Sponsored Content
Full Discussion: Using perl to grep a list of patterns from an input file
Top Forums Shell Programming and Scripting Using perl to grep a list of patterns from an input file Post 302761661 by Corona688 on Saturday 26th of January 2013 10:37:58 AM
Old 01-26-2013
300,000 records is not that large unless they are really, really huge records. And 'really goofed up results' is not the same as 'the data is so huge that the utilities do not give satisfactory results' -- if the data were really too large, it would have said 'out of memory' or some such.

T[N] is how many times its been printed. I've been using it to tell whether I should put NONE in a file. Now I also use it to check if a pattern has been printed enough times to stop printing it any more.

Code:
awk 'NR==FNR { A[++L]=$1; print "#" $1 > $1; next }
        { for(N=1; N<=L; N++) if(index($0, A[N])) { T[N]++ ; if(T[N] <= 3) print > A[N] ; } }
        END {
                for(N=1; N<=L; N++)
                if(!T[N]) { close(A[N]); print "#"A[N]" NONE" >A[N] }
        }' listfile inputdata

 

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

grep patterns - File

Hi I have 3 patterns for example to be searched. These three patterns are available in file1. The patterns to be searched are in file2. I want to search the pattern of file1 to file2. Can any one help with example? Regards Dhana (1 Reply)
Discussion started by: dhanamurthy
1 Replies

2. Shell Programming and Scripting

sed/awk help to match list of patterns and remove from org file

Hi, From the pattern mentioned below remove lines based on pattern range. Conditions 1 Look For all lines starting with ALTER TABLE and Ending with ; and contains the word MOVE.I wanto to remove these lines from the file sample below. Note : The above pattern list could be found in... (1 Reply)
Discussion started by: rajan_san
1 Replies

3. Shell Programming and Scripting

Perl - How to search a text file with multiple patterns?

Good day, great gurus, I'm new to Perl, and programming in general. I'm trying to retrieve a column of data from my text file which spans a non-specific number of lines. So I did a regexp that will pick out the columns. However,my pattern would vary. I tried using a foreach loop unsuccessfully.... (2 Replies)
Discussion started by: Sp3ck
2 Replies

4. Shell Programming and Scripting

Searching patterns in 1 file and deleting all lines with those patterns in 2nd file

Hi Gurus, I have a file say for ex. file1 which has 3500 lines in it which are different account numbers and another file (file2) which has 230000 lines in it. I want to read all the lines in file1 and delete all those lines from file2 which has that same pattern as in file1. I am not quite... (4 Replies)
Discussion started by: toms
4 Replies

5. Shell Programming and Scripting

grep for certain files using a file as input to grep and then move

Hi All, I need to grep few files which has words like the below in the file name , which i want to put it in a file and and grep for the files which contain these names and move it to a new directory , full file name -C20091210.1000-20091210.1100_SMGBSC3:1000... (2 Replies)
Discussion started by: anita07
2 Replies

6. Shell Programming and Scripting

List all file that match user input perl

Hi, I want to list all file that match user input ( specified shell wildcard) but when I compile it dont list me #!/usr/bin/perl -w print "Enter Advance Search Function: "; chomp ($func = <STDIN>); my @files = glob("$func"); foreach my $file (@files) { print "$file\n";... (1 Reply)
Discussion started by: guidely
1 Replies

7. Shell Programming and Scripting

Which Grep to use a file as input?

I have two files: usednaslist & naslist Using RHEL5 usednaslist >filera:/vol/EQIMS/build >filera:/vol/iquad_dev/FAST_dev naslist >server12 SunOS filera:/vol/EQIMS/build /users/uxsrvlogs >servers3 SunOS filera:/vol/iquad_dev/FAST_dev /mnt >server4 SunOS ... (2 Replies)
Discussion started by: nitrobass24
2 Replies

8. UNIX for Beginners Questions & Answers

Using grep to select specific patterns in text file?

How do I use grep to select words that start with I or O, end in box, and contain at least one letter in between them? the text file mailinfo.txt contains Inbox the Inbox Is a match box Doesn't match INBOX Outbox Outbox1 InbOX Ibox I box If the command works correctly it... (4 Replies)
Discussion started by: steezuschrist96
4 Replies

9. UNIX for Beginners Questions & Answers

How to iterate Grep via all patterns provided in an input file?

When I use the following grep command with options -F and -f, its just displaying the text related to only the last pattern. Command: $ grep -f pattern_file.txt input_file.txt Output: doc-C2-16354 Even the following command yields the same output: Command: $ grep -Ff pattern_file.txt... (6 Replies)
Discussion started by: nsai
6 Replies

10. UNIX for Beginners Questions & Answers

Grep multiple patterns(file) and replace whole line

I am able to grep multiple patterns which stored in a files. However, how could we replace the whole line with either the pattern or new string? For example: pattern_file: *Info in the () is not part of the pattern file. They are the intended name to replace the whole line after the pattern... (5 Replies)
Discussion started by: wxboo
5 Replies

LEARN ABOUT OPENSOLARIS

auditstat

auditstat(1M)						  System Administration Commands					     auditstat(1M)

NAME

       auditstat - display kernel audit statistics

SYNOPSIS

       auditstat [-c count] [-h numlines] [-i interval] [-n] [-v]

DESCRIPTION

       auditstat displays kernel audit statistics. The fields displayed are as follows:

       aud     The total number of audit records processed by the audit(2) system call.

       ctl     This field is obsolete.

       drop    The total number of audit records that have been dropped. Records are dropped according to the kernel audit policy. See auditon(2),
	       AUDIT_CNT policy for details.

       enq     The total number of audit records put on the kernel audit queue.

       gen     The total number of audit records that have been constructed (not the number written).

       kern    The total number of audit records produced by user processes (as a result of system calls).

       mem     The total number of Kbytes of memory currently in use by the kernel audit module.

       nona    The total number of non-attributable audit records that have been constructed. These are audit records that are not attributable to
	       any particular user.

       rblk    The total number of times that the audit queue has blocked waiting to process audit data.

       tot     The total number of Kbytes of audit data written to the audit trail.

       wblk    The total number of times that user processes blocked on the audit queue at the high water mark.

       wrtn    The  total  number  of audit records written. The difference between enq and wrtn is the number of outstanding audit records on the
	       audit queue that have not been written.

OPTIONS

       -c count       Display the statistics a total of count times. If count is equal to zero, statistics are	displayed  indefinitely.   A  time
		      interval must be specified.

       -h numlines    Display a header for every  numlines of statistics printed. The default is to display the header every 20 lines. If numlines
		      is equal to zero, the header is never displayed.

       -i interval    Display the statistics every interval where interval is the number of seconds to sleep between each collection.

       -n	      Display the number of kernel audit events currently configured.

       -v	      Display the version number of the kernel audit module software.

EXIT STATUS

       auditstat returns 0 upon success and 1 upon failure.

ATTRIBUTES

       See attributes(5) for descriptions of the following attributes:

       +-----------------------------+-----------------------------+
       |      ATTRIBUTE TYPE	     |	    ATTRIBUTE VALUE	   |
       +-----------------------------+-----------------------------+
       |Availability		     |SUNWcsu			   |
       +-----------------------------+-----------------------------+

SEE ALSO

       auditconfig(1M), praudit(1M), bsmconv(1M), audit(2), auditon(2), attributes(5)

NOTES

       The functionality described in this man page is available only if the Basic Security Module (BSM) has been enabled.  See   bsmconv(1M)  for
       more information.

SunOS 5.11							    11 Feb 2008 						     auditstat(1M)
All times are GMT -4. The time now is 07:00 PM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy