Login or Register to Ask a Question and Join Our Community

Sponsored Content
Full Discussion: Find records with matching patterns
Top Forums UNIX for Dummies Questions & Answers Find records with matching patterns Post 302577472 by sbhuvana20 on Tuesday 29th of November 2011 06:33:03 AM
Old 11-29-2011
Find records with matching patterns
Hi,

I need to find records with a search string from a file. Search strings are provided in a file.

For eg. search_String.txt file is like below
chicago
mexico
newark
sanhose

and the file from where the records need to be fetched is given below

src_file:
xxx|chicago|12/31/2011|abc@xyz.com|installed
yyy|sanhose|12/30/2011|yyy@xyz.com|deleted
zzz|newark|11/30/2011|zzz@xyz.com|installed
ccc|denver|12/31/2011|ccc@xyz.com|installed


I have written a code as below using grep

#!/usr/bin/ksh
LIST=search_String.txt

while read line
do
grep ${line} src_file >> OUTPUT.TXT
done < ${LIST}

exit 0

This code works. But the problem am facing is my src_file is a very huge file having around 23 million records and I need to search for 1200 strings from this src_file and get the records from src_file.
Given this situation my code runs for hours.

Could anyone of you help me to understand if there is a better way for this search?

Thanks
 

10 More Discussions You Might Find Interesting

1. UNIX for Dummies Questions & Answers

matching 3 patterns in shell script

IN a file I need to check for 3 patterns if all the 3 patterns are in the file. I need to send out an email. All this needs to be done in korn shell script. Please advise. (1 Reply)
Discussion started by: saibsk
1 Replies

2. Shell Programming and Scripting

AWK: matching patterns in 2 different files

In a directory, there are two different file extensions (*.txt and *.xyz) having similar names of numerical strings (*). The (*.txt) contains 5000 multiple files and the (*.xyz) also contains 5000 multiple files. Each of the files has around 4000 rows and 8 columns, with several unique string... (5 Replies)
Discussion started by: asanjuan
5 Replies

3. Shell Programming and Scripting

Matching patterns

I have a file name in $f. If $f has "-" at the beginning, or "=", or does not have extension ".ry" or ".xt" or ".dat" then cerr would not be empty. Tried the following but having some problems. set cerr = `echo $f | awk '/^-|=|!.ry|!.xt|!.dat/'` (4 Replies)
Discussion started by: kristinu
4 Replies

4. Shell Programming and Scripting

how to form Records[multiple line] between two known patterns

file contents looks like this : #START line1 of record1 line2 of record1 #END #START line1 of record2 line2 of record2 line3 of record2 #END #START line1 of record3 #END my question how should i make it a records between #START and #END . willl i be able to get the contents of the... (5 Replies)
Discussion started by: sathish92
5 Replies

5. Shell Programming and Scripting

Find matched patterns and print them with other patterns not the whole line

Hi, I am trying to extract some patterns from a line. The input file is space delimited and i could not use column to get value after "IN" or "OUT" patterns as there could be multiple white spaces before the next digits that i need to print in the output file . I need to print 3 patterns in a... (3 Replies)
Discussion started by: redse171
3 Replies

6. Shell Programming and Scripting

Finding matching patterns in two files

Hi, I have requirement to find the matching patterns of two files in Unix. One file is the log file and the other is the error list file. If any pattern in the log file matches the list of errors in the error list file, then I would need to find the counts of the match. For example, ... (5 Replies)
Discussion started by: Bobby_2000
5 Replies

7. Shell Programming and Scripting

Find files not matching multiple patterns and then delete anything older than 10 days

Hi, I have multiple files in my log folder. e.g: a_m1.log b_1.log c_1.log d_1.log b_2.log c_2.log d_2.log e_m1.log a_m2.log e_m2.log I need to keep latest 10 instances of each file. I can write multiple find commands but looking if it is possible in one line. m file are monthly... (4 Replies)
Discussion started by: wahi80
4 Replies

8. Shell Programming and Scripting

Bash - Find files excluding file patterns and subfolder patterns

Hello. For a given folder, I want to select any files find $PATH1 -f \( -name "*" but omit any files like pattern name ! -iname "*.jpg" ! -iname "*.xsession*" ..... \) and also omit any subfolder like pattern name -type d \( -name "/etc/gconf/gconf.*" -o -name "*cache*" -o -name "*Cache*" -o... (2 Replies)
Discussion started by: jcdole
2 Replies

9. Shell Programming and Scripting

Delete patterns matching

Delete patterns matching OS version: RHEL 7.3 Shell : Bash I have a file like below (pattern.txt). I need to delete all lines starting with the following words (words separated by comma below) and ) character. LOGGING, NOCOMPRESS, TABLESPACE , PCTFREE, INITRANS, MAXTRANS, STORAGE,... (3 Replies)
Discussion started by: John K
3 Replies

10. Shell Programming and Scripting

Extended grep not matching some patterns

i have a file where the hostnames and variables are in same line in below format, am able extract some part variables while otherlike subscriptions and handler is missing. can you please correct me if grep is able to perform this ? cat /tmp/test localhost subscriptions='' handler="genie"... (14 Replies)
Discussion started by: rakeshkumar
14 Replies

LEARN ABOUT ULTRIX

trpt

trpt(8c)																  trpt(8c)

Name
       trpt - transliterate protocol trace

Syntax
       trpt [ -a ] [ -s ]  [ -t ] [ -j ] [ -p hex-address ] [ system [ core ] ]

Description
       The command interrogates the buffer of TCP trace records created when a socket is marked for debugging and prints a readable description of
       these records.

Options
       When no options are supplied, prints all the trace records found in the system grouped according to TCP connection protocol  control  block
       (PCB).  The following options may be used to alter this behavior:

       -s     In addition to the normal output, prints a detailed description of the packet sequencing information.

       -t     In addition to the normal output, prints the values for all timers at each point in the trace.

       -j     Gives a list of the protocol control block addresses for which there are trace records.

       -p     Shows only trace records associated with the protocol control block whose address follows.

       -a     In addition to the normal output, prints the values of the source and destination addresses for each packet recorded.

       The recommended use of is to isolate the problem and enable debugging on the socket(s) involved in the connection.  Find the address of the
       protocol control blocks associated with the sockets using the -A option to Then run with the -p option, supplying the  associated  protocol
       control block addresses.  If there are many sockets using the debugging option, the -j option may be useful in checking to see if any trace
       records are present for the socket in question.

       If debugging is being performed on a system or core file other than the default, the last  two  arguments  may  be  used  to  supplant  the
       defaults.

Diagnostics
       no namelist
       The system image does not contain the proper symbols to find the trace buffer.

       Other diagnostic messages are self-explanatory.

Files
See Also
       netstat(1), setsockopt(2)

																	  trpt(8c)
All times are GMT -4. The time now is 08:57 AM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy