Login or Register to Ask a Question and Join Our Community

Sponsored Content
Full Discussion: Want unix script to search a list of strings
Top Forums Shell Programming and Scripting Want unix script to search a list of strings Post 302296162 by adminuser on Tuesday 10th of March 2009 02:10:59 PM
Old 03-10-2009
Want unix script to search a list of strings
Want unix script to search a list of strings (stored line by line in a file), search all the matching lines of files under directories and subdirectories in different unix machines(not one box diff boxes - all the unix box names and username/password are stored with a comma delimitor in flat file) and piped to a file. THE SEARCH SHOULD BE FAST.

Scenario:

1) searchlist.txt will have like
id1
id2
id3
id4 etc....
2) and the id's should be searched in files under the folder /logs and again /logs might have subdirectories in it. the /logs even might have .gz files also. the id's should be searched even in .gz files also. if any line matches the lines should be piped to result.txt file. the script should be capable of searching in differenct unix boxes.
3) THE SEARCH SHOULD BE VERY FAST as the log files under /logs directory will be in 100's and huge too.......
 

9 More Discussions You Might Find Interesting

1. Programming

Returning Strings from C program to Unix shell script

Hi, Iam calling a C program from a Unix shell script. The (C) program reads encrypted username/password from a text file , decrypts and returns the decrypted string. Is there any way i can return the decrypted string to Unix shell program. My shell script uses the output of the program to... (11 Replies)
Discussion started by: satguyz
11 Replies

2. Programming

Returning Strings from C program to Unix shell script

Hi, I'm having a requirement where I need to call a C program from a shell script and return the value from the C program to shell script. I refered a thread in this forum. But using that command in the code, it is throwing an error clear_text_password=$(get_password) Error: bash:... (24 Replies)
Discussion started by: venkatesh_sasi
24 Replies

3. Shell Programming and Scripting

Awk search for a element in the list of strings

Hi, how do I match a particular element in a list and replace it with blank? awk 'sub///' $FILE list="AL, AK, AZ, AR, CA, CO, CT, DE, FL, GA, HI, ID, IL, IN, IA, KS, KY, LA, ME, MD, MA, MI, MN, MS, MO, MT, NE, NV, NH, NJ, NM, NY, NC, ND, OH, OK, OR, PA, RI, SC, SD, TN, TX, UT, VT, VA, WA,... (2 Replies)
Discussion started by: grossgermany
2 Replies

4. UNIX for Dummies Questions & Answers

script to search patterns inside list of files

>testfile while read x do if then echo $x >> testfile else fi if then echo $x >> testfile else fi done < list_of_files is there any efficient way to search abc.dml and xyz.dml ? (2 Replies)
Discussion started by: dr46014
2 Replies

5. UNIX for Dummies Questions & Answers

Delete strings in file1 based on the list of strings in file2

Hello guys, should be a very easy questn for you: I need to delete strings in file1 based on the list of strings in file2. like file2: word1_word2_ word3_word5_ word3_word4_ word6_word7_ file1: word1_word2_otherwords..,word3_word5_others... (7 Replies)
Discussion started by: roussine
7 Replies

6. Shell Programming and Scripting

Take a list if strings from a file and search them in a list of files and report them

I have a file 1.txt with the below contents. -----cat 1.txt----- 1234 5678 1256 1234 1247 ------------------- I have 3 more files in a folder -----ls -lrt------- A1.txt A2.txt A3.txt ------------------- The contents of those three files are similar format with different data values... (8 Replies)
Discussion started by: realspirituals
8 Replies

7. Shell Programming and Scripting

Search between two search strings and print the value

Based on the forums i have tried with grep command but i am unable to get the required output. search this value /*------ If that is found then search for temp_vul and print and also search until /*------- and print new_vul Input file contains: ... (5 Replies)
Discussion started by: onesuri
5 Replies

8. Shell Programming and Scripting

Help needed with shell script to search and replace a set of strings among the set of files

Hi, I am looking for a shell script which serves the below purpose. Please find below the algorithm for the same and any help on this would be highly appreciated. 1)set of strings need to be replaced among set of files(directory may contain different types of files) 2)It should search for... (10 Replies)
Discussion started by: Amulya
10 Replies

9. UNIX for Beginners Questions & Answers

How to pass strings from a list of strings from another file and create multiple files?

Hello Everyone , Iam a newbie to shell programming and iam reaching out if anyone can help in this :- I have two files 1) Insert.txt 2) partition_list.txt insert.txt looks like this :- insert into emp1 partition (partition_name) (a1, b2, c4, s6, d8) select a1, b2, c4, (2 Replies)
Discussion started by: nubie2linux
2 Replies

LEARN ABOUT MOJAVE

zipgrep

ZIPGREP(1L)															       ZIPGREP(1L)

NAME

       zipgrep - search files in a ZIP archive for lines matching a pattern

SYNOPSIS

       zipgrep [egrep_options] pattern file[.zip] [file(s) ...]  [-x xfile(s) ...]

DESCRIPTION

       zipgrep	will  search  files  within  a ZIP archive for lines matching the given string or pattern.  zipgrep is a shell script and requires
       egrep(1) and unzip(1L) to function.  Its output is identical to that of egrep(1).

ARGUMENTS

       pattern
	      The pattern to be located within a ZIP archive.  Any string or regular expression accepted by egrep(1) may be used.  file[.zip] Path
	      of  the  ZIP archive.  (Wildcard expressions for the ZIP archive name are not supported.)  If the literal filename is not found, the
	      suffix .zip is appended.	Note that self-extracting ZIP files are supported, as with any other ZIP archive; just	specify  the  .exe
	      suffix (if any) explicitly.

       [file(s)]
	      An  optional list of archive members to be processed, separated by spaces.  If no member files are specified, all members of the ZIP
	      archive are searched.  Regular expressions (wildcards) may be used to match multiple members:

	      *      matches a sequence of 0 or more characters

	      ?      matches exactly 1 character

	      [...]  matches any single character found inside the brackets; ranges are specified by a beginning character, a hyphen, and an  end-
		     ing character.  If an exclamation point or a caret (`!' or `^') follows the left bracket, then the range of characters within
		     the brackets is complemented (that is, anything except the characters inside the brackets is considered a match).

	      (Be sure to quote any character that might otherwise be interpreted or modified by the operating system.)

       [-x xfile(s)]
	      An optional list of archive members to be excluded from processing.  Since wildcard characters  match  directory	separators  (`/'),
	      this  option  may  be used to exclude any files that are in subdirectories.  For example, ``zipgrep grumpy foo *.[ch] -x */*'' would
	      search for the string ``grumpy'' in all C source files in the main directory of the ``foo'' archive, but none in any subdirectories.
	      Without the -x option, all C source files in all directories within the zipfile would be searched.

OPTIONS

       All options prior to the ZIP archive filename are passed to egrep(1).

SEE ALSO

       egrep(1), unzip(1L), zip(1L), funzip(1L), zipcloak(1L), zipinfo(1L), zipnote(1L), zipsplit(1L)

URL

       The Info-ZIP home page is currently at
       http://www.info-zip.org/pub/infozip/
       or
       ftp://ftp.info-zip.org/pub/infozip/ .

AUTHORS

       zipgrep was written by Jean-loup Gailly.

Info-ZIP							   20 April 2009						       ZIPGREP(1L)
All times are GMT -4. The time now is 03:35 PM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy