Script to search a large file with a list of terms in another file Post: 302433447

10 More Discussions You Might Find Interesting

1. UNIX for Dummies Questions & Answers

Large file search

How do I search through a file that is so large (over 1GB) and find out exactly on what the exact pattern is found. I've used grep and know the line exist but what it returns is not complete because there are blobs in the data and there are control characters, etc and part of the data may beyond...

2. Shell Programming and Scripting

Search for multiple lines in large file

Hi, I have a requirement to search for a string in a large log file along with few lines before and after the the string. The following script was sufficient to search such an entry. STRING_TO_GREP="$1" FILE_TO_GREP="$2" NUMBER_OF_LINES_BEFORE=$3 NUMBER_OF_LINES_AFTER=$4 for i in `grep...

3. Shell Programming and Scripting

Take a list if strings from a file and search them in a list of files and report them

I have a file 1.txt with the below contents. -----cat 1.txt----- 1234 5678 1256 1234 1247 ------------------- I have 3 more files in a folder -----ls -lrt------- A1.txt A2.txt A3.txt ------------------- The contents of those three files are similar format with different data values...

4. Shell Programming and Scripting

Grep multiple search terms with context

I have a file that is a sort library in the format: ##def title1 content1 stuff1 content2 stuff2 ##enddef ##def title2 etc.. I want to grep def and content and pull some trailing context from content so the result would look something like:

5. Shell Programming and Scripting

Script to sort large file with frequency

Hello, I have a very large file of around 2 million records which has the following structure: I have used the standard awk program to sort: # wordfreq.awk --- print list of word frequencies { # remove punctuation #gsub(/_]/, "", $0) for (i = 1; i <= NF; i++) freq++ } END { for (word...

6. Shell Programming and Scripting

Removing duplicate terms in a file

Hi everybody I have a .txt file that contains some assembly code for optimizing it i need to remove some replicated parts. for example I have:e_li r0,-1 e_li r25,-1 e_lis r25,0000 add r31, r31 ,r0 e_li r28,-1 e_lis r28,0000 add r31, r31 ,r0 e_li r28,-1 ...

7. UNIX for Dummies Questions & Answers

Grep? - using a file of terms to search another file when the information is on a different line

I have a flat file that looks like this, let's call it Chromosome_9.txt: FT /Gene_Name="Guanyl-Acetylase 9" FT /Gene_Number"36952" FT /Gene_Name="Endoplasmic Luciferase" FT /Gene_Number"36953" FT ...

8. UNIX for Dummies Questions & Answers

Grep -B used with -f? (Searching a file using a list of terms, output is lines before each match)

9. UNIX for Dummies Questions & Answers

Search file and print everything except multiple search terms

I'm trying to find a way to search a range of similar words in a file. I tried using sed but can't get it right:sed 's/$ca01$*//'It only removes "ca01" but leaves the rest of the word. I still want the rest of the information on the lines just not these specific words listed below. Any...

10. UNIX for Beginners Questions & Answers

Search spaces in 5th column in large file

i have a file having 5 columns with more than million records. And i want to search using UNIX command to find if there are any spaces in 5th column. any please help.

LEARN ABOUT MOJAVE

zipgrep

ZIPGREP(1L)															       ZIPGREP(1L)

NAME

       zipgrep - search files in a ZIP archive for lines matching a pattern

SYNOPSIS

       zipgrep [egrep_options] pattern file[.zip] [file(s) ...]  [-x xfile(s) ...]

DESCRIPTION

       zipgrep	will  search  files  within  a ZIP archive for lines matching the given string or pattern.  zipgrep is a shell script and requires
       egrep(1) and unzip(1L) to function.  Its output is identical to that of egrep(1).

ARGUMENTS

       pattern
	      The pattern to be located within a ZIP archive.  Any string or regular expression accepted by egrep(1) may be used.  file[.zip] Path
	      of  the  ZIP archive.  (Wildcard expressions for the ZIP archive name are not supported.)  If the literal filename is not found, the
	      suffix .zip is appended.	Note that self-extracting ZIP files are supported, as with any other ZIP archive; just	specify  the  .exe
	      suffix (if any) explicitly.

       [file(s)]
	      An  optional list of archive members to be processed, separated by spaces.  If no member files are specified, all members of the ZIP
	      archive are searched.  Regular expressions (wildcards) may be used to match multiple members:

	      *      matches a sequence of 0 or more characters

	      ?      matches exactly 1 character

	      [...]  matches any single character found inside the brackets; ranges are specified by a beginning character, a hyphen, and an  end-
		     ing character.  If an exclamation point or a caret (`!' or `^') follows the left bracket, then the range of characters within
		     the brackets is complemented (that is, anything except the characters inside the brackets is considered a match).

	      (Be sure to quote any character that might otherwise be interpreted or modified by the operating system.)

       [-x xfile(s)]
	      An optional list of archive members to be excluded from processing.  Since wildcard characters  match  directory	separators  (`/'),
	      this  option  may  be used to exclude any files that are in subdirectories.  For example, ``zipgrep grumpy foo *.[ch] -x */*'' would
	      search for the string ``grumpy'' in all C source files in the main directory of the ``foo'' archive, but none in any subdirectories.
	      Without the -x option, all C source files in all directories within the zipfile would be searched.

OPTIONS

       All options prior to the ZIP archive filename are passed to egrep(1).

SEE ALSO

       egrep(1), unzip(1L), zip(1L), funzip(1L), zipcloak(1L), zipinfo(1L), zipnote(1L), zipsplit(1L)

URL

       The Info-ZIP home page is currently at
       http://www.info-zip.org/pub/infozip/
       or
       ftp://ftp.info-zip.org/pub/infozip/ .

AUTHORS

       zipgrep was written by Jean-loup Gailly.

Info-ZIP							   20 April 2009						       ZIPGREP(1L)