how to search files efficiently using patterns Post: 302135225

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

search patterns

hello, i have an input file of about 50,00,000 lines. few of its lines are as follows: <CR:0023498789,TPO-14987084;BO=IC&SUB=ALLP <CF:0023498789,CB=YES;BIL&NC=NO <CF:0023498789,CW=NO;NS=NO <GC:0023498789,CG=YES;TPO&NC=YES <CR:0024659841,TPO-14484621;BO=NO&BA=OC&SUB=ALLH...

2. UNIX for Advanced & Expert Users

Best way to search for patterns in huge text files

I have the following situation: a text file with 50000 string patterns: abc2344536 gvk6575556 klo6575556 .... and 3 text files each with more than 1 million lines: ... 000000 abc2344536 46575 0000 000000 abc2344536 46575 4444 000000 abc2344555 46575 1234 ... I...

3. UNIX for Dummies Questions & Answers

script to search patterns inside list of files

>testfile while read x do if then echo $x >> testfile else fi if then echo $x >> testfile else fi done < list_of_files is there any efficient way to search abc.dml and xyz.dml ?

4. Shell Programming and Scripting

Search multiple patterns in multiple files

Hi, I have to write one script that has to search a list of numbers in certain zipped files. For eg. one file file1.txt contains the numbers. File1.txt contains 5,00,000 numbers and I have to search each number in zipped files(The number of zipped files are around 1000 each file is 5 MB) I have...

5. Shell Programming and Scripting

to read two files, search for patterns and store the output in third file

hello i have two files temp.txt and temp_unique.text the second file consists the unique fields from the temp.txt file the strings stored are in the following form 4,4 17,12 15,65 4,4 14,41 15,65 65,89 1254,1298i'm able to run the following script to get the total count of a...

6. SuSE

Search all files based on first and in all listed files search the second patterns

Hello Linux Masters, I am not a linux expert therefore i need help from linux gurus. Well i have a requirement where i need to search all files based on first patterns and after seraching all files then serach second pattern in all files which i have extracted based on first pattern....

7. Shell Programming and Scripting

Algorithm to load files efficiently without missing or accidently archiving....

We have a requirement where we get the Delta Files in every one hour and we need to load them into Oracle database every one hour using Powercenter. To efficiently do this we need to build an File management system. Here is our process: we get 6 files for 6 tables with a timestamp appended...

8. Shell Programming and Scripting

Search for patterns in thousands of files

Hi All, I want to search for a certain string in thousands of files and these files are distributed over different directories created daily. For that I created a small script in bash but while running it I am getting the below error: /ms.sh: xrealloc: subst.c:5173: cannot allocate...

9. Shell Programming and Scripting

Efficiently altering and merging files in perl

I have two files fileA HEADER LINE A CommentLine A Content A .... .... .... TAILER AfileB HEADER LINE B CommentLine B Content B .... .... .... TAILER BI want to merge these two files as HEADER LINE A CommentLine A Content A

10. Shell Programming and Scripting

Bash - Find files excluding file patterns and subfolder patterns

Hello. For a given folder, I want to select any files find $PATH1 -f $ -name "*" but omit any files like pattern name ! -iname "*.jpg" ! -iname "*.xsession*" ..... $ and also omit any subfolder like pattern name -type d \( -name "/etc/gconf/gconf.*" -o -name "*cache*" -o -name "*Cache*" -o...

LEARN ABOUT DEBIAN

dh_installlisting

DH_INSTALLLISTING(1)					User Contributed Perl Documentation				      DH_INSTALLLISTING(1)

NAME

       dh_installlisting - install .listing files to be used by desktop-profiles package

SYNOPSIS

       dh_installlisting [debhelper options] [filename(s)]

DESCRIPTION

       dh_installlisting is a debhelper program that handles installing listing files used by the desktop-profiles package into the correct
       location in package builddirectories (NOTE: this command is provided by the desktop-profiles package, so don't forget to build-depends on
       it). It also updates the cache of profile assignments (when it exists) to reflect the added metadata.

       If a file named debian/package.listing exists (or debian/listing in case of the main package) it is installed in etc/desktop-profiles. In
       addition any files given as argument will be installed in etc/desktop-profiles as package_file.listing. The format of .listing files is
       described in desktop-profiles(7).

       A dependancy on desktop-profiles will be added to misc:Depends by using this script.

SEE ALSO

       debhelper(7) desktop-profiles(7) update-profile-cache(1)

AUTHOR

       Bart Cornelis  (cobaco) <cobaco@skolelinux.no>

perl v5.14.2							    2006-12-13						      DH_INSTALLLISTING(1)

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

search patterns

Discussion started by: rochitsharma

2. UNIX for Advanced & Expert Users

Best way to search for patterns in huge text files

Discussion started by: andy2000

3. UNIX for Dummies Questions & Answers

script to search patterns inside list of files

Discussion started by: dr46014

4. Shell Programming and Scripting

Search multiple patterns in multiple files

Discussion started by: vsachan