Sponsored Content
Top Forums Shell Programming and Scripting Search for patterns in thousands of files Post 302785737 by PikK45 on Tuesday 26th of March 2013 09:39:15 AM
Old 03-26-2013
I found something on this

Can you give it a try and see?
 

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Finding a specific pattern from thousands of files ????

Hi All, I want to find a specific pattern from approximately 400000 files on solaris platform. Its very heavy for me to grep that pattern to each file individually. Can anybody suggest me some way to search for specific pattern (alpha numeric) from these forty thousand files. Please note that... (6 Replies)
Discussion started by: aarora_98
6 Replies

2. UNIX Desktop Questions & Answers

how to search files efficiently using patterns

hi friens, :) if i need to find files with extension .c++,.C++,.cpp,.Cpp,.CPp,.cPP,.CpP,.cpP,.c,.C wat is the pattern for finding them :confused: (2 Replies)
Discussion started by: arunsubbhian
2 Replies

3. UNIX for Advanced & Expert Users

Copying Thousands of Tiny or Empty Files?

There is a procedure I do here at work where I have to synchronize file systems. The source file system always has three or four directories of hundreds of thousands of tiny (1k or smaller) or empty files. Whenever my rsync command reaches these directories, I'm waiting for hours for those files... (3 Replies)
Discussion started by: deckard
3 Replies

4. UNIX for Advanced & Expert Users

Best way to search for patterns in huge text files

I have the following situation: a text file with 50000 string patterns: abc2344536 gvk6575556 klo6575556 .... and 3 text files each with more than 1 million lines: ... 000000 abc2344536 46575 0000 000000 abc2344536 46575 4444 000000 abc2344555 46575 1234 ... I... (8 Replies)
Discussion started by: andy2000
8 Replies

5. Shell Programming and Scripting

help to parallelize work on thousands of files

I need to find a smarter way to process about 60,000 files in a single directory. Every night a script runs on each file generating a output on another directory; this used to take 5 hours, but as the data grows it is taking 7 hours. The files are of different sizes, but there are 16 cores... (10 Replies)
Discussion started by: vhope07
10 Replies

6. UNIX for Dummies Questions & Answers

script to search patterns inside list of files

>testfile while read x do if then echo $x >> testfile else fi if then echo $x >> testfile else fi done < list_of_files is there any efficient way to search abc.dml and xyz.dml ? (2 Replies)
Discussion started by: dr46014
2 Replies

7. Shell Programming and Scripting

to read two files, search for patterns and store the output in third file

hello i have two files temp.txt and temp_unique.text the second file consists the unique fields from the temp.txt file the strings stored are in the following form 4,4 17,12 15,65 4,4 14,41 15,65 65,89 1254,1298i'm able to run the following script to get the total count of a... (3 Replies)
Discussion started by: vaibhavkorde
3 Replies

8. SuSE

Search all files based on first and in all listed files search the second patterns

Hello Linux Masters, I am not a linux expert therefore i need help from linux gurus. Well i have a requirement where i need to search all files based on first patterns and after seraching all files then serach second pattern in all files which i have extracted based on first pattern.... (1 Reply)
Discussion started by: Black-Linux
1 Replies

9. Shell Programming and Scripting

Bash-awk to process thousands of files

Hi to all, I have thousand of files in a folder with names with format "FILE-YYYY-MM-DD-HHMM" for what I want to send the following AWK command awk '/Code.*/' FILE-2014* I'd like to separate all files that have the same date to a folder named with the corresponding date. For example, if I... (7 Replies)
Discussion started by: Ophiuchus
7 Replies

10. Shell Programming and Scripting

Bash - Find files excluding file patterns and subfolder patterns

Hello. For a given folder, I want to select any files find $PATH1 -f \( -name "*" but omit any files like pattern name ! -iname "*.jpg" ! -iname "*.xsession*" ..... \) and also omit any subfolder like pattern name -type d \( -name "/etc/gconf/gconf.*" -o -name "*cache*" -o -name "*Cache*" -o... (2 Replies)
Discussion started by: jcdole
2 Replies
RMADISON(1)															       RMADISON(1)

NAME
rmadison -- Remotely query the Debian archive database about packages SYNOPSIS
rmadison [OPTIONS] PACKAGE ... DESCRIPTION
dak ls queries the Debian archive database ("projectb") and displays which package version is registered per architecture/component/suite. The CGI at http://qa.debian.org/madison.php provides that service without requiring SSH access to ftp-master.debian.org or the mirror on ries.debian.org. This script, rmadison, is a command line frontend to this CGI. OPTIONS
-a, --architecture=ARCH only show info for ARCH(s) -b, --binary-type=TYPE only show info for binary TYPE -c, --component=COMPONENT only show info for COMPONENT(s) -g, --greaterorequal show buildd 'dep-wait pkg >= {highest version}' info -G, --greaterthan show buildd 'dep-wait pkg >> {highest version}' info -h, --help show this help and exit -s, --suite=SUITE only show info for this suite -S, --source-and-binary show info for the binary children of source pkgs -t, --time show projectb snapshot and reload time (not supported by all archives) -u, --url=URL[,URL ...] use URL for the query. Supported shorthands are debian or qa http://qa.debian.org/madison.php bpo http://backports.debian.org/cgi-bin/madison.cgi debug http://debug.debian.net/cgi-bin/madison.cgi ubuntu http://people.canonical.com/~ubuntu-archive/madison.cgi udd http://qa.debian.org/cgi-bin/madison.cgi See the RMADISON_URL_MAP_ variable below for a method to add new shorthands. --version show version and exit --no-conf, --noconf don't read the devscripts configuration files ARCH, COMPONENT and SUITE can be comma (or space) separated lists, e.g. --architecture=m68k,i386 CONFIGURATION VARIABLES
The two configuration files /etc/devscripts.conf and ~/.devscripts are sourced by a shell in that order to set configuration variables. Command line options can be used to override configuration file settings. Environment variable settings are ignored for this purpose. The currently recognised variables are: RMADISON_URL_MAP_SHORTHAND=URL Add an entry to the set of shorthand URLs listed above. SHORTHAND should be replaced with the shorthand form to be used to refer to URL. Multiple shorthand entries may be specified by using multiple RMADISON_URL_MAP_* variables. RMADISON_DEFAULT_URL=URL Set the default URL to use unless overridden by a command line option. RMADISON_ARCHITECTURE=ARCH Set the default architecture to use unless overridden by a command line option. To run an unrestricted query when RMADISON_ARCHITECTURE is set, use --architecture='*'. NOTES
dak ls also supports -r, --regex to treat PACKAGE as a regex. Since that can easily DoS the database ("-r ."), this option is not supported by the CGI and rmadison. dak ls was formerly called madison. The protocol used by rmadison is fairly simple, the CGI accepts query the parameters a, b, c, g, G, s, S, t, and package. The parameter text is passed to enable plain-text output. SEE ALSO
madison-lite(1), dak(1). AUTHOR
rmadison and http://qa.debian.org/madison.php were written by Christoph Berg <myon@debian.org>. dak was written by James Troup <james@nocrew.org>, Anthony Towns <ajt@debian.org>, and others. Debian Utilities 2013-12-23 RMADISON(1)
All times are GMT -4. The time now is 05:57 PM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy