10-23-2012
grep 1000s of files with 1000s of grep values
Hi,
I have around 200,000 files in a given directory.
I need to cat each of these files and grep them for thousands of identifier values (or strings) in a given text file.
The text file looks something like this:
1234
1243545
1234353
121324
etc with thousands of entries.
Can you please assist how I can do this, and in the most efficient manner possible because this script will no doubt take a long time to run.
Thanks in advance.
Mantis
10 More Discussions You Might Find Interesting
1. Shell Programming and Scripting
Hi everybody! :) :D :D :)
it's great to be here since this is my first post.
touch /base/oracle/FRA/XMUT00/RMAN_FLAG
touch /base/oracle/FRA/XRLL00/RMAN_FLAG
find directory name containing RMAN_FLAG :
$ find /base/oracle/FRA -name RMAN_FLAG -print|xargs -n1 dirname |sort -u... (3 Replies)
Discussion started by: jolan_louve
3 Replies
2. UNIX for Dummies Questions & Answers
machine: HPUX
file: a.dat
contents:
decimal 1
decimal 2
string 1
string 2
ASCII value of 'd': 100.
to grep lines that have 'd', I use the following command
grep d a.dat
My requirement:
I should grep for lines that contain 'd'. But I should use ASCII value of 'd' in the command... (1 Reply)
Discussion started by: sriksama
1 Replies
3. Shell Programming and Scripting
Hi Guys,
I need to set the value of $7 to zero in case $7 is NULL. I've tried the below command but doesn't work. Any ideas. thanks guys.
MEM=`ps v $PPID| grep -i db2 | grep -v grep| awk '{ if ( $7 ~ " " ) { print 0 } else { print $7}}' `
Harby. (4 Replies)
Discussion started by: hariza
4 Replies
4. Shell Programming and Scripting
Hi...
I have a file abc.txt , havin more then 10,000 lines, each field separated by '#'.
I want to grep 9914699895 and 999 from abc.txt
I am trying
cat abc.txt | grep 9914699895 | grep 999
but i am also getting data like 9991111111 or 9991010101
I want to grep "999" exactly and... (1 Reply)
Discussion started by: tushar_tus
1 Replies
5. UNIX for Advanced & Expert Users
Hi,
I need to move 1000s of files from one folder to another.
Actually there are 100K+ files.
Source dir : source1
Target dir : target1
Now if try cp or mv commands I am getting an error message : Argument List too long.
I tried to do it by the time the files are created in the... (1 Reply)
Discussion started by: unx100
1 Replies
6. Shell Programming and Scripting
Hi All, I need to grep few files which has words like the below in the file name , which i want to put it in a file and and grep for the files which contain these names and move it to a new directory ,
full file name -C20091210.1000-20091210.1100_SMGBSC3:1000... (2 Replies)
Discussion started by: anita07
2 Replies
7. Shell Programming and Scripting
this is a little more complex than that. I have a text file and I need to find all the distinct words that appear in a line after the word TABLESPACE
when I grep for just the word tablespace, I get:
how do i parse this a little better so i have a smaller file to read?
This is just an... (4 Replies)
Discussion started by: guessingo
4 Replies
8. Cybersecurity
Hi,
My boss has suddenly started receiving 1000s of messages in his inbox. They are undelivered messages that are bouncing back, though the emails weren't coming from him. I guess either these are fake undelivered messages and are just scam emails. Or they are real emails being sent with spoofed... (1 Reply)
Discussion started by: timgolding
1 Replies
9. UNIX Desktop Questions & Answers
Hi
I'm sure there's a way to do this, but I ran out of caffeine/talent before getting the answer in a long winded alternate way (don't ask ;) )
The task I was trying to do was scan a directory of files and show only files that contained 3 values:
I940
5433309
2181
I tried many variations... (4 Replies)
Discussion started by: callumw
4 Replies
10. Shell Programming and Scripting
i have this line of code that looks for the same file if it is currently running and returns the count.
`ps -eaf -o args | grep -i sfs_pcard_load_file.ksh | grep -v grep | wc -l`
basically it is assigned to a variable
ISRUNNING=`ps -eaf -o args | grep -i sfs_pcard_load_file.ksh |... (6 Replies)
Discussion started by: wtolentino
6 Replies
LEARN ABOUT DEBIAN
chronicle-rss-importer
CHRONICLE-RSS-IMPORTER(1) User Contributed Perl Documentation CHRONICLE-RSS-IMPORTER(1)
NAME
chronicle-rss-importer - Import entries from an RSS feed to chronicle
SYNOPSIS
General Options:
--output Specify the directory to write entries to.
--feed Specify the URL of the feed.
--sequential Specify that entries should be numbered rather than named.
Help Options:
--help Show the help information for this script.
--manual Read the manual for this script.
--verbose Show useful debugging information.
ABOUT
Chronicle is a simple tool to convert a collection of text files,
located within a single directory, into a blog consisting of static
HTML files.
This importer script will create a directory of input files from a
given RSS feed, by downloading it and writing out each entry to a single
text file.
The output files will be named after the entries titles, or if
B<--sequential> was used each entry will be numbered numerically.
AUTHOR
Steve
--
http://www.steve.org.uk/
LICENSE
Copyright (c) 2007-2010 by Steve Kemp. All rights reserved.
This module is free software; you can redistribute it and/or modify it under the same terms as Perl itself. The LICENSE file contains the
full text of the license.
perl v5.12.3 2011-05-03 CHRONICLE-RSS-IMPORTER(1)