Yes, making a pass across your 12,000 record data file for each entry in the list isn't very efficient. First thing I'll point out is that your for loop will not be listing the contents of the list, but the file name. You'd need something like this:
This reads the contents of list1.txt placing each line into the variable i. Still not efficient, but I wanted to point out the problem with your code.
Using awk, you can make one pass across each file. Way more efficient in terms of numer of i/o operations, but not as efficient as writing a programme to do the same thing in C.
You could make this more efficient by tracking most recently used files and allowing awk to keep some number (100) open and closing the rest. The programme would be executing far less opens/closes on the output files. You'd probably not have any issue keeping 212 of them open, but if your target list grows, or your system has smallish quotas on open files, you could have issues which is why I suggested closing the file after each write. Another, and easier, way would be to write a single output file of the form <filename> <text> as an intermediate file. Once the initial processing is finished, the intermediate file could be sorted and a single pass made to write each separate file. This has the advantage of opening/closing each output file just once and thus avoids the efficiency problems in my example above.
The need for the delete stems from some awk implementations which create an entry in the hash when the test is made (when targets[foo] does not exist). Without the delete, the hash will eventually contain an entry for every word in the list2.txt file rather than just the ones from the first list. These extra entries all have the value 0, so the programme works, but the memory usage is unnecessarily large. The delete statement prevents awk from keeping entries in the target hash that have a zero value, but it adds to the execution time.
Last edited by agama; 07-31-2011 at 05:03 PM..
Reason: additional thought about output
hi all,
i would like to search in a directory. all files they were found shoul be opend and looked about a keyword. if keyword is found i want to see the name of the file. i've rtfm of find and have a command like this :
find /etc -exec cat \{}\ | grep KEYWORD
but don't work, and :
find... (4 Replies)
I've following sed command working fine -
sed '/search_pattern1/ !s/pattern1/pattern2/" file
Now, I want to search two patterns - search_pattern1 and search_pattern2 .
How can put these into above sed statement ?
Thanks in advance. (12 Replies)
Hi All,
I have almost 1000+ files and I want to search specific pattern. Looking forwarded your input. Pls note that need to ignore words in between /* */
Search for: "insert into xyz" (Which procedure contain all 3).
Expected output:
procedure test1
procedure test2
procedure test3
File... (12 Replies)
Hi Friends,
I have been trying to write the script since morning and reached some where now. but i think i am stuck in the final step. please help
I want to search the strings below in red in the be be searched in the directories below. How can i do that in my shell script.
Thanks
Adi
... (8 Replies)
Hello,
I want to test if i find the word CACCIA AND idlck in a file, i have to print a message Ok.
For that , i need to user a awk command with a && logical.
Can you help me ?
:confused:
### CACCIA: DEBUT ###
if $(grep -wqi "$2" /etc/passwd); then
&& rm /etc/security/.idlck
... (3 Replies)
Hello,
I try to print out with sed or awk the 21.18 between "S3 Temperature" and "GrdC" in a text file.
The blanks are all real blanks no tabs.
Only the two first chars from temperture are required. So the "21" i need as output.
S3 Temperatur 21.18 GrdC No Alarm
... (3 Replies)
Hi,
Need your help for this scripting issue I have. I am not really good at this, so seeking your help.
I have a file looking similar to this:
Hello, i am human and name=ABCD.
How are you?
Hello, i am human and name=PQRS.
I am good.
Hello, i am human and name=ABCD.
Good bye.
Hello, i... (12 Replies)
Hy there all. Im new here. Olso new to terminal & bash, but it seams that for me it's much easyer to undarsatnd scripts than an actual programming language as c or anyother languare for that matter.
S-o here is one og my home works s-o to speak.
Write a shell script which:
-only works as a... (1 Reply)
hi,
i need to replace all words in any quote position and then need to change the words inside the file thousand of raw.
textfile data :
"Ninguno","Confirma","JuicioABC"
"JuicioCOMP","Recurso","JuicioABC"
"JuicioDELL","Nulidad","Nosino"
"Solidade","JuicioEUR","Segundo"
need... (1 Reply)
Discussion started by: benjietambling
1 Replies
LEARN ABOUT SUSE
tracker-search
tracker-search(1) User Commands tracker-search(1)NAME
tracker-search - Search all content for keywords
SYNOPSIS
tracker-search [OPTION...] EXPRESSION [EXPRESSION...]
DESCRIPTION
tracker-search searches all indexed content for EXPRESSION. The resource in which EXPRESSION matches must exist (see --all for more infor-
mation). All results are returned in ascending order. In all cases, if no EXPRESSION is given for an argument (like --folders for example)
then ALL items in that category are returned instead.
EXPRESSION
One or more terms to search. The default operation is a logical AND. For logical OR operations, see -r.
OPTIONS
-?, --help
Give a short help message.
-l, --limit=N
Limit search to N results. The default is 512.
-o, --offset=N
Offset the search results by N. For example, start at item number 10 in the results. The default is 0.
-r, --or-operator
Use OR for search terms instead of AND (the default)
-d, --detailed
Show the unique URN associated with each search result. This does not apply to --music-albums and --music-artists.
-a, --all
Show results which might not be available. This might bebecause a removable media is not mounted for example. Without this option,
resources are only shown if they exist. This option applies to all command line switches except --music-albums and --music-artists.
-f, --files=EXPRESSION
Search for files of any type matching EXPRESSION (optional).
-e, --folders=EXPRESSION
Search for folders matching EXPRESSION (optional).
-m, --music=EXPRESSION
Search for music files matching EXPRESSION (optional).
--music-albums=ALBUM
Search for music albums matching ALBUM (optional).
--music-artists=ARTIST
Search for music artists matching ARTIST (optional).
-l, --images=EXPRESSION
Search for images matching EXPRESSION (optional).
-v, --videos=EXPRESSION
Search for videos matching EXPRESSION (optional).
-t, --documents=EXPRESSION
Search for documents matching EXPRESSION (optional).
-e, --emails=EXPRESSION
Search for emails matching EXPRESSION (optional). Returns a list of subjects for emails found.
-c, --contacts=EXPRESSION
Search for contacts matching EXPRESSION (optional). Returns a list of names and email addresses found.
-V, --version
Print version.
SEE ALSO tracker-store(1), tracker-stats(1), tracker-tag(1), tracker-info(1).
GNU July 2009 tracker-search(1)