10-21-2015
You could also explain what the SPLNOMAXLEN[] values are trying to accomplish. (If you were trying to perform an exact match for one of two numbers ($1 or "91"$1) instead of a string match at the start and then a string length comparison), it would be tremendously faster.)
And, please explain why printing found or not found 1.5 billion times with no indication of what was or was not found is going to be useful to anyone. This appears to be a useless exercise. And, in that case, why does the speed matter?
But, showing us the output you're hoping to produce from those sample input files might help us understand what you're trying to do.
Note that if 1/3 of your MDN.TXT lines are duplicates (as they are in your sample), you might speed things up considerably by getting rid of the duplicates before running the search loop. That alone would probably save you about 25% on your script's running time.
10 More Discussions You Might Find Interesting
1. Shell Programming and Scripting
hello all
greeting for the day
i have a text file as the following
text.xml
abcd<FIELD>123.456</FIELD>efgh
i need to replace the value between <FIELD> and </FIELD> by using awk command.
please throw some light on this.
thank you very very much
Erik (5 Replies)
Discussion started by: erikshek
5 Replies
2. Shell Programming and Scripting
Hello!
I have text file:
From aaa@bbb Fri Jun 1 10:04:29 2010
--____OSPHWOJQGRPHNTTXKYGR____
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: quoted-printable
Content-Disposition: inline
My code '234565'. ... (2 Replies)
Discussion started by: candyme
2 Replies
3. Shell Programming and Scripting
Hello friends!
Help me pls to write correct awk and grep statements for my task:
I have got files with name filename.txt
It has such structure:
Start of file
FROM: address@domen.com (12...890) abc
DATE: 11/23/2009 on Std
SUBJECT: any subject
End of file
So, I must check,
if this file... (4 Replies)
Discussion started by: candyme
4 Replies
4. Shell Programming and Scripting
How to reverse search for a matched string in a file. Get line# of the first matched line. I am getting '2' into 'lineNum' variable.
But it feels like I am using too many commands. Is there a better more efficiant way to do this on Unix?
abc.log
aaaaaaaaaaaaa
bbbbbbbbbbbbb... (11 Replies)
Discussion started by: kchinnam
11 Replies
5. Shell Programming and Scripting
Hi,
I have an XML file with around 1 billion rows in it and i am trying to find the number of times a particular tag occurs in it. The solution i am using works but takes a lot of time (~1 hr) .Please help me with an efficient way to do this.
Lets say the input file is
<Root>
... (13 Replies)
Discussion started by: Sheel
13 Replies
6. Homework & Coursework Questions
Use and complete the template provided. The entire template must be completed. If you don't, your post may be deleted!
1. The problem statement, all variables and given/known data:
Write a template main.c file via shell script to make it easier for yourself later.
The issue here isn't writing... (2 Replies)
Discussion started by: george3isme
2 Replies
7. Shell Programming and Scripting
Hi,
I am trying to populate an array with data from a text file. I have a working method using awk but it is too slow and inefficent. See below.
The text file has 70,000 lines. As awk is a line editor it reads each line of the file until it gets to the required line and then processes it.... (3 Replies)
Discussion started by: carlr
3 Replies
8. Shell Programming and Scripting
Hello,
Some time ago a helpful awk file was provided on the forum which I give below:
NR==FNR{A=$0;next}{for(j in A){split(A,P,"=");for(i=1;i<=NF;i++){if($i==P){$i=P}}}}1
While it works beautifully on English and Latin characters i.e. within the ASCII range of 127, the moment a character beyond... (6 Replies)
Discussion started by: gimley
6 Replies
9. Shell Programming and Scripting
Hi Friends,
I have a very big text file, that has code for multiple functions. I have scan through the file and write each function in seperate file. All functions starts with
BEGIN DSFNC
Identifier "ABCDDataValidationfnc"
and ends with
END DSFNC
I need create a file(using identifier)... (2 Replies)
Discussion started by: anandapani
2 Replies
10. Shell Programming and Scripting
Hi guys,
I have a text file named file1.txt that is formatted like this:
001 , ID , 20000
002 , Name , Brandon
003 , Phone_Number , 616-234-1999
004 , SSNumber , 234-23-234
005 , Model , Toyota
007 , Engine ,V8
008 , GPS , OFF
and I have file2.txt formatted like this:
... (2 Replies)
Discussion started by: An0mander
2 Replies
LEARN ABOUT DEBIAN
approx-import
APPROX-IMPORT(8) System Manager's Manual APPROX-IMPORT(8)
NAME
approx-import - copy local .deb files into the approx cache
SYNOPSIS
approx-import [OPTION]... file.deb ...
DESCRIPTION
approx-import copies local .deb files, such as those found in /var/cache/apt/archives, into the approx(8) cache.
It does so by computing the MD5 checksum of each argument. If it matches a package in one of the Packages files in the approx(8) cache,
then the file is copied to the appropriate location in the cache.
Note that all Packages files must be scanned, regardless of how many .deb files are being imported, and this process may take several min-
utes.
The approx-import command must be run by the superuser or the approx(8) user.
OPTIONS
-c file, --config file
Specify an additional configuration file. May be used multiple times.
-s, --simulate
Process files but do not actually copy them into the cache.
-q, --quiet
Don't print the names of files that are imported.
-v, --verbose
Print the disposition of each file.
EXAMPLES
To import packages from the local apt(8) cache:
approx-import /var/cache/apt/archives/*.deb
To import packages from another proxy's cache:
find other-cache -name "*.deb" | xargs approx-import
(where other-cache is the pathname of the other proxy's cache directory)
FILES
/etc/approx/approx.conf
Configuration file for approx and related programs.
/var/cache/approx
Default cache directory for archive files.
SEE ALSO
approx.conf(5), approx(8)
AUTHOR
Eric Cooper <ecc@cmu.edu>
June 2010 APPROX-IMPORT(8)