Shell Programming and Scripting

Hi Chubler XL,

I have modified the code again (above), can you give it a test? thanks!

I get core dump if input file has a blank line in it:

Code:

assertion "(n->flags & WSTRCUR) == 0" failed: file "../gawk-3.1.8/field.c", line 217, function: rebuild_record
Aborted (core dumped)

Hi Chubler_XL,
Many thanks, but the code still does not handle residue. I gave it as sample:
LOOKUP

Code:

prasad
manian
raghava
rajendra
subramanian

INPUT:

Code:

rajendraprasadsubramaniam
perisubramaniam
rajendraperisubramaniam

where peri was a "residual element".
The output was

Code:

Rajendra prasad subramaniam
Perisubramaniam
Rajendra perisubramaniam

showing that peri was attached to one of the two strings. Any way around this problem ?
Best regards and thanks,

Gimley

I guess the problem is the word "subramanian" in the lookup file, it should be "subramaniam", is it right?

Yes, lol just found it myself and was posting the same thing.

Gimley, did you read my warning on post #14 the solution still might not be 100% accurate.

Perhaps some sort of least-cost analysis of each replacement could improve the results, I would involve recursive code and may be a fair bit slower.

Sorry for goof-up. I have been up since 4.00 a.m. and i guess somewhere the goofup did occur.
Sorry for the bother. I tested the code and it is working. Will test it against a huge file and let you all know the results

Many thanks once again for the timely help,

Gimley

---------- Post updated 02-24-11 at 04:43 AM ---------- Previous update was 02-23-11 at 09:38 PM ----------

Dear Chubler_XL,
I have safely tested the script and it runs beautifully. I have also digested the thinking and the commands. One last request. Is it possible to add to the code a flag when a residual element is detected i.e. an element which is not found in the dictionary. This would help me speed up analysis of the data.
Sorry for imposing once again and many many thanks for all the help given. It has been a great learning experience.
p.s.
I am posting the "final" code which is working:

NR==FNR{a[$1]; next}
function lsr(c,p) {
for(p=length(c);p;p--)
if(tolower(substr(c,1,p)) in a) break;
if (p) return substr(c,1,p);
return "";
}
{while(length) {
s=lsr($0);
while (!s && length) {
printf substr($0,1,1);
$0=substr($0,2);
s=lsr($0);
if (s) printf " ";
}
printf "%s ", s;
$0=substr($0,length(s)+1)
}
printf "\n"; }

How about a ! on either side of a residual:

Code:

NR==FNR{a[$1]; next}
function lsr(c,p) {
    for(p=length(c);p;p--)
        if(tolower(substr(c,1,p)) in a) break;
    if (p) return substr(c,1,p);
    return "";
}
{while(length) {
    s=lsr($0);
    if (!s) printf "!";
    while (!s && length) {
        printf substr($0,1,1);
        $0=substr($0,2);
        s=lsr($0);
        if (s) printf "! ";
    }
    printf "%s ", s;
    $0=substr($0,length(s)+1)
}
printf "\n"; }