Many thanks for the awk script. It seems to be running. Initially I used a very large syllable list in which some syllables were part of larger syllables and hence did not give any output, since once a larger syllable was admitted a subset of that syllable would automatically be excluded. I assume this is why the large syllable list did not yield results. I also sorted the syllable list on length with the largest first and this did improve the output.
Thanks a lot
p.s. I just got a mail from Mr Don Cragun who has also proposed an awk solution saying that my corpus had flaws. I corrected the same and the output is as desired. Many thanks for your help
---------- Post updated at 08:44 AM ---------- Previous update was at 08:39 AM ----------
Thanks a lot. I am so sorry that the corpus data was faulty. I guess I should have checked it out. I removed all garbage from the data and the script ran just fine. I had a syllable list of over 300 syllables and a corpus of around 37000 and the script sent by The data was sent by the community and since it was entered by hand it had flaws. The responsibility is entirely mine.
Your solution as wella s Rudic's worked just great. Many thanks once more to the forum for their generous help.
You might also want to try the following:
It produces exactly the same output as my earlier suggestion, but incorporates improvements from RudiC's suggestion and finishes performance enhancements that were incomplete in my earlier post. If you have a lot of relatively short words and some relatively long syllables, words that match relatively long syllables (leaving a small number of unmatched characters), and words that contain a few medium syllables that have been matched (leaving a small number of unmatched characters); this script will run faster. (Further improvements could be made by keeping track of the longest sequence of unmatched characters instead of just keeping track of the number of unmatched characters, but I'll leave that as an exercise for the reader.)
Sorry for the late response: it was night here when you posted this solution. I tested this script and it does give better results. Many thanks for all your help.
I am working on Sindhi: a perso-Arabic script and since it shares the Unicode-block with over 400 other languages, quite often the database contains characters which are not wanted: illegal characters.
I have identified the character set of Sindhi which is given below:
For clarity's sake, each... (8 Replies)
At present we are using one application , in which they are loading some files.
the files are some times a mix of chinese and arabic.
Is there any way to encode these literals and do the loading.
Rgds
Rj
---------- Post updated at 04:54 AM ---------- Previous update was at 04:47 AM... (0 Replies)
Hello,
Some time back I had posted a request for a syllable concordance in which if a syllable was provided in a file, the program would extract a word from a file entitled "Corpus" matching that syllable. The program was
The following script was provided which did the job and for which I am... (3 Replies)
Hello,
I have two files. The first file contains specific syllables of a language (Hindi) and the second file contains a large database from which these syllables have been culled.
The syllable file which has syllables in Hindi has one syllable per line
and the corpus file has a data... (8 Replies)
Hi,
I have searched in all installation cds for arabic packages but couldn't find it.
1. Is there any other way to download arabic package?
2. Does we need to reboot the system after installing package?
3. I don't want to reboot the system so is there any service to restart to make the... (2 Replies)
Hi,
i have a file which show text on window like,
insert into test values('اسيل للخدمات عبر الأثير');
but when i open this file in solaris it don't show like
insert into test values('اسيل للخدمات عبر الأثير');
i also want to see the line same as it is on windows
kindly help me (3 Replies)
I want to display Arabic characters in QNX4.
This work was been done by a colleague several years ago but he didn't document his work.
I installed fonts and I got this display (attached).
Please let me know how can correct as per the initial display were working in Arabic (attached).
Thanks... (0 Replies)