Find Syllable count mismatch


 
Thread Tools Search this Thread
Top Forums Shell Programming and Scripting Find Syllable count mismatch
# 1  
Old 01-28-2019
Find Syllable count mismatch

Hello,
I have written a syllable splitter for Pseudo English [conforming to the rules of Indic] and Indic.
I have a large database with the following structure
Code:
Syllables in Pseudo English delimited by |=Syllables in Devanagari delimited by |

The tool produces syllables in both scripts. An example is given below:
Code:
a|bba|l=अ|ब्ब|ल
a|bA|s=अ|बा|स
a|bbA|s=अ|ब्बा|स
A|ba|dA=आ|ब|दा
a|bde|sh=अ|ब्दे|श
a|b|dhe|sh=अ|ब|धे|श
a|bdu|l=अ|ब्दु|ल
a|bdu|lA=अ|ब्दु|ला
a|bdu|llA=अ|ब्दु|ल्ला
a|bdu|lla|h=अ|ब्दु|ल्ल|ह
a|bdu|llA|h=अ|ब्दु|ल्ला|ह
a|bdu|r=अ|ब्दु|र
A|bhA=आ|भा
a|bha|y=अ|भ|य
a|bhi=अ|भी
a|bhi|ji|t=अ|भि|जी|त

However at times the software goofs up and the number of syllables on either side do not match as in:
Code:
zu|ba|i|dA=ज़ु|बै|दा
zu|ba|i|r=ज़ु|बै|र

As can be seen there is a mismatch: English admits 4 syllables and Devanagari admits only 3
I work in Windows environment and what I need is a script in awk or Perl which will run through the file and identify mismatches as in the example above.
Many thanks for your help and since this is my first post for the Year, belated Happy New Year.
# 2  
Old 01-28-2019
C'mon, gimley, with 301 post you should know that it is appreaciated in here if you show your attempts and where and how they fail / goof.
# 3  
Old 01-28-2019
Well, I have to go now. So - one for the road:
Code:
awk -F= 'split($1,T,"|") != split($2,T,"|")' file
zu|ba|i|dA=ज़ु|बै|दा
zu|ba|i|r=ज़ु|बै|र

This User Gave Thanks to RudiC For This Post:
Login or Register to Ask a Question

Previous Thread | Next Thread

8 More Discussions You Might Find Interesting

1. UNIX for Beginners Questions & Answers

How to find the count of IP addresses that belong to different subnets and display the count?

Hi, I have a file with a list of bunch of IP addresses from different VLAN's . I am trying to find the list the number of each vlan occurence in the output Here is how my file looks like 1.1.1.1 1.1.1.2 1.1.1.3 1.1.2.1 1.1.2.2 1.1.3.1 1.1.3.2 1.1.3.3 1.1.3.4 So what I am trying... (2 Replies)
Discussion started by: new2prog
2 Replies

2. Shell Programming and Scripting

awk to output match and mismatch with count using specific fields

In the below awk I am trying output to one file those lines that match between $2,$3,$4 of file1 and file2 with the count in (). I am also trying to output those lines that are missing between $2,$3,$4 of file1 and file2 with the count of in () each. Both input files are tab-delimited, but the... (7 Replies)
Discussion started by: cmccabe
7 Replies

3. Shell Programming and Scripting

Count mismatch in UNIX

Hi, I have a requirement like below. client is sending the .txt filles.In that file we have 10 records but when I execute the below command it is showing 9 records. klena20> wc -l sample_file.txt|awk '{print $1}' It is showing the output as 9 But in a file records are 10. I found... (7 Replies)
Discussion started by: kirankumar
7 Replies

4. UNIX for Dummies Questions & Answers

Files count mismatch when used with Tar with find

Hi I have used the below steps and found some discrepancies step 1 : find ./ -type f -mtime +7 -name "*.00*" | wc -l = 13519 ( total files ) ( the size of this files is appx : 10GB ) step 2: find ./ -type f -mtime +7 -name "*.00*" | xargs tar zcvf Archieve_7.tar.gz step... (7 Replies)
Discussion started by: rakeshkumar
7 Replies

5. Shell Programming and Scripting

Syllable splitter in Perl

Hello, I am a relative newbie and want to split Names in English into syllables. Does anyone know of a perl script which does that. Since my main area is linguistics, I would be happy to add rules to it and post the perl script back for other users. I tried the CPan perl modules but they don't... (6 Replies)
Discussion started by: gimley
6 Replies

6. Shell Programming and Scripting

Creating a syllable concordance

Hello, I have two files. The first file contains specific syllables of a language (Hindi) and the second file contains a large database from which these syllables have been culled. The syllable file which has syllables in Hindi has one syllable per line and the corpus file has a data... (8 Replies)
Discussion started by: gimley
8 Replies

7. Shell Programming and Scripting

To find String mismatch

Hi, I have a doubt when searching files for the existence of a particular key. I have a property file has data with key and value pair like below and i call it as property file.ini here are the contents in File: popertyfile.ini location.property=2 agent.method=begin newkey=23 ... (2 Replies)
Discussion started by: raghu.amilineni
2 Replies

8. Shell Programming and Scripting

comparing two files and find mismatch

hi i have two files and i want to compare both the files and find out mismatch in 3rd file file1 00354|1|0|1|1|0|0|0|1|2 52424|1|0|1|1|0|0|0|1|2 43236|1|0|1|1|0|0|0|1|2 41404|1|0|1|1|0|0|0|1|2 79968|1|0|1|1|0|0|0|1|2 file2 00354|1|0|1|1|0|0|0|1|2 52424|1|0|1|1|0|0|0|0|2... (9 Replies)
Discussion started by: dodasajan
9 Replies
Login or Register to Ask a Question