Optimal and information theoretic syntactic pattern recognition for traditional errors
In this paper we present a foundational basis for optimal and information theoretic syntactic pattern recognition. We do this by developing a rigorous model, M*, for channels which permit arbitrarily distributed substitution, deletion and insertion syntactic errors. More explicitly, if A is any finite alphabet and A* the set of words over A, we specify a stochastically consistent scheme by which a string U ϵ A* can be transformed into any Y ϵ A* by means of arbitrarily distributed substitution, deletion and insertion operations. The scheme is shown to be Functionally Complete and stochastically consistent. Apart from the synthesis aspects, we also deal with the analysis of such a model and derive a technique by which Pr[Y|U], the probability of receiving Y given that U was transmitted, can be computed in cubic time using dynamic programming. Experimental results which involve dictionaries with strings of lengths between 7 and 14 with an overall average noise of 39.75% demonstrate the superiority of our system over existing methods. The modcl also has applications in speech and uni-dimcnsional signal processing.
|Series||Lecture Notes in Computer Science|
Oommen, J, & Kashyap, R.L. (R. L.). (1996). Optimal and information theoretic syntactic pattern recognition for traditional errors. In Lecture Notes in Computer Science. doi:10.1007/3-540-61577-6_2