| Research Abstract |
It is that purpose of this research builds the electronic dictionary system which considered recognition of sign language, automatic generation of animation. In this research, I examined it in each function of sign language recognition part, speech analysis part, articulation generation part, image database part on construction of electronic dictionary system by 3D animation through research period.
1.In recognition part, I proposed technique of no restriction by grobal articulation recognition by using monocular camera model for HMM model, hand configuration recognition.
2.In linguistic analysis part, I proposed NVGS model that made a morpheme and notation of suprasegmental phoneme possible.
And I proposed phonetic sign notation for articulation description of sign language.
3.In articulation generation part, I proposed complete synthesis by rule method from articulation notation symbol proposed and made representation of a non-manual signal possible. I was able to have been to utilize it
… More
on Internet furthermore.
4.I recorded image database KOSIGN Ver.2 for the electronic dictionary which consisted for about 1,100 vocabulary in image database part. This database considered that I used it in education, and it was constructed data of a man and a woman with two camera model from the left diagonal front and from the front. And this integrated function of each part and built prototype of sign language electronic dictionary system by interactive 3D animation in multi-media environment.
A good result was provided as above, and purpose of this research and enforcement scheduling were almost achieved. And this were introduced with NEWS7 of NHK television on animation automatic generation among result on Sunday, January 18,1998. And, for the scheduling last year, I made report of result provided from this research scheduling whole. It is equipment working state to summarize result of this research in an article furthermore.
Toward acquisition of factor technique of multimodal interface with data processing equipment by analyzing modality of sign language from this research result, I researched it, and continuation felt importance to let develop. Less
|
