Co-Investigator(Kenkyū-buntansha) |
IKUTA Kazushige Tokushima Bunri University, Literature, Professor, 文学部, 教授 (60289311)
INOUE Tatsuki Weseda University, Asia-Pacific Studies, Lecturer, アジア太平洋研究科, 講師 (60298065)
|
Budget Amount *help |
¥2,200,000 (Direct Cost: ¥2,200,000)
Fiscal Year 2006: ¥800,000 (Direct Cost: ¥800,000)
Fiscal Year 2005: ¥500,000 (Direct Cost: ¥500,000)
Fiscal Year 2004: ¥900,000 (Direct Cost: ¥900,000)
|
Research Abstract |
We have developed an automated Japanese essay scoring system called Jess. The system needs expert writings rather than expert raters to build the evaluation model. By detecting statistical outliers of predetermined aimed essay features compared with many professional writings for each prompt, our system can evaluate essays. The following three features are examined : (1) rhetoric -- syntactic variety, or the use of various structures in the arrangement of phases, clauses, and sentences, (2) organization -- characteristics associated with the orderly presentation of ideas, such as rhetorical features and linguistic cues, and (3) content -- vocabulary related to the topic, such as relevant information and precise or specialized vocabulary. The final evaluation score is calculated by deducting from a perfect score assigned by a learning process using editorials and columns from the Mainichi Daily News newspaper. A diagnosis for the essay is also given. In this research, we have done followings : 1. Jess has been public on the Web at http://coca.rd.dnc.ac.jp/jess/. The system is valid for essays of 800 to 1,600 characters ; the program is written in C shell script, jgawk, jsed, and C, and comes to just under 10,000 lines. 2. We investigated the criteria given for scoring essays by statistical approaches, and have revised the model. Better criteria have been adopted. 3. We ported the system of Linux to Windows. In closed environment, the data information such as posted essay and its score are not leaked out of networks.
|