• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

Developing a system that automatically evaluates texts

Research Project

Project/Area Number 19300042
Research Category

Grant-in-Aid for Scientific Research (B)

Allocation TypeSingle-year Grants
Section一般
Research Field Intelligent informatics
Research InstitutionTokyo Institute of Technology

Principal Investigator

OKUMURA Manabu  Tokyo Institute of Technology, 精密工学研究所, 教授 (60214079)

Co-Investigator(Kenkyū-buntansha) TAKAMURA Hiroya  東京工業大学, 精密工学研究所, 助教 (80361773)
平尾 努  日本電信電話株式会社, NTTコミュニケーション科学基礎研究所・知識処理研究グループ, 研究員 (40396148)
難波 英嗣  広島市立大学, 情報科学研究科, 講師 (50345378)
Co-Investigator(Renkei-kenkyūsha) HIRAO Tsutomu  日本電信電話株式会社NTTコミュニケーション科学基礎研究所, 知識処理研究グループ, 研究員 (40396148)
NANBA Hidetsugu  広島市立大学, 情報科学研究科, 講師 (50345378)
Project Period (FY) 2007 – 2009
Project Status Completed (Fiscal Year 2009)
Budget Amount *help
¥18,460,000 (Direct Cost: ¥14,200,000、Indirect Cost: ¥4,260,000)
Fiscal Year 2009: ¥4,160,000 (Direct Cost: ¥3,200,000、Indirect Cost: ¥960,000)
Fiscal Year 2008: ¥4,680,000 (Direct Cost: ¥3,600,000、Indirect Cost: ¥1,080,000)
Fiscal Year 2007: ¥9,620,000 (Direct Cost: ¥7,400,000、Indirect Cost: ¥2,220,000)
Keywords情報の信頼性 / テキスト自動要約 / 自動採点 / テキストの質 / 内容の情報量 / テキストの自動要約
Research Abstract

As the evaluation framework for text quality, we developed a statistical method that evaluates local coherence of a text. We made improvements to the entity grid local coherence model for Japanese text, and investigated the effectiveness of taking into account cohesive devices, such as conjunction, explicit reference relation, lexical cohesion, and refining syntactic roles for a topic marker in Japanese. As the evaluation framework for text content, we explored the use of paraphrases for the refinement of traditional automatic methods for summary evaluation.

Report

(4 results)
  • 2009 Annual Research Report   Final Research Report ( PDF )
  • 2008 Annual Research Report
  • 2007 Annual Research Report
  • Research Products

    (17 results)

All 2010 2009 2008 2007

All Journal Article (8 results) (of which Peer Reviewed: 8 results) Presentation (9 results)

  • [Journal Article] 言い換えを用いたテキストの自動評価2010

    • Author(s)
      平原一帆, 難波英嗣, 竹澤寿幸, 奥村学
    • Journal Title

      情報処理学会論文誌データベース Vol.3,No.2

    • NAID

      110007990611

    • Related Report
      2009 Final Research Report
    • Peer Reviewed
  • [Journal Article] テキスト結束性を考慮したentity gridに基づく局所的一貫性モデル2010

    • Author(s)
      横野光, 奥村学
    • Journal Title

      自然言語処理 Vol.17,No.1

      Pages: 161-182

    • NAID

      10027016077

    • Related Report
      2009 Final Research Report
    • Peer Reviewed
  • [Journal Article] 言い換えを用いたテキストの自動評価2010

    • Author(s)
      平原一帆, 難波英嗣, 竹澤寿幸, 奥村学
    • Journal Title

      情報処理学会論文誌データベース Vol.3, No.2(WEB公開)

    • NAID

      110007990611

    • Related Report
      2009 Annual Research Report
    • Peer Reviewed
  • [Journal Article] テキスト結束性を考慮したentity gridに基づく局所的一貫性モデル2010

    • Author(s)
      横野光, 奥村学
    • Journal Title

      自然言語処理 Vol.17, No.1

      Pages: 161-182

    • NAID

      10027016077

    • Related Report
      2009 Annual Research Report
    • Peer Reviewed
  • [Journal Article] Supervise d automatic evaluation for summarizatio n with voted regression model2007

    • Author(s)
      Tsutomu Hirao, Manabu Okumura, Norihi to Yasuda, Hideki Isozaki
    • Journal Title

      Informat ion Processing & Management Vol.43

      Pages: 1521-1535

    • Related Report
      2009 Final Research Report
    • Peer Reviewed
  • [Journal Article] 抜粋による複数文書要約を評価するためのコーパスと評価指標2007

    • Author(s)
      平尾努, 奥村学, 福島孝博, 難波英嗣, 野畑周, 磯崎秀樹
    • Journal Title

      情報処理学会論文誌データベース Vol.48

      Pages: 60-68

    • NAID

      110006390951

    • Related Report
      2009 Final Research Report
    • Peer Reviewed
  • [Journal Article] Supervised automatic evaluation for summarization with voted regression model2007

    • Author(s)
      Tsutomu Hirao, Manabu Okumura, Norihito Yasuda and Hideki Isozaki
    • Journal Title

      Information Processing & Management 43

      Pages: 1521-1535

    • NAID

      10022007200

    • Related Report
      2007 Annual Research Report
    • Peer Reviewed
  • [Journal Article] 抜粋による複数文書要約を評価するためのコーパスと評価指標2007

    • Author(s)
      平尾 努, 奥村 学, 福島孝博, 難波 英嗣, 野畑周, 磯崎 秀樹
    • Journal Title

      情報処理学会論文誌データベース 48

      Pages: 60-68

    • NAID

      110006390951

    • Related Report
      2007 Annual Research Report
    • Peer Reviewed
  • [Presentation] Incorporating Cohesive Devices into Entity Grid Model in Evaluating Local Coherence of Japanese Text2010

    • Author(s)
      Hikaru YOKONO, Manabu OKUMURA
    • Organizer
      CICLing2010
    • Place of Presentation
      Iasi, Romania
    • Year and Date
      2010-03-23
    • Related Report
      2009 Final Research Report
  • [Presentation] Incorporating Cohesive Devices into Entity Grid Model in Evaluating Local Coherence of Japanese Text2010

    • Author(s)
      Hikaru YOKONO, Manabu OKUMURA
    • Organizer
      CLCLing
    • Place of Presentation
      Iasi, Romania
    • Year and Date
      2010-03-23
    • Related Report
      2009 Annual Research Report
  • [Presentation] 言い換えを用いたテキストの自動評価2010

    • Author(s)
      平原一帆, 難波英嗣, 竹澤寿幸, 奥村学
    • Organizer
      言語処理学会第16回年次大会
    • Place of Presentation
      東京大学
    • Year and Date
      2010-03-09
    • Related Report
      2009 Annual Research Report 2009 Final Research Report
  • [Presentation] Automatic Evaluation of Texts by Using Paraphrases2009

    • Author(s)
      Kazuho Hirahara, Hidetsugu Nanba, Toshiyuki Takezawa, Manabu Okumura
    • Organizer
      the 4th Language & Technology Conference(LTC 2009)
    • Place of Presentation
      Poznan, Poland
    • Year and Date
      2009-11-07
    • Related Report
      2009 Final Research Report
  • [Presentation] Automatic Evaluation of Texts by Using Paraphrases2009

    • Author(s)
      Kazuho Hirahara, Hidetsugu Nanba, Toshiyuki Takezawa, Manabu Okumura
    • Organizer
      the 4th Language & Technology Conference (LTC 2009)
    • Place of Presentation
      Poznan, Poland
    • Year and Date
      2009-11-07
    • Related Report
      2009 Annual Research Report
  • [Presentation] テキストの自動評価システムの開発2009

    • Author(s)
      奥村学
    • Organizer
      電子情報通信学会思考と言語研究会
    • Place of Presentation
      機械振興会館
    • Year and Date
      2009-06-18
    • Related Report
      2009 Annual Research Report 2009 Final Research Report
  • [Presentation] 言い換えを用いたテキストの自動評価2009

    • Author(s)
      平原一帆, 難波英嗣, 竹澤寿幸, 奥村学
    • Organizer
      情報処理学会自然言語処理研究会
    • Place of Presentation
      東京工業大学
    • Year and Date
      2009-05-22
    • Related Report
      2009 Annual Research Report 2009 Final Research Report
  • [Presentation] テキスト結束性判定のためのentity gridモデルの素性の検討2009

    • Author(s)
      横野光, 奥村学
    • Organizer
      情報処理学会第189回自然言語処理研究会
    • Place of Presentation
      お茶の水女子大学
    • Year and Date
      2009-01-23
    • Related Report
      2009 Final Research Report 2008 Annual Research Report
  • [Presentation] 原文からの抜粋度合を考慮した要約の自動評価法2008

    • Author(s)
      平原一帆, 難波英嗣, 竹澤寿幸, 奥村学, 平尾努
    • Organizer
      言語処理学会第14回年次大会
    • Place of Presentation
      東京大学
    • Year and Date
      2008-03-19
    • Related Report
      2009 Final Research Report 2007 Annual Research Report

URL: 

Published: 2007-04-01   Modified: 2016-04-21  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi