• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

Development of writer support system using the user's intention extraction and automatic text generation

Research Project

Project/Area Number 20K19878
Research Category

Grant-in-Aid for Early-Career Scientists

Allocation TypeMulti-year Fund
Review Section Basic Section 61030:Intelligent informatics-related
Research InstitutionNational Institute of Advanced Industrial Science and Technology

Principal Investigator

Watanabe Kento  国立研究開発法人産業技術総合研究所, 情報・人間工学領域, 研究員 (50828324)

Project Period (FY) 2020-04-01 – 2023-03-31
Project Status Completed (Fiscal Year 2022)
Budget Amount *help
¥4,290,000 (Direct Cost: ¥3,300,000、Indirect Cost: ¥990,000)
Fiscal Year 2022: ¥1,300,000 (Direct Cost: ¥1,000,000、Indirect Cost: ¥300,000)
Fiscal Year 2021: ¥1,300,000 (Direct Cost: ¥1,000,000、Indirect Cost: ¥300,000)
Fiscal Year 2020: ¥1,690,000 (Direct Cost: ¥1,300,000、Indirect Cost: ¥390,000)
Keywords歌詞情報処理 / 自然言語処理 / 音楽情報処理 / ヒューマンコンピュータインタラクション / 創作支援
Outline of Research at the Start

小説や歌詞などの創作的文書の自動生成技術は深層学習の発展を背景に、文法や意味が正しい文を生成できるようになったが、生成文章の内容は一貫性や具体性に欠けるため、作者の意図を反映した文章を生成することは難しいタスクである。本課題では、作者の意図を説明可能なデータ構造として抽出する手法を設計し、さらに抽出された意図構造に基づいた文章を自動生成することで、作文作業がどこまで効率化され、作品の表現力がどこまで高められるかを明らかにする。そのステップとして、(1)作者の意図を表現するデータ構造の設計、(2)意図構造を抽出するインタラクションの設計、(3)作者の意図に基づく作文支援の有用性の調査を進める。

Outline of Final Research Achievements

We have developed a lyric writing support system to assist users who have a clear idea of the content they want to include in their lyrics, but are struggling to come up with appropriate phrases. This system generates and suggests lyrics that reflect the user's intentions, providing inspiration for the creative process. In developing this support system, we found that removing information related to the wording of the lyrics and focusing only on the meaning was effective in enabling the computer to grasp the intended message. To accomplish this, we investigated methods for removing wording information and discovered that by converting the user's input text into an image, we could extract only the intended meaning. By generating text from this image, we were able to improve the accuracy of the user's intent in the generated text. In addition, we developed a lyric generation method that reduces the risk of plagiarism, which further enhances the usefulness of the system.

Academic Significance and Societal Importance of the Research Achievements

本研究によって、画像を用いた情報抽出手法が歌詞生成の性能向上に有効であることも示され、自然言語処理の分野において、意味情報のみを取り出す手法の一つとして、有用な知見を提供することを意味する。また、本研究成果が音楽制作において、作詞者や音楽プロデューサーの創造性を支援することが期待される。特に、作詞に苦手意識を持つ人や初心者にとって、意図を反映した歌詞生成が手助けとなると考えられる。また、著作権侵害の問題が深刻化するGenerative AIにおいて、著作物の剽窃リスクを下げる歌詞生成手法が開発されたことは、AI業界と音楽業界にとっても大きな意義を持つ。

Report

(4 results)
  • 2022 Annual Research Report   Final Research Report ( PDF )
  • 2021 Research-status Report
  • 2020 Research-status Report
  • Research Products

    (8 results)

All 2023 2021 2020

All Journal Article (4 results) (of which Peer Reviewed: 4 results,  Open Access: 2 results) Presentation (4 results) (of which Int'l Joint Research: 3 results)

  • [Journal Article] A Method To Detect Chorus Sections in Lyrics Text2023

    • Author(s)
      Kento Watanabe and Masataka Goto
    • Journal Title

      IEICE Transactions on Information and Systems

      Volume: -

    • Related Report
      2022 Annual Research Report
    • Peer Reviewed
  • [Journal Article] Atypical Lyrics Completion Considering Musical Audio Signals2021

    • Author(s)
      Kento Watanabe and Masataka Goto
    • Journal Title

      Proceedings of the 2nd Workshop on NLP for Music and Spoken Audio

      Volume: 1 Pages: 37-41

    • Related Report
      2021 Research-status Report
    • Peer Reviewed / Open Access
  • [Journal Article] Atypical Lyrics Completion Considering Musical Audio Signals2021

    • Author(s)
      Kento Watanabe and Masataka Goto
    • Journal Title

      Proceedings of the 27th International Conference on Multimedia Modeling

      Volume: 1 Pages: 174-186

    • DOI

      10.1007/978-3-030-67832-6_15

    • ISBN
      9783030678319, 9783030678326
    • Related Report
      2020 Research-status Report
    • Peer Reviewed
  • [Journal Article] Lyrics Information Processing: Analysis, Generation, and Applications2020

    • Author(s)
      Kento Watanabe and Masataka Goto
    • Journal Title

      Proceedings of the 1st Workshop on NLP for Music and Audio

      Volume: 1 Pages: 6-11

    • Related Report
      2020 Research-status Report
    • Peer Reviewed / Open Access
  • [Presentation] 入力文章の内容に沿った新たな歌詞を生成する作詞支援システムと剽窃リスクを下げる歌詞生成手法2023

    • Author(s)
      渡邉 研斗, 後藤 真孝
    • Organizer
      言語処理学会第29回年次大会
    • Related Report
      2022 Annual Research Report
  • [Presentation] Atypical Lyrics Completion Considering Musical Audio Signals2021

    • Author(s)
      Kento Watanabe and Masataka Goto
    • Organizer
      the 2nd Workshop on NLP for Music and Spoken Audio
    • Related Report
      2021 Research-status Report
    • Int'l Joint Research
  • [Presentation] Atypical Lyrics Completion Considering Musical Audio Signals2021

    • Author(s)
      Kento Watanabe and Masataka Goto
    • Organizer
      The 27th International Conference on Multimedia Modeling
    • Related Report
      2020 Research-status Report
    • Int'l Joint Research
  • [Presentation] Lyrics Information Processing: Analysis, Generation, and Applications2020

    • Author(s)
      Kento Watanabe and Masataka Goto
    • Organizer
      The 1st Workshop on NLP for Music and Audio
    • Related Report
      2020 Research-status Report
    • Int'l Joint Research

URL: 

Published: 2020-04-28   Modified: 2024-01-30  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi