• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

Roleplay Interactive System to Model Affective Information from Stituation

Research Project

Project/Area Number 17K17809
Research Category

Grant-in-Aid for Young Scientists (B)

Allocation TypeMulti-year Fund
Research Field Intelligent informatics
Kansei informatics
Research InstitutionOsaka Institute of Technology (2019-2021)
Toyohashi University of Technology (2017-2018)

Principal Investigator

Ueno Miki  大阪工業大学, 工学部, 講師 (60757368)

Project Period (FY) 2017-04-01 – 2022-03-31
Project Status Completed (Fiscal Year 2021)
Budget Amount *help
¥4,420,000 (Direct Cost: ¥3,400,000、Indirect Cost: ¥1,020,000)
Fiscal Year 2020: ¥1,040,000 (Direct Cost: ¥800,000、Indirect Cost: ¥240,000)
Fiscal Year 2019: ¥910,000 (Direct Cost: ¥700,000、Indirect Cost: ¥210,000)
Fiscal Year 2018: ¥1,300,000 (Direct Cost: ¥1,000,000、Indirect Cost: ¥300,000)
Fiscal Year 2017: ¥1,170,000 (Direct Cost: ¥900,000、Indirect Cost: ¥270,000)
Keywords個性推定 / 対話的システム / 創作支援 / 深層学習 / 感性情報工学 / 助言出力 / 文字生成 / 質感選定 / 機械学習 / 対話システム / 絵のモデル化 / 画像と言語の対応 / 質感の学習 / 感性情報処理 / ロールプレイ対話 / メタデータ構築 / ストーリー解析 / 感性情報 / 人工知能 / 感性情報学 / 情報工学
Outline of Final Research Achievements

The aim of this research is to model affective information. If computers understand certain situations, computers output comments for appropriate activity to humans.
In this research, I proposed two types of story generation systems and three types of interactive systems which guide for humans to enhance creativity.

Academic Significance and Societal Importance of the Research Achievements

人が想起する情報を定量化すること,計算機が創作することに世の注目が集まっている.
人工知知能システムの中でも挑戦的な課題だが,人が協調する社会を目指して,画像中の注視箇所から得られる情報から人が想起する情報を得るシステムの構築をしている.
現状本研究ではユーザが入力した情報から限定的ではあるが対話的に助言を出すことが可能であり,データの大規模化によって,さらに今後の発展が見込まれる.

Report

(6 results)
  • 2021 Annual Research Report   Final Research Report ( PDF )
  • 2020 Research-status Report
  • 2019 Research-status Report
  • 2018 Research-status Report
  • 2017 Research-status Report
  • Research Products

    (28 results)

All 2021 2020 2019 2018 2017

All Journal Article (12 results) (of which Open Access: 3 results,  Peer Reviewed: 9 results) Presentation (16 results) (of which Int'l Joint Research: 6 results,  Invited: 1 results)

  • [Journal Article] Automatic Prediction of Photographic Paper based on Photo Contest Information2021

    • Author(s)
      平井 喜一、上野 未貴
    • Journal Title

      Proceedings of the Annual Conference of JSAI

      Volume: JSAI2021 Issue: 0 Pages: 3D2OS12b04-3D2OS12b04

    • DOI

      10.11517/pjsai.JSAI2021.0_3D2OS12b04

    • NAID

      130008051674

    • Related Report
      2021 Annual Research Report
    • Open Access
  • [Journal Article] Adjustment of Formal and Casual Handwritten Characters by means of Deep Learning2021

    • Author(s)
      突廻 恵太、上野 未貴
    • Journal Title

      Proceedings of the Annual Conference of JSAI

      Volume: JSAI2021 Issue: 0 Pages: 3D1OS12a04-3D1OS12a04

    • DOI

      10.11517/pjsai.JSAI2021.0_3D1OS12a04

    • NAID

      130008051684

    • Related Report
      2021 Annual Research Report
    • Open Access
  • [Journal Article] Photograph Creation Support System to Analyze Point of Praising Photography2021

    • Author(s)
      青木 俊憲、上野 未貴
    • Journal Title

      Proceedings of the Annual Conference of JSAI

      Volume: JSAI2021 Issue: 0 Pages: 3D2OS12b05-3D2OS12b05

    • DOI

      10.11517/pjsai.JSAI2021.0_3D2OS12b05

    • NAID

      130008051678

    • Related Report
      2021 Annual Research Report
    • Open Access
  • [Journal Article] Photograph Classification Based on Main Theme and Multiple Values by Deep Neural Networks", Advances in Intelligent Systems and Computing2021

    • Author(s)
      Toshinori Aoki, Miki Ueno
    • Journal Title

      Distributed Computing and Artificial Intelligence, 17th International Conference

      Volume: 1237 Pages: 206-210

    • DOI

      10.1007/978-3-030-53036-5_22

    • ISBN
      9783030530358, 9783030530365
    • Related Report
      2020 Research-status Report
    • Peer Reviewed
  • [Journal Article] Analysis of Partial Semantic Segmentation for Images of Four-Scene Comics2021

    • Author(s)
      Akira Terauchi, Naoki Mori, Miki Ueno
    • Journal Title

      Distributed Computing and Artificial Intelligence, 17th International Conference

      Volume: 1237 Pages: 51-59

    • Related Report
      2020 Research-status Report
    • Peer Reviewed
  • [Journal Article] A Project of “Developing a Dataset and Framework to Analyse Stories in Four-scene Comics Using Deep Neural Networks”2019

    • Author(s)
      上野 未貴
    • Journal Title

      NIHON GAZO GAKKAISHI (Journal of the Imaging Society of Japan)

      Volume: 58 Issue: 5 Pages: 545-551

    • DOI

      10.11370/isj.58.545

    • NAID

      130007726205

    • ISSN
      1344-4425, 1880-4675
    • Year and Date
      2019-10-10
    • Related Report
      2019 Research-status Report
    • Peer Reviewed
  • [Journal Article] A Comparative Study of The Corpus for Story Creation System2019

    • Author(s)
      Haruka Takahashi, Miki Ueno, Hitoshi Isahara
    • Journal Title

      Advances in Intelligent Systems and Computing

      Volume: 1003 Pages: 18-27

    • DOI

      10.1007/978-3-030-23887-2_3

    • ISBN
      9783030238865, 9783030238872
    • Related Report
      2019 Research-status Report
    • Peer Reviewed
  • [Journal Article] Can Computers Understand Picture Books and Comics?2019

    • Author(s)
      Miki Ueno, Kiyohito Fukuda, Naoki Mori
    • Journal Title

      Post-Narratology Through Computational and Cognitive Approaches

      Volume: - Pages: 318-350

    • DOI

      10.4018/978-1-5225-7979-3.ch008

    • Related Report
      2018 Research-status Report
    • Peer Reviewed
  • [Journal Article] Estimating the Purpose of Discard in Mahjong to Support Learning for Beginners2018

    • Author(s)
      Miki Ueno, Daiki Hayakawa, Hitoshi Isahara
    • Journal Title

      Advances in Intelligent Systems and Computing

      Volume: 800 Pages: 155-163

    • DOI

      10.1007/978-3-319-94649-8_19

    • ISBN
      9783319946481, 9783319946498
    • Related Report
      2018 Research-status Report
    • Peer Reviewed
  • [Journal Article] Structure Analysis on Common Plot in Four-Scene Comic Story Dataset2018

    • Author(s)
      Miki Ueno
    • Journal Title

      MultiMedia Modeling

      Volume: 11296 Pages: 625-636

    • DOI

      10.1007/978-3-030-05716-9_56

    • ISBN
      9783030057152, 9783030057169
    • Related Report
      2018 Research-status Report
    • Peer Reviewed
  • [Journal Article] Artificial Curation for Creating Learners Manual based on Data Semantics and User Personality2017

    • Author(s)
      Miki Ueno, Masataka Morishita, Hitoshi Isahara
    • Journal Title

      Advances in Intelligent Systems and Computing

      Volume: 620

    • Related Report
      2017 Research-status Report
    • Peer Reviewed
  • [Journal Article] Classification of Two Comic Books based on Convolutional Neural Networks2017

    • Author(s)
      Miki Ueno, Toshinori Suenaga, Hitoshi Isahara
    • Journal Title

      Advances in Distributed Computing and Artificial Intelligence Journal

      Volume: 6

    • Related Report
      2017 Research-status Report
    • Peer Reviewed
  • [Presentation] 深層学習を用いた手書き文字のフォーマルとカジュアルの分類2021

    • Author(s)
      突廻 恵太, 上野 未貴
    • Organizer
      HAIシンポジウム
    • Related Report
      2020 Research-status Report
  • [Presentation] 写真画像に基づく自動用紙推定の提案2021

    • Author(s)
      平井 喜一, 上野 未貴
    • Organizer
      HAIシンポジウム
    • Related Report
      2020 Research-status Report
  • [Presentation] 撮影技術習得を目的とした複数の評価特徴に基づく写真創作の解析2020

    • Author(s)
      青木 俊憲, 上野 未貴
    • Organizer
      人工知能学会全国大会
    • Related Report
      2020 Research-status Report
  • [Presentation] 分散表現に基づく漫画の画像と台詞の対応識別2020

    • Author(s)
      寺内 光, 森 直樹, 上野 未貴
    • Organizer
      人工知能学会全国大会
    • Related Report
      2020 Research-status Report
  • [Presentation] Considering Creative Stories from Interaction Perspective2019

    • Author(s)
      Miki Ueno
    • Organizer
      7th International Conference on Human-Agent Interaction
    • Related Report
      2019 Research-status Report
    • Int'l Joint Research / Invited
  • [Presentation] 創作者と人工知能が創る創作の未来2019

    • Author(s)
      上野 未貴
    • Organizer
      人工知能学会全国大会
    • Related Report
      2019 Research-status Report
  • [Presentation] 創作支援を目的とした類似度調節によるストーリー生成システムの構築2019

    • Author(s)
      高橋 遼, 上野 未貴, 井佐原 均
    • Organizer
      人工知能学会全国大会
    • Related Report
      2019 Research-status Report
  • [Presentation] 中役割を考慮した物語文の類似文検索による創作者の支援と感性の解析2019

    • Author(s)
      葛井 健文, 上野 未貴, 井佐原 均
    • Organizer
      人工知能学会全国大会
    • Related Report
      2019 Research-status Report
  • [Presentation] Novel deep learning method for understanding Japanese comics2019

    • Author(s)
      Ryo Iwasaki, Koichi Sato, Miki Ueno, Naoki Mori, Makoto Okada
    • Organizer
      24th International Symposium on Artificial Life and Robotics
    • Related Report
      2018 Research-status Report
    • Int'l Joint Research
  • [Presentation] An Analysis on the Process of Creating Stories by the Creation Support System2017

    • Author(s)
      Takefumi Katsui, Miki Ueno, Hitoshi Isahara
    • Organizer
      International Conference on Advanced Informatics: Concept Theory and Applications
    • Related Report
      2017 Research-status Report
    • Int'l Joint Research
  • [Presentation] Analysis on Complex Emotions in Four-Scene Comics for Story Caption Generation2017

    • Author(s)
      Miki Ueno, Hitoshi Isahara
    • Organizer
      The 6th Asian Conference on Information Systems
    • Related Report
      2017 Research-status Report
    • Int'l Joint Research
  • [Presentation] Story Pattern Analysis based on Scene Order Information in Four-Scene Comics2017

    • Author(s)
      Miki Ueno, Hitoshi Isahara
    • Organizer
      2017 14th IAPR International Conference on Document Analysis and Recognition (ICDAR),
    • Related Report
      2017 Research-status Report
    • Int'l Joint Research
  • [Presentation] Comic Book Interpretation based on Deep Neural Networks2017

    • Author(s)
      Miki Ueno
    • Organizer
      First International Workshop on Symbolic-Neural Learning
    • Related Report
      2017 Research-status Report
    • Int'l Joint Research
  • [Presentation] 質問集合とグラフに基づく物語全体の流れを管理可能な創作支援システムの提案2017

    • Author(s)
      葛井 健文 上野 未貴 井佐原 均
    • Organizer
      人工知能学会全国大会
    • Related Report
      2017 Research-status Report
  • [Presentation] 漫画中の表現獲得方法に基づくストーリー理解過程の解析2017

    • Author(s)
      上野 未貴, 末長 寿規, 井佐原 均
    • Organizer
      人工知能学会全国大会
    • Related Report
      2017 Research-status Report
  • [Presentation] 麻雀初心者に向けた役作成のヒント例示システムの構築2017

    • Author(s)
      早川 大貴,上野 未貴,井佐原 均
    • Organizer
      第38回ゲーム情報学発表会
    • Related Report
      2017 Research-status Report

URL: 

Published: 2017-04-28   Modified: 2023-03-16  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi