• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to project page

2017 Fiscal Year Annual Research Report

脳と心を持たせる進化的アドバンスド知能ロボットの創造

Research Project

Project/Area Number 15H01712
Research InstitutionThe University of Tokushima

Principal Investigator

任 福継  徳島大学, 大学院社会産業理工学研究部(理工学域), 教授 (20264947)

Co-Investigator(Kenkyū-buntansha) 呉 景龍  岡山大学, 自然科学研究科, 教授 (30294648)
松本 和幸  徳島大学, 大学院社会産業理工学研究部(理工学域), 助教 (90509754)
Project Period (FY) 2015-04-01 – 2019-03-31
Keywords感性情報学 / 知能ロボディックス / 人工知能 / 情報システム / 機械学習 / 感情コーパス / 自然言語理解 / 心的状態遷移ネットワーク
Outline of Annual Research Achievements

本研究では、「心状態遷移ネットワーク」を発展させ、深層学習を活かした進化的脳・心をもつロボットを創造する。平成29年度では、次の研究を行い、それぞれの研究業績を下記に概要する。
顔表情認識及び会話と自然言語理解を通じ、ロボットの感情を創生する研究した。
近年、ロボットのIQは飛躍的に進展があったが、そのEQ(感情指数)はあまり進んでいない。人間の脳機能、特に感情の発生・遷移のメカニズムについて、いままで得られた成果が少なく、活用できるものがあまりあげられない。よって、我々は、「心的状態遷移ネットワーク」理論を発展し、まず人間の感情認知機能をロボットに組み込んで、ロボットのEQを研究した。具体的には、会話における言語表現に現れる感情要素を抽出し、自然言語理解を通じて、話者の感情を分析する。また、話者の顔表情を深層学習を通じて解析して、顔表情から感情認識アルゴリズムを開発した。言葉使い及び顔表情を総合的に生かして、話者の感情(心的状態)を推定した。一方、このような方法を発展し、ロボット自身の感情を創造した。
会話解析において、我々は、介護ロボットが具えるべき対話機能や行動、想定されるシナリオなどを設計し、スクリプトを活かし、特定な場面における自然言語理解機能を開発した。看護現場に収集したデータを検討し、10個スクリプトを作成し、実験を行ない、その有効性を確かめることができた。なお、言葉使いに基づく感情認識には、予め開発した感情辞書と感情コーパスを活用した。
顔表情解析において、まず、50人分の顔表情データベースを構築した。これは静止顔データではなく、動的な顔表情データである。従来の深層学習方法では、静止画に対したものが多くて、動画に適応な方法がすくない。我々は、動的な顔表情データに適用な機械学習方法を開発した。なお、推定精度は高くない点について今後、引き続き検討していく。

Current Status of Research Progress
Current Status of Research Progress

2: Research has progressed on the whole more than it was originally planned.

Reason

本研究では、「心状態遷移ネットワーク」を発展させ、深層学習を活かした進化的脳・心をもつロボットを創造する。
平成29年度では、顔表情認識及び会話と自然言語理解を通じ、ロボットの感情を創生する研究した。
予算上の事情で、当初予定の2足歩行できるヒューマノイドロボットを購入できなかったが、ロボットの感情創生について、我々の持っている坐姿勢のヒューマノイドロボットを活かし、実証実験を行なった。今年度の結果から見ても、特に支障がなく、順調に進展している。

Strategy for Future Research Activity

当初の計画通り、引き続き下記のように実施する。
1.スーパー関数を活かした会話意味理解手法のプログラムを実装
2.動画顔表情データベースに基づく感情の認識アルゴリズムの改善
3.ロボットの心の創造及びその応用に関する評価
4.ロボットに脳と心を持たせるかどうかに関する検証
5.プロトタイプシステムの構築・テスト・評価

  • Research Products

    (35 results)

All 2018 2017

All Journal Article (6 results) (of which Int'l Joint Research: 4 results,  Peer Reviewed: 6 results) Presentation (29 results) (of which Int'l Joint Research: 24 results,  Invited: 3 results)

  • [Journal Article] Detecting Users' Anomalous Emotion Using Social Media for Business Intelligence2018

    • Author(s)
      Xiao Sun, Chen Zhang, Guoqiang Li, Daniel Sun, Fuji Ren, Albert Zomaya and Rajiv Ranjan
    • Journal Title

      Journal of Computational Science

      Volume: 25 Pages: 193-200

    • DOI

      10.1016/j.jocs.2017.05.029

    • Peer Reviewed / Int'l Joint Research
  • [Journal Article] Trends Detection of Flu based on Essemble Models with Emotional Factors from Social Networks2017

    • Author(s)
      Xiao Sun, Fuji Ren and Jiaqi Ye
    • Journal Title

      IEEJ Transactions on Electrical and Electronic Engineering (TEEE)

      Volume: 12 Pages: 388-396

    • DOI

      10.1002/tee.22389

    • Peer Reviewed / Int'l Joint Research
  • [Journal Article] Ego-state Estimation from Short Texts Based on Sentence Distributed Representation2017

    • Author(s)
      Kazuyuki Matsumoto, Satoshi Tanaka, Minoru Yoshida, Kenji Kita and Fuji Ren
    • Journal Title

      International Journal of Advanced Intelligence

      Volume: 9 Pages: 145-161

    • Peer Reviewed
  • [Journal Article] Voice conversion based on RBF neural network2017

    • Author(s)
      Xun Feng, Hongjun Ni and Fuji Ren
    • Journal Title

      International Journal of Advanced Intelligence

      Volume: 9 Pages: 163-173

    • Peer Reviewed / Int'l Joint Research
  • [Journal Article] Text Classification Based on Word Co-occurrence with Background knowledge2017

    • Author(s)
      Jiawen Deng, Mingyu Huang and Fuji Ren
    • Journal Title

      International Journal of Advanced Intelligence

      Volume: 9 Pages: 29-42

    • Peer Reviewed / Int'l Joint Research
  • [Journal Article] Disambiguating Users' Temporal Intent in Search Queries with Deep Neural Networks2017

    • Author(s)
      XIN KANG, Fuji Ren and Yunong Wu
    • Journal Title

      International Journal of Advanced Intelligence

      Volume: 9 Pages: 11-28

    • Peer Reviewed
  • [Presentation] Intellectual business society and Jobless society: Unclear power of artificial intelligence2017

    • Author(s)
      Fuji Ren
    • Organizer
      2017 GLOBAL UNMANNED SYSTEM CONFERENCE
    • Int'l Joint Research / Invited
  • [Presentation] TUA1 at the NTCIR-13 Actionable Knowledge Graph Task: Sampling Related Actions from Online Searching2017

    • Author(s)
      XIN KANG, Yunong Wu and Fuji Ren
    • Organizer
      Proceedings of the 13th NTCIR Conference on Evaluation of Information Access Technologies
  • [Presentation] Medweb Task: Identify Multi-Symptoms from Tweets Based on Active Learning and Semantic Information2017

    • Author(s)
      Chao Li, XIN KANG and Fuji Ren
    • Organizer
      Proceedings of the 13th NTCIR Conference on Evaluation of Information Access Technologies
  • [Presentation] TUA1 at the NTCIR-13 OpenLiveQ Task2017

    • Author(s)
      Mengjia He, XIN KANG and Fuji Ren
    • Organizer
      Proceedings of the 13th NTCIR Conference on Evaluation of Information Access Technologies
  • [Presentation] TUA1 at NTCIR-13 Short Text Conversation 2 Task2017

    • Author(s)
      Yunong Wu, XIN KANG, Kenji Kita and Fuji Ren
    • Organizer
      Proceedings of the 13th NTCIR Conference on Evaluation of Information Access Technologies
  • [Presentation] RESEARCH ON CONSTRUCTION AND ANALYSIS OF JAPANESE-CHINESE EMOTIONAL EXPRESSION CORPUS2017

    • Author(s)
      Ruixue Xia, Fuji Ren, XIN KANG and Shun Nishide
    • Organizer
      The 12th International Conference on Natural Language Processing and Knowledge Engineering
    • Int'l Joint Research
  • [Presentation] Learning Efficient Drawing Sequence Through Training of Recurrent Neural Network Model2017

    • Author(s)
      Yasuda Tadayoshi, Yamashita Maki, Shun Nishide, XIN KANG and Fuji Ren
    • Organizer
      The 12th International Conference on Natural Language Processing and Knowledge Engineering
    • Int'l Joint Research
  • [Presentation] Exploring the Relations Between Posts and Comments for Short Text Conversation2017

    • Author(s)
      Yunong Wu, Kenji Kita, Kazuyuki Matsumoto, XIN KANG and Fuji Ren
    • Organizer
      The 12th International Conference on Natural Language Processing and Knowledge Engineering
    • Int'l Joint Research
  • [Presentation] Realization and Improvement of Robot Object Recognition2017

    • Author(s)
      Jie Shen, Ziyun Jiao, Fuji Ren, XIN KANG, Shun Nishide, Suichun Qu and Yi Yang
    • Organizer
      The 12th International Conference on Natural Language Processing and Knowledge Engineering
    • Int'l Joint Research
  • [Presentation] Building Emotional Corpus for Microblogging Emoticons2017

    • Author(s)
      Qian Zhang, Fuji Ren, XIN KANG, Shun Nishide, Shibing Zhang and Xiaoge Zhang
    • Organizer
      The 12th International Conference on Natural Language Processing and Knowledge Engineering
    • Int'l Joint Research
  • [Presentation] Human Pose Recognition in Robots Based on Angle of Joint Vector2017

    • Author(s)
      Yuming Xu, Fuji Ren, XIN KANG, Shun Nishide and Ping Jiang
    • Organizer
      The 12th International Conference on Natural Language Processing and Knowledge Engineering
    • Int'l Joint Research
  • [Presentation] Recognizing facial emotions in the video2017

    • Author(s)
      Qianlu Huang, Fuji Ren, XIN KANG, Shun Nishide and Qiang Wang
    • Organizer
      The 12th International Conference on Natural Language Processing and Knowledge Engineering
    • Int'l Joint Research
  • [Presentation] Mining Actionable Intents to Facilitate Search Engine Users' Actions2017

    • Author(s)
      XIN KANG, Yunong Wu and Fuji Ren
    • Organizer
      The 12th International Conference on Natural Language Processing and Knowledge Engineering
    • Int'l Joint Research
  • [Presentation] Emotion Robot and Advanced Intelligence2017

    • Author(s)
      Fuji Ren
    • Organizer
      The 12th International Conference on Natural Language Processing and Knowledge Engineering
    • Int'l Joint Research / Invited
  • [Presentation] Your WiFi Knows How You Feel: Leveraging Commodity WiFi Devices for Emotion Sensing2017

    • Author(s)
      Yu Gu, Yantong Wang, Tao Liu and Fuji Ren
    • Organizer
      The 12th International Conference on Natural Language Processing and Knowledge Engineering
    • Int'l Joint Research
  • [Presentation] Selected LBP-TOP based Dynamic Facial Expression Recognition on Ren-VFEdb2017

    • Author(s)
      Duo Feng and Fuji Ren
    • Organizer
      The 12th International Conference on Natural Language Processing and Knowledge Engineering
    • Int'l Joint Research
  • [Presentation] Facial Expression Recognition with Convolutional Neural Networks Based on Joint Loss2017

    • Author(s)
      Xiaohua Wang, Muzi Peng, Min Hu and Fuji Ren
    • Organizer
      The 12th International Conference on Natural Language Processing and Knowledge Engineering
    • Int'l Joint Research
  • [Presentation] An improved algorithm of human-robot interaction oriented text similarity calculation2017

    • Author(s)
      Haowen Wang, Min Hu, Fuji Ren and Xiaohua Wang
    • Organizer
      The 12th International Conference on Natural Language Processing and Knowledge Engineering
    • Int'l Joint Research
  • [Presentation] Multi-label Emotion Computing Using Dense Neural Network Based on Distance Feature Represented Ren_CECps2017

    • Author(s)
      Ning Liu and Fuji Ren
    • Organizer
      The 12th International Conference on Natural Language Processing and Knowledge Engineering
    • Int'l Joint Research
  • [Presentation] Facial Expression Recognition Based on Dynamic Fuzzy Density2017

    • Author(s)
      Yanqiu Li, Fuji Ren and Min Hu
    • Organizer
      The 3rd International Conference on Fuzzy Systems and Data Mining
    • Int'l Joint Research
  • [Presentation] Facial Expression Recognition under Partial Occlusion Based on Fusion of Global and Local Features2017

    • Author(s)
      Xiaohua Wang, Chen Xia, Min Hu and Fuji Ren
    • Organizer
      The 9th International Conference on Graphic and Image Processing
    • Int'l Joint Research
  • [Presentation] Improved Facial Expression Recognition Method Based on ROI Deep Convolutional Neutral Network2017

    • Author(s)
      Xiao Sun, Man Lv, Changqin Quan and Fuji Ren
    • Organizer
      7th International Conference on Affective Computing and Intelligent Interaction
    • Int'l Joint Research
  • [Presentation] A Fusion Decision Method Based on the Dynamic Fuzzy Density Assignment2017

    • Author(s)
      Yanqiu Li, Fuji Ren and Min Hu
    • Organizer
      2017 International Conference on Advances in Image Processing
    • Int'l Joint Research
  • [Presentation] Silence is Golden: Exploring Ambient Signals for Detecting Motions in a Real-time Manner2017

    • Author(s)
      Yu Gu, Jinhai Zhan, Fuji Ren and Xiaoyan Wang
    • Organizer
      IEEE 86th Vehicular Technology Conference
    • Int'l Joint Research / Invited
  • [Presentation] Activity Recognition via Channel Response: From Theoretical Analysis to Real-world Experiments2017

    • Author(s)
      Yu Gu, Jianwen Tian, Liwen Zhang, Zhi Liu, Fuji Ren and Xiaoyan Wang
    • Organizer
      IEEE 85th Vehicular Technology Conference: VTC2017-Spring
    • Int'l Joint Research
  • [Presentation] Human-Machine Conversation Based on Hybrid Neural Network2017

    • Author(s)
      Xiao Sun, Xiaoqi Peng, Fuji Ren and Yun Xue
    • Organizer
      2017 IEEE International Conference on Computational Science and Engineering (CSE) and Embedded and Ubiquitous Computing (EUC)
    • Int'l Joint Research
  • [Presentation] Discernibility Matrix and Rules Acquisition Based Chinese Question Answering System2017

    • Author(s)
      Zhao Han, Duoqian Miao, Fuji Ren and Hongyun Zhang
    • Organizer
      International Joint Conference on Rough Sets
    • Int'l Joint Research
  • [Presentation] Extraction emotion from spoken language based on the language information2017

    • Author(s)
      Yoshie Setsu, Xin Kang, Shun Nishide, Fuji Ren
    • Organizer
      The 31st Annual Conference of the Japanese Society for Artificial Intelligence
  • [Presentation] Numerical simulation of VAWT on the effects of rotation cylinder2017

    • Author(s)
      Shuda Xin, Yang Cao and Fuji Ren
    • Organizer
      ACMME 2017 5th Asia Conference on Mechanical and Materials Engineering
    • Int'l Joint Research

URL: 

Published: 2018-12-17  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi