• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to project page

2016 Fiscal Year Annual Research Report

脳と心を持たせる進化的アドバンスド知能ロボットの創造

Research Project

Project/Area Number 15H01712
Research InstitutionThe University of Tokushima

Principal Investigator

任 福継  徳島大学, 大学院理工学研究部, 教授 (20264947)

Co-Investigator(Kenkyū-buntansha) 呉 景龍  岡山大学, 自然科学研究科, 教授 (30294648)
松本 和幸  徳島大学, 大学院理工学研究部, 助教 (90509754)
Project Period (FY) 2015-04-01 – 2019-03-31
Keywords知能ロボティックス / マルチモーダルインターフェース / 感情認識 / 心状態遷移ネットワーク / ロボットの脳と心 / 感情コーパス
Outline of Annual Research Achievements

本研究では、「アドバンスド知能」と「心的状態遷移ネットワーク」に基づいて、ロボットに脳と心を持たせた進化的ロボットの構築を目的とするものである。平成28年度は、ロボットの心の創造をメインに、感情コーパスの充実及び言語理解と感情解析を行ってきた。具体的には、以下のように研究を実施した。
1.感情コーパスの充実と感情認識精度の向上に関する研究を行った。特に、顔表情コーパスについて、従来、静止画コーパスを開発したが、静止画だけで感情推定精度が低いので、今年度では、動画コーパスを試行錯誤しながら、開発してみた。動画感情コーパスを作成するには、時間と労力がかかるが、いくつかの経験が収められた。特に、動画感情コーパスを構築するとき、場面の設定、温度や照明などが工夫しなければならない。例えば、暑いとき、喜びや平静の感情が出にくいので、避ける必要がある。
2.深層学習アルゴリズムの実装とスーパー関数を活かした言語理解に関する研究を行った。深層学習手法DNNを活かして、3千万くらいのデータを対象として、解析を行った。その結果から、深層学習手法で、スーパー関数を導入すると、感情認識精度が向上されることが分かった。
3.ロボットの脳と心の再定義と感情認識に関する実験を行なった。従来、提案した「心状態遷移ネットワーク」を発展して、ロボットの脳がIQ、ロボットの心がEQ、そしてIQとEQの関連性を研究した。発表できる成果がまだ得られなかったが、今後の研究方向性が明らかにした。また、ヒューマノイドロボットを使って、自動的にロボットの表情生成アルゴリズムを開発した。

Current Status of Research Progress
Current Status of Research Progress

2: Research has progressed on the whole more than it was originally planned.

Reason

本研究の最初予定は、「アドバンスド知能」と、これまで開発された「心的状態遷移ネットワーク」を発展させ、多層思考モデルに深層学習を活かした進化的脳・心を持つロボットを創造する。なお、ハードウェアとしてのロボットの開発は行わず、表情変化などの機能を持ち、2足歩行できるヒューマノイドロボットを特製・購入して実験に用いるが、予算上の事情で、2足歩行できるヒューマノイドロボットを購入できなかった。しかしながら、ロボットの感情表現およびロボットの脳の実証実験は2足歩行ヒューマノイドロボットを使わず、我々のもっている坐姿勢のヒューマノイドロボットを活かし、模擬手法を提案した。今年度の結果から見て、特に支障がなく、順調に進展している。

Strategy for Future Research Activity

当初の計画通り、引き続き下記のように実施する。
1.ロボットのEQ
2.会話と自然言語理解
3.顔表情データベースの構築
4.介護ロボットのシナリオの試験
5.ロボットの感情創造

  • Research Products

    (24 results)

All 2017 2016

All Journal Article (11 results) (of which Int'l Joint Research: 7 results,  Peer Reviewed: 11 results,  Acknowledgement Compliant: 10 results) Presentation (13 results) (of which Int'l Joint Research: 12 results,  Invited: 1 results)

  • [Journal Article] Trends Detection of Flu based on Essemble Models with Emotional Factors from Social Networks2017

    • Author(s)
      Xiao Sun, Fuji Ren and Jiaqi Ye
    • Journal Title

      IEEJ Transactions on Electrical and Electronic Engineering (TEEE)

      Volume: 12 Pages: 388-396

    • DOI

      10.1002/tee.22389

    • Peer Reviewed / Int'l Joint Research
  • [Journal Article] Facial expression recognition method based on multi-regional D-S evidences theory fusion2017

    • Author(s)
      Zhong Huang, Fuji Ren
    • Journal Title

      IEEJ Transactions on Electrical and Electronic Engineering

      Volume: 12 Pages: 251-261

    • DOI

      10.1002/tee.22372

    • Peer Reviewed / Int'l Joint Research / Acknowledgement Compliant
  • [Journal Article] Refinement by Filtering Translation Candidates and Similarity Based Approach to Expand Emotion Tagged Corpus2017

    • Author(s)
      Kazuyuki Matsumoto, Fuji Ren, Minoru Yoshida and Kenji Kita
    • Journal Title

      Communications in Computer and Information Science

      Volume: 631 Pages: 260-280

    • DOI

      10.1007/978-3-319-52758-1_15

    • Peer Reviewed / Acknowledgement Compliant
  • [Journal Article] Automatic facial expression learning method based on humanoid robot XIN-REN2016

    • Author(s)
      Fuji Ren, Zhong Huang
    • Journal Title

      IEEE Transactions on Human-Machine Systems

      Volume: 46 Pages: 810-821

    • DOI

      10.1109/THMS.2016.2599495

    • Peer Reviewed / Int'l Joint Research / Acknowledgement Compliant
  • [Journal Article] Variable Differently Implicational Inference for R- and S-Implications2016

    • Author(s)
      Yiming Tang, Fuji ren
    • Journal Title

      International Journal of Information technology & Decision Making

      Volume: 15 Pages: 1235-1264

    • DOI

      10.1142/S0219622016500334

    • Peer Reviewed / Int'l Joint Research / Acknowledgement Compliant
  • [Journal Article] Semisupervised Learning of Author-Specific Emotions in Micro-Blogs2016

    • Author(s)
      Xin Kang, Fuji Ren, Yunong Wu
    • Journal Title

      IEEJ Transactions on Electrical and Electronic Engineering

      Volume: 11 Pages: 768-775

    • DOI

      10.1002/tee.22302

    • Peer Reviewed / Acknowledgement Compliant
  • [Journal Article] Hybrid Chinese Text Classification Approach Using General Knowledge from Baidu Baike2016

    • Author(s)
      Fuji Ren and Chao Li
    • Journal Title

      IEEJ Transactions on Electrical and Electronic Engineering

      Volume: 11 Pages: 488-498

    • DOI

      10.1002/tee.22266

    • Peer Reviewed / Acknowledgement Compliant
  • [Journal Article] Detecting Influenza States based on Hybrid Model with Personal Emotional Factors from Social Networks2016

    • Author(s)
      Xiao Sun, Jiaqi Yi and Fuji Ren
    • Journal Title

      Neurocomputing

      Volume: 210 Pages: 257-268

    • DOI

      doi:10.1016/j.neucom.2016.01.107

    • Peer Reviewed / Int'l Joint Research / Acknowledgement Compliant
  • [Journal Article] Sentiment Analysis for Chinese Microblog based on Deep Neural Networks with Convolutional Extension Features2016

    • Author(s)
      Xiao Sun, Chengcheng LI and Fuji Ren
    • Journal Title

      Neurocomputing

      Volume: 210 Pages: 227-236

    • DOI

      doi:10.1016/j.neucom.2016.02.077

    • Peer Reviewed / Int'l Joint Research / Acknowledgement Compliant
  • [Journal Article] A novel factored POMDP model for affective dialogue management2016

    • Author(s)
      Fuji Ren, Yu Wang, Changqin Quan,
    • Journal Title

      Journal of Intelligent and Fuzzy Systems

      Volume: 31 Pages: 127-136

    • DOI

      10.3233/IFS-162126

    • Peer Reviewed / Int'l Joint Research / Acknowledgement Compliant
  • [Journal Article] Slang Analysis Based on Variant Information Extraction Focusing on the Time Series Topics2016

    • Author(s)
      Kazuyuki Matsumoto, Minoru Yoshida, Seiji Tsuchiya, Kenji Kita and Fuji Ren
    • Journal Title

      International Journal of Advanced Intelligence

      Volume: 8 Pages: 84-98

    • Peer Reviewed / Acknowledgement Compliant
  • [Presentation] Ego-state Estimation from Short Texts Based on Sentence Distributed Representation2016

    • Author(s)
      Kazuyuki Matsumoto, Tanaka Satoshi, Minoru Yoshida, Kenji Kita and Fuji Ren
    • Organizer
      The 11th International Conference on Natural Language Processing and Knowledge Engineering
    • Place of Presentation
      Okinawa Jichikaikan, Naha, Okinawa, Japan
    • Year and Date
      2016-12-14 – 2016-12-17
    • Int'l Joint Research
  • [Presentation] Advanced Intelligence and Multisource Imaging Model2016

    • Author(s)
      Fuji Ren
    • Organizer
      The 11th International Conference on Natural Language Processing and Knowledge Engineering
    • Place of Presentation
      Okinawa Jichikaikan, Naha, Okinawa, Japan
    • Year and Date
      2016-12-14 – 2016-12-17
    • Int'l Joint Research / Invited
  • [Presentation] Disambiguating Users' Temporal Intent in Search Queries with Deep Neural Networks2016

    • Author(s)
      XIN KANG, Yunong Wu and Fuji Ren
    • Organizer
      The 11th International Conference on Natural Language Processing and Knowledge Engineering
    • Place of Presentation
      Okinawa Jichikaikan, Naha, Okinawa, Japan
    • Year and Date
      2016-12-14 – 2016-12-17
    • Int'l Joint Research
  • [Presentation] Classification of Biological Contacts and Crystal Contacts Using Deep Learning Model2016

    • Author(s)
      Chao Li and Fuji Ren
    • Organizer
      The 11th International Conference on Natural Language Processing and Knowledge Engineering
    • Place of Presentation
      Okinawa Jichikaikan, Naha, Okinawa, Japan
    • Year and Date
      2016-12-14 – 2016-12-17
    • Int'l Joint Research
  • [Presentation] Generation of Humanlike Facial Expression for Natural Human-Robot Interaction System2016

    • Author(s)
      Shun Nishide, Hidenobu Shibasaki, XIN KANG and Fuji Ren
    • Organizer
      The 11th International Conference on Natural Language Processing and Knowledge Engineering
    • Place of Presentation
      Okinawa Jichikaikan, Naha, Okinawa, Japan
    • Year and Date
      2016-12-14 – 2016-12-17
    • Int'l Joint Research
  • [Presentation] Towards a Developmental Human-Robot Interaction System Using Robot Facial Expressions From Human Feedback2016

    • Author(s)
      Hiroki Urakami, Shun Nishide and Fuji Ren
    • Organizer
      The 11th International Conference on Natural Language Processing and Knowledge Engineering
    • Place of Presentation
      Okinawa Jichikaikan, Naha, Okinawa, Japan
    • Year and Date
      2016-12-14 – 2016-12-17
    • Int'l Joint Research
  • [Presentation] Text classification based on word co-occurrence with background knowledge2016

    • Author(s)
      Jiawen Deng, Mingyu Huang and Fuji Ren
    • Organizer
      The 11th International Conference on Natural Language Processing and Knowledge Engineering
    • Place of Presentation
      Okinawa Jichikaikan, Naha, Okinawa, Japan
    • Year and Date
      2016-12-14 – 2016-12-17
    • Int'l Joint Research
  • [Presentation] Voice conversion based on RBF neural network2016

    • Author(s)
      Xun Feng, Hongjun Ni and Fuji Ren
    • Organizer
      The 11th International Conference on Natural Language Processing and Knowledge Engineering
    • Place of Presentation
      Okinawa Jichikaikan, Naha, Okinawa, Japan
    • Year and Date
      2016-12-14 – 2016-12-17
    • Int'l Joint Research
  • [Presentation] Integration of Homography Constraints and Feature Correspondences in the Image Sequences for Traffic Sign Localization2016

    • Author(s)
      Zhichao Cui, Yuehu Liu and Fuji Ren
    • Organizer
      The 11th International Conference on Natural Language Processing and Knowledge Engineering
    • Place of Presentation
      Okinawa Jichikaikan, Naha, Okinawa, Japan
    • Year and Date
      2016-12-14 – 2016-12-17
    • Int'l Joint Research
  • [Presentation] Human-robot emotion interaction via human skeleton tracking2016

    • Author(s)
      Shuda Xing, Yang Cao and Fuji Ren
    • Organizer
      The 11th International Conference on Natural Language Processing and Knowledge Engineering
    • Place of Presentation
      Okinawa Jichikaikan, Naha, Okinawa, Japan
    • Year and Date
      2016-12-14 – 2016-12-17
    • Int'l Joint Research
  • [Presentation] Speech emotion recognition based on MFCC and D-MFCC2016

    • Author(s)
      Kai Yang, Quan Shi and Fuji Ren
    • Organizer
      The 11th International Conference on Natural Language Processing and Knowledge Engineering
    • Place of Presentation
      Okinawa Jichikaikan, Naha, Okinawa, Japan
    • Year and Date
      2016-12-14 – 2016-12-17
    • Int'l Joint Research
  • [Presentation] TUTA1 at the NTCIR-12 Temporalia Task2016

    • Author(s)
      Ning Liu, Mengjia He, Chao Li, Xin Kang and Fuji Ren
    • Organizer
      Proceedings of the 12th NTCIR Conference on Evaluation of Information Access Technologies
    • Place of Presentation
      National Center of Sciences, Tokyo, Japan
    • Year and Date
      2016-06-07 – 2016-06-10
  • [Presentation] Understanding Blog author's emotions with hierarchical Bayesian models2016

    • Author(s)
      XIN KANG and Fuji Ren
    • Organizer
      2016 IEEE 13th International Conference on Networking, Sensing, and Control
    • Place of Presentation
      Hotel Geneve, Mexico City, Mexico
    • Year and Date
      2016-04-28 – 2016-04-30
    • Int'l Joint Research

URL: 

Published: 2018-01-16  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi