• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

Study on Human-Machine Communication and Learning through Content-Awareness

Research Project

Project/Area Number 26280059
Research Category

Grant-in-Aid for Scientific Research (B)

Allocation TypePartial Multi-year Fund
Section一般
Research Field Perceptual information processing
Research InstitutionKobe University

Principal Investigator

ARIKI Yasuo  神戸大学, 都市安全研究センター, 名誉教授 (10135519)

Co-Investigator(Kenkyū-buntansha) 滝口 哲也  神戸大学, 都市安全研究センター, 准教授 (40397815)
榎並 直子  神戸大学, 自然科学系先端融合研究環重点研究部, 助教 (80628925)
Project Period (FY) 2014-04-01 – 2017-03-31
Project Status Completed (Fiscal Year 2016)
Budget Amount *help
¥14,040,000 (Direct Cost: ¥10,800,000、Indirect Cost: ¥3,240,000)
Fiscal Year 2016: ¥4,550,000 (Direct Cost: ¥3,500,000、Indirect Cost: ¥1,050,000)
Fiscal Year 2015: ¥4,550,000 (Direct Cost: ¥3,500,000、Indirect Cost: ¥1,050,000)
Fiscal Year 2014: ¥4,940,000 (Direct Cost: ¥3,800,000、Indirect Cost: ¥1,140,000)
Keywords音声認識 / 物体認識 / コミュニケーション / アウェアネス / 機能認識 / 学習 / 未知物体 / 音声対話 / リカーレントニューラルネットワーク / 意図認識 / 特定物体認識 / 一般物体認識
Outline of Final Research Achievements

We studied on a smooth communication method with computers under the assumption that human and computers can communicate each other through the common recognition that is called content awareness in this study. To realize the content awareness, the following five points were carried out and the associated research results were obtained;
(1)Objects and state recognition with high accuracy, (2)Utilization of object recognition in speech communication, (3)Unknown object recognition and learning, (4)Functional recognition of unknown object, (5)Speech communication with common knowledge about objects.

Report

(4 results)
  • 2016 Annual Research Report   Final Research Report ( PDF )
  • 2015 Annual Research Report
  • 2014 Annual Research Report
  • Research Products

    (32 results)

All 2017 2016 2015 2014

All Journal Article (7 results) (of which Peer Reviewed: 7 results,  Open Access: 3 results) Presentation (25 results) (of which Int'l Joint Research: 11 results)

  • [Journal Article] LLC Revisit : Scene Classification with k-Farthest Neighbours2016

    • Author(s)
      Katsuyuki Tanaka,Tetsuya Takiguchi, Yasuo Ariki
    • Journal Title

      IEICE TRANSACTIONS on Information and Systems

      Volume: E99-D,No.5 Pages: 1375-1383

    • NAID

      130005148981

    • Related Report
      2016 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] Multithreading Cascade of SURF for Facial Expression Recognition2016

    • Author(s)
      Jinhui Chen, Zhaojie Luo, Tetsuya Takiguchi, Yasuo Ariki
    • Journal Title

      EURASIP Journal on Image and Video Processing

      Volume: 2016(1) Issue: 1 Pages: 1-13

    • DOI

      10.1186/s13640-016-0140-7

    • NAID

      120005898708

    • Related Report
      2016 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] マルチモーダル情報を用いた色名称と物体名称に基づく物体特定2015

    • Author(s)
      小篠裕子, 有木康雄
    • Journal Title

      画像電子学会誌

      Volume: 45巻1号 Pages: 105-111

    • NAID

      130006078492

    • Related Report
      2015 Annual Research Report
    • Peer Reviewed
  • [Journal Article] 一般物体認識に基づく音声で指示された物体の選択法2015

    • Author(s)
      西村仁志, 小篠裕子, 有木康雄, 中野幹生
    • Journal Title

      電子情報通信学会論文誌D

      Volume: Vol.J98-D,No.9 Pages: 1265-1276

    • Related Report
      2015 Annual Research Report
    • Peer Reviewed
  • [Journal Article] Audio-Visual Speech Recognition Using Convolutive Bottleneck Networks for a Person with Severe Hearing Loss2015

    • Author(s)
      Yuki Takashima, Yasuhiro Kakihara, Ryo Aihara, Tetsuya Takiguchi, Yasuo Ariki, Nobuyuki Mitani, Kiyohiro Omori, Kaoru Nakazono
    • Journal Title

      IPSJ Transactions on Computer Vision and Applications

      Volume: Vol. 7 Pages: 64-68

    • NAID

      130005091225

    • Related Report
      2015 Annual Research Report
    • Peer Reviewed
  • [Journal Article] Discriminating Unknown Objects from Known Objects Using Image and Speech Information2015

    • Author(s)
      Yuko Ozasa, Mikio Nakano, Yasuo Ariki, Naoto Iwahashi
    • Journal Title

      IEICE TRANSACTIONS on Information and Systems

      Volume: Vol.E98-D No.3 Pages: 704-711

    • NAID

      130004841858

    • Related Report
      2014 Annual Research Report
    • Peer Reviewed
  • [Journal Article] A Robust SVM Classification Framework Using PSM for Multi-class Recognition2015

    • Author(s)
      Jinhui Chen, Tetsuya Takiguchi, Yasuo Ariki
    • Journal Title

      EURASIP Journal on Image and Video Processing

      Volume: 2015 Issue: 1

    • DOI

      10.1186/s13640-015-0061-x

    • NAID

      120005650142

    • Related Report
      2014 Annual Research Report
    • Peer Reviewed / Open Access
  • [Presentation] 料理アシスト対話システムにおけるユーザ発話のクラス分類2017

    • Author(s)
      山田 燿司, 滝口 哲也, 有木 康雄
    • Organizer
      日本音響学会2017年春季研究発表会
    • Place of Presentation
      明治大学(神奈川県・川崎市)
    • Year and Date
      2017-03-15
    • Related Report
      2016 Annual Research Report
  • [Presentation] ニュース情報検索「NetTv」における質問種別の推定2017

    • Author(s)
      丸本理貴人,田中克幸,有木康雄,滝口哲也
    • Organizer
      日本音響学会2017年春季研究発表会
    • Place of Presentation
      明治大学(神奈川県・川崎市)
    • Year and Date
      2017-03-15
    • Related Report
      2016 Annual Research Report
  • [Presentation] Estimation of Object Functions Focusing on Feature of Object Parts2017

    • Author(s)
      Ryunosuke Azuma, Tetsuya Takiguchi, Yasuo Ariki
    • Organizer
      The 23rd International Workshop on Frontiers of Computer Vision
    • Place of Presentation
      ソウル(韓国)
    • Year and Date
      2017-02-01
    • Related Report
      2016 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Convolutional Neural Networksを用いた機能推定2016

    • Author(s)
      東龍之介, 北野陽祐, 滝口哲也, 有木康雄
    • Organizer
      MIRU 2016
    • Place of Presentation
      アクトシティ浜松(静岡県・浜松市)
    • Year and Date
      2016-08-02
    • Related Report
      2016 Annual Research Report
  • [Presentation] MODELING DEEP BIDIRECTIONAL RELATIONSHIPS FOR IMAGE CLASSIFICATION AND GENERATION2016

    • Author(s)
      Toru Nakashika, Tetsuya Takiguchi, Yasuo Ariki
    • Organizer
      ICASSP2016
    • Place of Presentation
      上海(中国)
    • Year and Date
      2016-03-22
    • Related Report
      2015 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Estimation of Object Functions Using Convolutional Neural Network2016

    • Author(s)
      Yosuke Kitano, Tetsuya Takiguchi, Yasuo Ariki
    • Organizer
      The 22st Korea-Japan joint Workshop on Frontiers of Computer Vision
    • Place of Presentation
      ひだホテルプラザ(岐阜県・高山市)
    • Year and Date
      2016-02-17
    • Related Report
      2015 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Rotation-invariant Histograms of Oriented Gradients for Local Patch Robust Representation2015

    • Author(s)
      Zhaojie Luo, Jinhui Chen, Tetsuya Takiguchi, and Yasuo Ariki
    • Organizer
      APSIPA Annual Summit and Conference 2015
    • Place of Presentation
      香港(中国)
    • Year and Date
      2015-12-16
    • Related Report
      2015 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Detection of Facial Parts via Deformable Part Model Using Part Annotation2015

    • Author(s)
      Kazuhiro Nishida, Naoko Enami and Yasuo Ariki
    • Organizer
      APSIPA Annual Summit and Conference 2015
    • Place of Presentation
      香港(中国)
    • Year and Date
      2015-12-16
    • Related Report
      2015 Annual Research Report
    • Int'l Joint Research
  • [Presentation] 状態空間の分割と状態遷移の学習に基づく Parallel POMDPの評価2015

    • Author(s)
      山田 燿司, 滝口 哲也, 有木 康雄
    • Organizer
      電子情報通信学会技術研究報告 (SP)
    • Place of Presentation
      六甲ホール(兵庫県・神戸市)
    • Year and Date
      2015-10-15
    • Related Report
      2015 Annual Research Report
  • [Presentation] Multithreading AdaBoost Framework for Object Recognition2015

    • Author(s)
      Jinhui Chen, Tetsuya Takiguchi, and Yasuo Ariki
    • Organizer
      The IEEE International Conference on Image Processing (ICIP) 2015
    • Place of Presentation
      Québec City (Canada)
    • Year and Date
      2015-09-27
    • Related Report
      2015 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Facial Expression Recognition with Multithreaded Cascade of Rotation-invariant HOG2015

    • Author(s)
      Jinhui Chen, Tetsuya Takiguchi, and Yasuo Ariki
    • Organizer
      The sixth International Conference on Affective Computing and Intelligent Interaction (ACII2015)
    • Place of Presentation
      西安(中国)
    • Year and Date
      2015-09-21
    • Related Report
      2015 Annual Research Report
    • Int'l Joint Research
  • [Presentation] SPOKEN DIALOGUE SYSTEM FOR PRODUCT RECOMMENDATION USING HIERARCHICAL POMDP2015

    • Author(s)
      Yoji Yamada, Tetsuya Takiguchi, Yasuo Ariki
    • Organizer
      2015 First International Workshop on Machine Learning in Spoken Language Processing (MLSLP)
    • Place of Presentation
      会津大学 (会津市・福島県)
    • Year and Date
      2015-09-19
    • Related Report
      2015 Annual Research Report
    • Int'l Joint Research
  • [Presentation] FEATURE EXTRACTION USING PRE-TRAINED CONVOLUTIVE BOTTLENECK NETS FOR DYSARTHRIC SPEECH RECOGNITION2015

    • Author(s)
      Yuki Takashima, Toru Nakashika, Tetsuya Takiguchi, Yasuo Ariki
    • Organizer
      The 23rd European Signal Processing Conference (EUSIPCO)
    • Place of Presentation
      Nice (France)
    • Year and Date
      2015-08-31
    • Related Report
      2015 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Word-Error Correction of Continuous Speech Recognition Based on Normalized Relevance Distance2015

    • Author(s)
      Yohei Fusayasu, Katsuyuki Tanaka, Tetsuya Takiguchi, Yasuo Ariki
    • Organizer
      International Joint Conference on Artificial Intelligence 2016
    • Place of Presentation
      Buenos Aires (Argentina)
    • Year and Date
      2015-07-25
    • Related Report
      2015 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Content-based Image Retrieval Using Rotation-invariant Histograms of Oriented Gradients2015

    • Author(s)
      Jinhui Chen, Toru Nakashika, Tetsuya Takiguchi, and Yasuo Ariki
    • Organizer
      ACM ICMR 2015
    • Place of Presentation
      上海(中国)
    • Year and Date
      2015-06-23
    • Related Report
      2015 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Deformable Part Modelを用いた顔部品検出2015

    • Author(s)
      西田 和博,榎並 直子,有木 康雄
    • Organizer
      電子情報通信学会技術研究報告 (PRMU)
    • Place of Presentation
      新潟大学駅南キャンパス「ときめいと」 (新潟県・新潟市)
    • Year and Date
      2015-06-18
    • Related Report
      2015 Annual Research Report
  • [Presentation] 階層的POMDPを用いた商品検索型音声対話システムの検討2015

    • Author(s)
      山田耀司, 滝口哲也, 有木康雄
    • Organizer
      日本音響学会
    • Place of Presentation
      中央大学 (東京都・文京区)
    • Year and Date
      2015-03-16 – 2015-03-18
    • Related Report
      2014 Annual Research Report
  • [Presentation] Color Saliency for Object Identification2015

    • Author(s)
      Yuko Ozasa, Naoko Enami, Yasuo Ariki
    • Organizer
      The 21st Korea-Japan joint Workshop on Frontiers of Computer Vision
    • Place of Presentation
      Mokpo (Korea)
    • Year and Date
      2015-01-28 – 2015-01-30
    • Related Report
      2014 Annual Research Report
  • [Presentation] Estimation of Object Functions Using Deformable Part Model2015

    • Author(s)
      Yosuke Kitano, Tetsuya Takiguchi, Yasuo Ariki
    • Organizer
      The 21st Korea-Japan joint Workshop on Frontiers of Computer Vision
    • Place of Presentation
      Mokpo (Korea)
    • Year and Date
      2015-01-28 – 2015-01-30
    • Related Report
      2014 Annual Research Report
  • [Presentation] Selection of an Object Requested by Speech Based on Generic Object Recognitio2014

    • Author(s)
      Hitoshi Nishimura, Yuko Ozasa, Yasuo Ariki, Mikio Nakano
    • Organizer
      ICMI 2014 Workshop on Multimodal, Multi-Party, Real-World Human-Robot Interaction
    • Place of Presentation
      Istanbul (Turkey)
    • Year and Date
      2014-11-12 – 2014-11-16
    • Related Report
      2014 Annual Research Report
  • [Presentation] 物体特定のための顕著性2014

    • Author(s)
      小篠裕子, 榎並直子, 有木康雄
    • Organizer
      電子情報通信学会
    • Place of Presentation
      幕張メッセ国際会議場 (千葉県・千葉市)
    • Year and Date
      2014-10-09 – 2014-10-10
    • Related Report
      2014 Annual Research Report
  • [Presentation] Selection of Unknown Objects Specified by Speech Using Models Constructed from Web Images2014

    • Author(s)
      Hitoshi Nishimura, Yuko Ozasa, Yasuo Ariki, Mikio Nakano
    • Organizer
      International Conference on Pattern Recognition
    • Place of Presentation
      Stockholm (Sweden)
    • Year and Date
      2014-08-24 – 2014-08-28
    • Related Report
      2014 Annual Research Report
  • [Presentation] 3D-Object Recognition Based on LLC Using Depth Spatial Pyramid2014

    • Author(s)
      Toru Nakashika, Takafumi Hori, Tetsuya Takiguchi, Yasuo Ariki
    • Organizer
      International Conference on Pattern Recognition
    • Place of Presentation
      Stockholm (Sweden)
    • Year and Date
      2014-08-24 – 2014-08-28
    • Related Report
      2014 Annual Research Report
  • [Presentation] 物体の機能発現を可能とする属性情報の抽出2014

    • Author(s)
      北野陽祐,滝口哲也,有木康雄
    • Organizer
      画像の認識・理解シンポジウム
    • Place of Presentation
      岡山コンベンションセンター(岡山県・岡山市)
    • Year and Date
      2014-07-28 – 2014-07-31
    • Related Report
      2014 Annual Research Report
  • [Presentation] Web画像を用いた一般物体認識と指示発話の音声認識を統合した物体選択法2014

    • Author(s)
      西村仁志,小篠裕子,有木康雄,中野幹生
    • Organizer
      画像の認識・理解シンポジウム
    • Place of Presentation
      岡山コンベンションセンター(岡山県・岡山市)
    • Year and Date
      2014-07-28 – 2014-07-31
    • Related Report
      2014 Annual Research Report

URL: 

Published: 2014-04-04   Modified: 2018-03-22  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi