• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

Synergic Attention-based Visuospatial Episodic Memory and its Application to Wearable Navigation

Research Project

Project/Area Number 15500075
Research Category

Grant-in-Aid for Scientific Research (C)

Allocation TypeSingle-year Grants
Section一般
Research Field Media informatics/Database
Research InstitutionSoka University

Principal Investigator

ATSUMI Masayasu  Soka University, Faculty of Engineering, Associate Professor, 工学部, 助教授 (00192980)

Project Period (FY) 2003 – 2005
Project Status Completed (Fiscal Year 2005)
Budget Amount *help
¥3,700,000 (Direct Cost: ¥3,700,000)
Fiscal Year 2005: ¥1,000,000 (Direct Cost: ¥1,000,000)
Fiscal Year 2004: ¥1,000,000 (Direct Cost: ¥1,000,000)
Fiscal Year 2003: ¥1,700,000 (Direct Cost: ¥1,700,000)
KeywordsAttention / Visuospatial episode / Competitive neural network / Self-organized learning / Speech interaction / User model / Bayesian network / Information providing / 注意制御 / シーン符号化 / 音声情報提供 / ウェアラブルシステム / シーン記憶 / 視空間エピソード記憶 / 自己組織学習
Research Abstract

In this research, we proposed fundamental methods for the partner machines such as familiar computers and robots that support daily activities of human owners by paying attention to their daily space and sharing attention and concern with them. These methods include representation and control of synergic attention between an owner and his/her partner machine, learning of attention structure based on the competitive neural network, and Bayesian network-based personal modeling and real-world information navigation using visual attention and response utterance of an owner. As for synergic attention, we built a method for modulating saliency-driven attention by active spatial attention induced by owner's concern. Then we built an attention transition and control method and proposed the synergic attention control method between an owner and his/her partner machine. As for learning of attention structure, we built a model of encoding a set of attended spots in a certain scene as an attention … More structure code. This model consists of the competitive neural network named the COGNET, which encodes objects included in attended spots, and the encoding mechanism of sizes and positions of the attended spots. Through experimental evaluation of the COGNET's main features, that are the fast self-organized learning and the glance recognition of objects in attended spots, it was confirmed that attention structure codes were useful enough for encoding visuospatial episodes. As for personal modeling and information providing based on it, we built a Bayesian network-based personal model of an owner and architecture of a partner machine equipped with it as an inference model. The personal model infers owner's concern from attended object codes, utterance response by impression words and context around the owner, and recommends what information satisfies his/her information needs. Through experiments using an interactive speech-based news provider system with a Bayesian network-based personal model of an owner, it was confirmed that the personal model made information providing personalized for the owner. Less

Report

(4 results)
  • 2005 Annual Research Report   Final Research Report Summary
  • 2004 Annual Research Report
  • 2003 Annual Research Report
  • Research Products

    (19 results)

All 2005 2004 2003 Other

All Journal Article (16 results) Publications (3 results)

  • [Journal Article] Saliency-driven Scene Learning and Recognition based on Competitively Growing Neural Network using Temporal Coding2005

    • Author(s)
      Masayasu Atsumi
    • Journal Title

      Journal of Advanced Computational Intelligence and Intelligent Informatics 9

      Pages: 235-243

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2005 Final Research Report Summary
  • [Journal Article] Saliency-driven Scene Learning and Recognition based on Competitively Growing Neural Network using Temporal Coding2005

    • Author(s)
      Masayasu Atsumi
    • Journal Title

      Journal of Advanced Computational Intelligence and Intelligent Informatics Vol.9

      Pages: 235-243

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2005 Final Research Report Summary
  • [Journal Article] Saliency-driven Scene Learning and Recognition based on Competitively Growing Neural Network using Temporal Coding2005

    • Author(s)
      Masayasu Atsumi
    • Journal Title

      Journal of Advanced Computational Intelligence and Intelligent Informatics Vol.9, No.3

      Pages: 235-243

    • Related Report
      2005 Annual Research Report
  • [Journal Article] Saliency-driven Scene Learning and Recognition based on Competitively Growing Neural Network using Temporal Coding2005

    • Author(s)
      Masayasu Atsumi
    • Journal Title

      Journal of Advanced Computational Intelligence and Intelligent Informatics Vol.9, No.3(in press)

    • Related Report
      2004 Annual Research Report
  • [Journal Article] Scene Learning and Glance Recognizability based on Competitively Growing Spiking Neural Network2004

    • Author(s)
      Masayasu Atsumi
    • Journal Title

      Proceedings 2004 IEEE International Joint Conference on Neural Networks

      Pages: 2859-2864

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2005 Final Research Report Summary
  • [Journal Article] Saliency-based Scene Learning and Recognition based on Competitively Growing Neural Network using Temporal Coding2004

    • Author(s)
      Masayasu Atsumi
    • Journal Title

      Proceedings of Joint 2nd International Conference on Soft Computing and Intelligent Systems and 5th International Symposium on Advanced Intelligent Systems (CD-ROM)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2005 Final Research Report Summary 2004 Annual Research Report
  • [Journal Article] Scene Memory on Competitively Growing Neural Network using Temporal Coding : Self-organized Learning and Glance Recognizability2004

    • Author(s)
      Masayasu Atsumi
    • Journal Title

      Neural Information Processing (Pal,N.R.; Kasabov,N.; Mudi, R.K.; Pal,S.; Parui,S.K.(Eds.)), Lecture Notes in Computer Science, Springer-Verlag, Heidelberg 3316

      Pages: 393-398

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2005 Final Research Report Summary
  • [Journal Article] Scene Memory of Mobile Robot based on Competitively Growing Neural Network using Temporal Coding2004

    • Author(s)
      Masayasu Atsumi
    • Journal Title

      Proceedings of the Second International Conference on Autonomous Robots and Agents

      Pages: 235-243

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2005 Final Research Report Summary
  • [Journal Article] Saliency-based Scene Learning and Recognition based on Competitively Growing Neural Network using Temporal Coding2004

    • Author(s)
      Masayasu Atsumi
    • Journal Title

      Proceedings of Joint 2nd International Conference on Soft Computing and Intelligent Systems and 5th International Symposium on Advanced Intelligent Systems CD-ROM TUP-6-3

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2005 Final Research Report Summary
  • [Journal Article] Scene Memory on Competitively Growing Neural Network using Temporal Coding : Self-organized Learning and Glance Recognizability2004

    • Author(s)
      Masayasu Atsumi
    • Journal Title

      Neural Information Processing, Lecture Notes in Computer Science(Pal, N.R. ; Kasabov, N. ; Mudi, R.K. ; Pal, S. ; Parui, S.K.(Eds.))(Springer-Verlag, Heidelberg) Vol.3316

      Pages: 393-398

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2005 Final Research Report Summary
  • [Journal Article] Scene Learning and Glance Recognizability based on Competitively Growing Spiking Neural Network2004

    • Author(s)
      Masayasu Atsumi
    • Journal Title

      Proceedings 2004 IEEE International Joint Conference on Neural Networks (IJCNN'2004)

      Pages: 2859-2864

    • Related Report
      2004 Annual Research Report
  • [Journal Article] Scene Memory on Competitively Growing Neural Network using Temporal Coding : Self-organized Learning and Glance Recognizability2004

    • Author(s)
      Masayasu Atsumi
    • Journal Title

      Neural Information Processing (Pal, N.R. ; Kasabov, N. ; Mudi, R.K. ; Pal, S. ; Parui, S.K. (Eds.)), Lecture Notes in Computer Science, Springer-Verlag, Heidelberg Vol.3316

      Pages: 393-398

    • Related Report
      2004 Annual Research Report
  • [Journal Article] Scene Memory of Mobile Robot based on Competitively Growing Neural Network using Temporal Coding2004

    • Author(s)
      Masayasu Atsumi
    • Journal Title

      Proceedings of the Second International Conference on Autonomous Robots and Agents (ICARA'2004)

      Pages: 82-87

    • Related Report
      2004 Annual Research Report
  • [Journal Article] Growing competitive Spiking Neural Network for Saliency-based Scene Recognition2003

    • Author(s)
      Masayasu Atsumi
    • Journal Title

      Proceedings of Workshop on Self-Organizing Maps Intelligent Systems and Innovational Computing

      Pages: 299-304

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2005 Final Research Report Summary
  • [Journal Article] Saliency-based Scene Recognition based on Growing Competitive Neural Network2003

    • Author(s)
      Masayasu Atsumi
    • Journal Title

      SMC 2003 Conference Proceedings, 2003 IEEE International Conference on Systems, Man & Cybernetics

      Pages: 2863-2870

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2005 Final Research Report Summary
  • [Journal Article] Growing Competitive Spiking Neural Network for Saliency-based Scene Recognition2003

    • Author(s)
      Masayasu Atsumi
    • Journal Title

      Proceedings of Workshop on Self-Organizing Maps -Intelligent Systems and Innovational Computing-

      Pages: 299-304

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2005 Final Research Report Summary
  • [Publications] Masayasu Atsumi: "Growing Competitive Spiking Neural Network for Saliency-based Scene Recognition"Proceedings of Workshop on Self-Organizing Maps-Intelligent Systems and Innovational Computing-. 2. 299-304 (2003)

    • Related Report
      2003 Annual Research Report
  • [Publications] Masayasu Atsumi: "Saliency-based Scene Recognition based on Growing Competitive Neural Network"SMC 2003 Conference Proceedings, 2003 IEEE International Conference on Systems, Man & Cybernetics. 2. 2863-2870 (2003)

    • Related Report
      2003 Annual Research Report
  • [Publications] Masayasu Atsumi: "Scene Learning and Glance Recognizability based on Competitively Growing Spiking Neural Network"2004 International Joint Conference on Neural Networks (IJCNN'2004). 2(発表予定). (2004)

    • Related Report
      2003 Annual Research Report

URL: 

Published: 2003-04-01   Modified: 2016-04-21  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi