• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

A Robust Behavior Estimation and Evaluation Method against Sensor Position Variation and Environmental Changes

Research Project

Project/Area Number 17K00372
Research Category

Grant-in-Aid for Scientific Research (C)

Allocation TypeMulti-year Fund
Section一般
Research Field Intelligent robotics
Research InstitutionRitsumeikan University

Principal Investigator

Lee Jooho  立命館大学, 情報理工学部, 教授 (80366434)

Co-Investigator(Kenkyū-buntansha) 島田 伸敬  立命館大学, 情報理工学部, 教授 (10294034)
Project Period (FY) 2017-04-01 – 2020-03-31
Project Status Completed (Fiscal Year 2019)
Budget Amount *help
¥4,420,000 (Direct Cost: ¥3,400,000、Indirect Cost: ¥1,020,000)
Fiscal Year 2019: ¥1,170,000 (Direct Cost: ¥900,000、Indirect Cost: ¥270,000)
Fiscal Year 2018: ¥1,560,000 (Direct Cost: ¥1,200,000、Indirect Cost: ¥360,000)
Fiscal Year 2017: ¥1,690,000 (Direct Cost: ¥1,300,000、Indirect Cost: ¥390,000)
Keywordsフェーズ推定 / 行動クラスタリング / ロバスト推定 / 行動推定 / 機械学習 / プロセスモデリング / 動作記述子 / 不変特徴 / 画像 / 空間知能化 / センサ配置
Outline of Final Research Achievements

In this research, a series of work is defined as a process. A camera is used to record a work having a certain process, and it is estimated robustly that what part of the process is the action that the person is performing. We have realized a world-class high-precision action classifier so that process estimation can be performed without lowering the estimation accuracy even if the camera is installed at a position different from the position of the camera when the model process was first recorded. This makes it possible to compare the same actions of different persons recorded in different environments.

Academic Significance and Societal Importance of the Research Achievements

本研究の成果によって、調理法、組み立て作業など、決まった一連の作業を行う先生役の人の動作をカメラで収めることによって、異なる空間で異なる人がその動作をまねて行った場合どの動作が作業全体におけるどの部分であるかを判別できると同時に2者間の動作の違いが比較できるようになる。これまでの手法はカメラを用いた場合できるだけ同じ位置にカメラを配置しないと再現性が低かったが本研究はその問題を概ね解決した。また本研究成果を活用することで、遠隔教育、ビデオ教育などがもっと容易にできるようになる。

Report

(4 results)
  • 2019 Annual Research Report   Final Research Report ( PDF )
  • 2018 Research-status Report
  • 2017 Research-status Report
  • Research Products

    (29 results)

All 2020 2019 2018 2017 Other

All Journal Article (7 results) (of which Int'l Joint Research: 1 results,  Peer Reviewed: 7 results,  Open Access: 5 results) Presentation (20 results) (of which Int'l Joint Research: 14 results,  Invited: 2 results) Remarks (2 results)

  • [Journal Article] Heartbeat classification using local transform pattern feature and hybrid neural fuzzy-logic system based on self-organizing map2020

    • Author(s)
      Miran Lee, Tae-Geon Song, Joo-Ho Lee
    • Journal Title

      Biomedical Signal Processing and Control

      Volume: 57 Pages: 101690-101690

    • DOI

      10.1016/j.bspc.2019.101690

    • Related Report
      2019 Annual Research Report
    • Peer Reviewed / Open Access / Int'l Joint Research
  • [Journal Article] Multi-Scale Affined-HOF and Dimension Selection for View-Unconstrained Action Recognition2020

    • Author(s)
      Dinh Tuan Tran, Hirotake Yamazoe, Joo-Ho Lee
    • Journal Title

      Applied Intelligence

      Volume: Vol.50 Issue: 5 Pages: 1-19

    • DOI

      10.1007/s10489-019-01572-8

    • Related Report
      2019 Annual Research Report
    • Peer Reviewed
  • [Journal Article] Development and Quantitative Assessment of an Elbow Joint Robot for Elderly Care Training2019

    • Author(s)
      Miran Lee, Kodai Murata, Ko Ameyama, Hirotake Yamazoe, Joo-Ho Lee
    • Journal Title

      Intelligent Service Robotics

      Volume: 12 Issue: 4 Pages: 277-287

    • DOI

      10.1007/s11370-019-00282-x

    • Related Report
      2019 Annual Research Report
    • Peer Reviewed
  • [Journal Article] Restoring Aspect Ratio Distortion of Natural Images With Convolutional Neural Network2019

    • Author(s)
      Sakurai Ryuhei、Yamane Sasuke、Lee Joo-Ho
    • Journal Title

      IEEE Transactions on Industrial Informatics

      Volume: 15 Issue: 1 Pages: 563-571

    • DOI

      10.1109/tii.2018.2803041

    • Related Report
      2018 Research-status Report
    • Peer Reviewed / Open Access
  • [Journal Article] Projection mapping onto multiple objects using a projector robot2018

    • Author(s)
      Hirotake Yamazoe, Misaki Kasetani, Tomonobu Noguchi, Joo-Ho Lee
    • Journal Title

      Advances in Robotics Research

      Volume: 2 Pages: 45-57

    • Related Report
      2017 Research-status Report
    • Peer Reviewed / Open Access
  • [Journal Article] Synthesis of Expressive Talking Heads from Speech with Recurrent Neural Network2018

    • Author(s)
      Ryuhei Sakurai, Taiki Shimba, Hirotake Yamazoe, Joo-Ho Lee
    • Journal Title

      Journal of Korea Robotics Society

      Volume: 13 Issue: 1 Pages: 16-25

    • DOI

      10.7746/jkros.2018.13.1.016

    • Related Report
      2017 Research-status Report
    • Peer Reviewed / Open Access
  • [Journal Article] Construction of Latent Descriptor Space and Inference Model of Hand-Object Interactions2017

    • Author(s)
      Tadashi MATSUO, Nobutaka SHIMADA
    • Journal Title

      IEICE Transactions on Information and Systems

      Volume: E100.D Issue: 6 Pages: 1350-1359

    • DOI

      10.1587/transinf.2016EDP7410

    • NAID

      130005687693

    • ISSN
      0916-8532, 1745-1361
    • Related Report
      2017 Research-status Report
    • Peer Reviewed / Open Access
  • [Presentation] 顔形状パラメータの逐次更新により個人適応を行う顔姿勢推定ネットワークの提案2019

    • Author(s)
      施 真琴、 内海 章、 山添 大丈、 李 周浩
    • Organizer
      パターン認識・メディア理解研究会(PRMU)
    • Related Report
      2019 Annual Research Report
  • [Presentation] 再構成可能な知能化空間における突起とレールを用いた Mobile Module の動作改善2019

    • Author(s)
      里岡 樹、山添 大丈、李 周浩
    • Organizer
      第20回計測自動制御学会システムインテグレーション部門講演会(SI2019)
    • Related Report
      2019 Annual Research Report
  • [Presentation] Network Structure for Personalized Face‐Pose Estimation Using Incrementally Updated Face-Shape Parameters2019

    • Author(s)
      Makoto Sei, Akira Utsumi, Hirotake Yamazoe, Joo-Ho Lee
    • Organizer
      The 5th Asian Conference on Pattern Recognition (ACPR 2019)
    • Related Report
      2019 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Human motion generation based on GAN toward unsupervised 3D human pose estimation2019

    • Author(s)
      Sasuke Yamane, Hirotake Yamazoe, Joo-Ho Lee
    • Organizer
      The 5th Asian Conference on Pattern Recognition (ACPR 2019)
    • Related Report
      2019 Annual Research Report
    • Int'l Joint Research
  • [Presentation] 再構成可能な知能化空間における突起を用いたMobile Moduleの開発2019

    • Author(s)
      里岡 樹、 山添 大丈、 李 周浩
    • Organizer
      第37回 日本ロボット学会学術講演会(RSJ2019)
    • Related Report
      2019 Annual Research Report
  • [Presentation] GANを用いた姿勢既知の教師データを必要としない3次元人物姿勢推定2019

    • Author(s)
      山根 佐介, 山添 大丈, 李 周浩
    • Organizer
      第22回 画像の認識・理解シンポジウム (MIRU2019)
    • Related Report
      2019 Annual Research Report
  • [Presentation] Elderly Care Training Using Real-Time Monitoring System with Care Training Assistant Elbow Robot (CaTARo-E)2019

    • Author(s)
      Miran Lee , Hirotake Yamazoe, Joo-Ho Lee
    • Organizer
      16TH INTERNATIONAL CONFERENCE ON UBIQUITOUS ROBOTS (UR2019)
    • Related Report
      2019 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Recalling Candidates of Grasping Method from an Object Image using Neural Network2019

    • Author(s)
      Makoto Sanada, Tadashi Matsuo, Nobutaka Shimada, Yoshiaki Shirai
    • Organizer
      The 2019 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2019)
    • Related Report
      2019 Annual Research Report
    • Int'l Joint Research
  • [Presentation] 力入力に対する剛体群の運動応答予測と静力学的構造安定性の推定2019

    • Author(s)
      福井 尚卿, 松尾 直志, 島田 伸敬
    • Organizer
      ロボティクス・メカトロニクス講演会2019(ROBOMECH2019)
    • Related Report
      2019 Annual Research Report
  • [Presentation] CNN を用いた眼球中心・虹彩中心推定に基づく視線検出手法の検討2018

    • Author(s)
      施 真琴, 内海 章, 山添 大丈, 萩田 紀博, 李 周浩
    • Organizer
      日本機械学会ロボティクス・メカトロニクス講演会2018(ROBOMECH2018)
    • Related Report
      2018 Research-status Report
  • [Presentation] Barb based Fast Movement of Mobile Module for Deploying Devices in Reconfigurable Intelligent Space2018

    • Author(s)
      Tatsuki Satooka, Hirotake Yamazoe, Joo-Ho Lee
    • Organizer
      2018 15th International Conference on Ubiquitous Robots (UR)
    • Related Report
      2018 Research-status Report
    • Int'l Joint Research
  • [Presentation] Investigation of gaze detcection method based on eyeball center and ireis center esrimation using CNN2018

    • Author(s)
      Makoto Sei, Akira Utsumi, Hirotake Yamazoe, Norihiro Hagita, Joo-Ho Lee
    • Organizer
      The 14th joint Workshop on Machine Perception and Robotics (MPR2018)
    • Related Report
      2018 Research-status Report
    • Int'l Joint Research
  • [Presentation] Toward Efficient Environment: Reconfigurable Intelligent Space2018

    • Author(s)
      Joo-Ho Lee, Tatsuki Satooka, Hirotake Yamazoe
    • Organizer
      AMSM2018
    • Related Report
      2018 Research-status Report
    • Int'l Joint Research / Invited
  • [Presentation] View-Invariant Human Activity Recognition Using Topic Model on Combined ORB-OF Feature2018

    • Author(s)
      DINH TUAN TRAN, Hirotake Yamazoe, Joo-Ho Lee
    • Organizer
      2019 IEEE/SICE International Symposium on System Integration
    • Related Report
      2018 Research-status Report
    • Int'l Joint Research
  • [Presentation] Camera Pose-Independent Action Recognition in Operating Room2018

    • Author(s)
      Dinh Tuan Tran, Hirotake Yamazoe, Joo-Ho Lee
    • Organizer
      The International Conference on Information and Communication Technology and Digital Convergence Business (ICIDB-2018)
    • Related Report
      2017 Research-status Report
    • Int'l Joint Research
  • [Presentation] Correcting Aspect Ratio Distortion of Natural Images by Convolutional Neural Network2017

    • Author(s)
      Ryuhei Sakurai, Sasuke Yamane, Joo-Ho Lee
    • Organizer
      The 14th International Conference on Ubiquitous Robots and Ambient Intelligence (URAI 2017)
    • Related Report
      2017 Research-status Report
    • Int'l Joint Research
  • [Presentation] PCA-based Surgical Phases Estimation with a Multi-Camera System2017

    • Author(s)
      Dinh Tuan Tran, Ryuhei Sakurai, Hirotake Yamazoe, Joo-Ho Lee
    • Organizer
      The 14th International Conference on Ubiquitous Robots and Ambient Intelligence (URAI 2017)
    • Related Report
      2017 Research-status Report
    • Int'l Joint Research
  • [Presentation] Coexistable robotics : relief, safety and convenience2017

    • Author(s)
      Joo-Ho Lee
    • Organizer
      The 14th International Conference on Ubiquitous Robots and Ambient Intelligence (URAI 2017)
    • Related Report
      2017 Research-status Report
    • Int'l Joint Research / Invited
  • [Presentation] Description and recall of the object using processes with scene change using LSTM2017

    • Author(s)
      Masaki Yano, Tadashi Matsuo, Nobutaka Shimada
    • Organizer
      The 2nd Workshop on Machine Learning Methods for High-Level Cognitive Capabilities in Robotics 2017
    • Related Report
      2017 Research-status Report
    • Int'l Joint Research
  • [Presentation] Transform Invariant Auto-encoder2017

    • Author(s)
      Tadashi Matsuo, Hiroya Fukuhara, Nobutaka Shimada
    • Organizer
      The 2017 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2017)
    • Related Report
      2017 Research-status Report
    • Int'l Joint Research
  • [Remarks] 環境変化にロバストな画像データを用いたフェーズ推定及び評価

    • URL

      http://www.aislab.org/index.php/phase-estimation/

    • Related Report
      2018 Research-status Report
  • [Remarks] Phase Estimation

    • URL

      http://www.aislab.org/index.php/phase-estimation/

    • Related Report
      2017 Research-status Report

URL: 

Published: 2017-04-28   Modified: 2021-02-19  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi