• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

Real-time High Precision Multi-media Integration System Using Distributed Multi-sensor Network

Research Project

Project/Area Number 14380167
Research Category

Grant-in-Aid for Scientific Research (B)

Allocation TypeSingle-year Grants
Section一般
Research Field Intelligent informatics
Research InstitutionKYUSHU UNIVERSITY

Principal Investigator

TANIGUCHI Rin-ichiro  KYUSHU UNIVERSITY, Faculty of Information Science and Electrical Engineering, Professor, 大学院・システム情報科学研究院, 教授 (20136550)

Co-Investigator(Kenkyū-buntansha) TANIGUCHI Hideo  KYUSHU UNIVERSITY, Faculty of Information Science and Electrical Engineering, Associate Professor, 大学院・システム情報科学研究院, 助教授 (70253507)
KUSAKABE Shigeru  KYUSHU UNIVERSITY, Faculty of Information Science and Electrical Engineering, Associate Professor, 大学院・システム情報科学研究院, 助教授 (70234416)
ARITA Daisaku  KYUSHU UNIVERSITY, Faculty of Information Science and Electrical Engineering, Research Associate, 大学院・システム情報科学研究院, 助手 (70304756)
TSURUTA Naoyuki  Fukuoka University, Faculty of Engineering, Associate Professor, 工学部, 助教授 (60227478)
TSUTSUMI Fujio  Central Research Institute of Electric Power Industry, Researcher, 情報研究所, 所員(研究職) (70371664)
Project Period (FY) 2002 – 2004
Project Status Completed (Fiscal Year 2004)
Budget Amount *help
¥14,800,000 (Direct Cost: ¥14,800,000)
Fiscal Year 2004: ¥2,900,000 (Direct Cost: ¥2,900,000)
Fiscal Year 2003: ¥6,600,000 (Direct Cost: ¥6,600,000)
Fiscal Year 2002: ¥5,300,000 (Direct Cost: ¥5,300,000)
KeywordsSensor network / Parallel-distributed processing / Real-time processing / Confidence driven architecture / Quality and real-time feature / Multi-view image analysis / Computer vision / 分散処理 / ビジョンシステム
Research Abstract

The aim of this project is to provide a system to provide users "arbitrary views" of the real-world information depending on the users' demands.
To achieve this goal, we have to observe the real world precisely through a lot of sensors and to integrate the sensed data into a meaningful information coincide with the user's request. In this project, we have established a framework of real-time acquisition and integration of information from multiple sensors, especially multiple cameras. The major achievements of this project are summarized as follows.
1.Integration of images acquired by multiple cameras
We have established a software framework to integrate, in real-time, images acquired by multiple cameras on a parallel-distributed computers, PC cluster. To achieve the real-time issue, we have also developed a mechanism to make the processing time constant based on variable-resolution strategy, in which the resolution of 3D space is changed depending on the geometrical complexity of an obse … More rved object.
2.Real-time execution control of vision system
There is a trade-off between required confidence and required computational resources of vision processings. For example, when we require precise result, the longer processing time is required. In practical applications, especially real-time ones, we have to make this difficult trade-off depending on the required accuracy and the available resources. Here, we have established a real-time execution control mechanism, called Confidence Driven mechanism, which controls the trade-off dynamically, depending on the user's required confidence, based on prediction of data and accuracies of implemented algorithms.
3.Construction of prototypical systems and evaluation
Based on the previous results, we have implemented prototypical applications : real-time vision-based human motion capturing and real-time free view-point video on a PC cluster, which has 9 IEEE cameras and 20 or more PCs. The experimental results show the effectiveness of our software framework of real-time vision processing. Less

Report

(4 results)
  • 2004 Annual Research Report   Final Research Report Summary
  • 2003 Annual Research Report
  • 2002 Annual Research Report
  • Research Products

    (41 results)

All 2005 2004 2003 2002 Other

All Journal Article (29 results) Publications (12 results)

  • [Journal Article] Implementing a Real-time Free-viewpoint Video System on a PC-cluster2005

    • Author(s)
      上田 恵 他
    • Journal Title

      Proc.International Workshop on Computer Architecture for Machine Perception (発表予定)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2004 Annual Research Report 2004 Final Research Report Summary
  • [Journal Article] Implementing a Real-time Free-viewpoint Video System on A PC-cluster2005

    • Author(s)
      M.Ueda, et al.
    • Journal Title

      Proc.of Int.Workshop on Computer Architecture for Machine Perception (in press)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2004 Final Research Report Summary
  • [Journal Article] Human Action Sensing for Proactive Human Interface : Computer Vision Approach2004

    • Author(s)
      谷口倫一郎 他
    • Journal Title

      Proc.Workshop on Processing Sensory Information for Proactive Systems

      Pages: 23-29

    • NAID

      120006655230

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2004 Annual Research Report 2004 Final Research Report Summary
  • [Journal Article] Real-time Free-viewpoint Video Generation Using Multiple Cameras and a PC-cluster2004

    • Author(s)
      上田 恵 他
    • Journal Title

      Proc.Pacific-Rim Conf.on Multimedia (PCM2004)

      Pages: 418-425

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2004 Final Research Report Summary
  • [Journal Article] 3次元ビデオ映像のオンライン生成2004

    • Author(s)
      上田 恵 他
    • Journal Title

      画像の認識・理解シンポジウム(MIRU2004) 2

      Pages: 283-288

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2004 Annual Research Report 2004 Final Research Report Summary
  • [Journal Article] Confidence-driven Architecture for Real-time Vision Processing and Its Application to Efficient Vision-based Human Motion Sensing2004

    • Author(s)
      吉本 廣雅 他
    • Journal Title

      Proc.of the International Conference on Pattern Recognition 2

      Pages: 736-740

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2004 Annual Research Report 2004 Final Research Report Summary
  • [Journal Article] Real-time Human Motion Sensing based on Vision-based Inverse Kinematics for Interactive Applications2004

    • Author(s)
      伊達 直人 他
    • Journal Title

      Proc.of the International Conference on Pattern Recognition 3

      Pages: 318-321

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2004 Annual Research Report 2004 Final Research Report Summary
  • [Journal Article] Human Action Sensing for Proactive Human Interface Computer Vision Approach2004

    • Author(s)
      R.Taniguchi et al.
    • Journal Title

      Proc.Workshop on Processing Sensory Information for Proactive Systems

      Pages: 23-29

    • NAID

      120006655230

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2004 Final Research Report Summary
  • [Journal Article] Real-time Free-viewpoint Video Generation Using Multiple Cameras and a PC Cluster2004

    • Author(s)
      M.Ueda et al.
    • Journal Title

      Proc.of Pacific-Rim Conf.on Multimedia (PCM2004)

      Pages: 418-425

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2004 Final Research Report Summary
  • [Journal Article] On-line Free-viewpoint Video Generation Using Multiple Cameras and PC Cluster2004

    • Author(s)
      M.Ueda et al.
    • Journal Title

      Proc.of Meeting on Image Recognition and Understanding (MIRU2004) Vol.2

      Pages: 283-288

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2004 Final Research Report Summary
  • [Journal Article] Confidence-driven Architecture for Real-time Vision Processing and Its Application to Efficient Vision-based Human Motion Sensing2004

    • Author(s)
      H.Yoshimoto, et al.
    • Journal Title

      Proc.of Int.Conf.on Pattern Recognition (ICPR2004) Vol.2

      Pages: 736-740

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2004 Final Research Report Summary
  • [Journal Article] Real-time Human Motion Sensing based on Vision-based Inverse Kinematics for Interactive Applications2004

    • Author(s)
      N.Date, et al.
    • Journal Title

      Proc.of Int.Conf.on Pattern Recognition (ICPR2004) Vol.3

      Pages: 318-321

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2004 Final Research Report Summary
  • [Journal Article] Real-time Free-viewpoint Video Generation Using Multiple Cameras and a PC Cluster2004

    • Author(s)
      上田 恵 他
    • Journal Title

      Proc.Pacific-Rim Conf.on Multimedia(PCM2004)

      Pages: 418-425

    • Related Report
      2004 Annual Research Report
  • [Journal Article] Performance Evaluation of Vision-based Real-time Motion Capture2003

    • Author(s)
      伊達直人, 吉本廣雅, 有田大作, 米元聡, 谷口倫一郎
    • Journal Title

      Proc.of Workshop on Parallel and Distributed Image Processing, Video Processing, and Multimedia(PDIVM'2003) (CD-ROM)

    • NAID

      110003239859

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2004 Final Research Report Summary
  • [Journal Article] Confidence-driven Memory Architecture for Real-Time Vision System2003

    • Author(s)
      Hiromasa YOSHIMOTO, Daisaku Arita, Rin-ichiro Taniguchi
    • Journal Title

      Proceedings of Workshop on Computer Vision System Control Architectures (VSCA2003)

      Pages: 15-18

    • NAID

      120006655155

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2004 Final Research Report Summary
  • [Journal Article] 実時間ビジョンシステムのための信頼度駆動メモリ2003

    • Author(s)
      吉本廣雅, 浦田大作, 谷口倫一郎
    • Journal Title

      情報処理学会論文誌 44・10

      Pages: 2428-2436

    • NAID

      110002711580

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2004 Final Research Report Summary
  • [Journal Article] Vision-based Latency-free Real-time Human Motion Sensing2003

    • Author(s)
      H.Yoshimoto, N.Date, D.Arita, R.Taniguchi
    • Journal Title

      Proceedings of 10th Korea-Japan Joint Workshop on Frontiers of Computer Vision

      Pages: 244-249

    • NAID

      120006655245

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2004 Final Research Report Summary
  • [Journal Article] Vision-based Real-time Motion Capture System Using Multiple Cameras2003

    • Author(s)
      H.YOSHIMOTO, N.Date, D.Arita R.Taniguchi
    • Journal Title

      Proceedings of IEEE International Conference on Multisensor Fusion and Integration for Intelligent Systems (MFI2003)

      Pages: 247-251

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2004 Final Research Report Summary
  • [Journal Article] 実時間多視点画像解析とその応用2003

    • Author(s)
      谷口倫一郎
    • Journal Title

      画像電子学会第31回年次大会予稿集

      Pages: 139-145

    • NAID

      130004569729

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2004 Final Research Report Summary
  • [Journal Article] 実時間分散画像処理システムのための信頼度駆動アーキテクチャ2003

    • Author(s)
      吉本廣雅, 有田大作, 谷口倫一郎
    • Journal Title

      「ハイパフォーマンスコンピューティングとアーキテクチャの評価」に関する北海道ワークショップ(HOKKE-2004) ARC149/HPC97

    • NAID

      110002774603

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2004 Final Research Report Summary
  • [Journal Article] Performance Evaluation of Vision-based Real-time Motion Capture2003

    • Author(s)
      N.Date, et al.
    • Journal Title

      Proc.of Workshop on Parallel and Distributed Image Processing, Video Processing, and Multi-media (PDIVM) (CD-ROM)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2004 Final Research Report Summary
  • [Journal Article] Confidence-driven Memory Architecture for Real-Time Vision2003

    • Author(s)
      H.Yoshimoto et al.
    • Journal Title

      Proc.of Workshop on Computer Vision System Architecture (VSCA2003)

      Pages: 15-18

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2004 Final Research Report Summary
  • [Journal Article] Confidence-driven Memory for Vision System2003

    • Author(s)
      H.Yoshimoto et al.
    • Journal Title

      IPSJ Journal Vol.44, No.10

      Pages: 2428-2436

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2004 Final Research Report Summary
  • [Journal Article] Vision-based Latency-free Real-time Human Motion Sensing2003

    • Author(s)
      H.Yoshimoto et al.
    • Journal Title

      Proc.of 10th Korea-Japan Joint Workshop on Frontiers of Computer Vision (FCV2003)

      Pages: 244-249

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2004 Final Research Report Summary
  • [Journal Article] Vision-based Real-time Motion Capture System Using Multiple Cameras2003

    • Author(s)
      H.Yoshimoto, et al.
    • Journal Title

      Proc.of IEEE Int. Conf. on Multisensor Fusion and Integration for Intelligent Systems (MFI2003)

      Pages: 247-251

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2004 Final Research Report Summary
  • [Journal Article] Real-time Multi-view Image Analysis and Its Application2003

    • Author(s)
      R.Taniguchi
    • Journal Title

      Proc.of 31^<st> IIEEJ Annual Conference

      Pages: 139-145

    • NAID

      130004569729

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2004 Final Research Report Summary
  • [Journal Article] Confidence-driven Architecture for Real-time Distributed Image Processing System2003

    • Author(s)
      H.Yoshimoto, et al.
    • Journal Title

      IPSJ SIG Technical Reports 2003-HPC-097-15

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2004 Final Research Report Summary
  • [Journal Article] Confidence driven Memory architecture : A real-time communication for distributed vision processing2002

    • Author(s)
      吉本廣雅, 有田大作, 谷口倫一郎
    • Journal Title

      Proc.of International Workshop on Informations Engineering

      Pages: 349-354

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2004 Final Research Report Summary
  • [Journal Article] Confidence driven Memory architecture : A real-time communication for distributed vision processing2002

    • Author(s)
      H.Yoshimoto, et al.
    • Journal Title

      Proc.of International Workshop on Information Engineering

      Pages: 349-354

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2004 Final Research Report Summary
  • [Publications] 吉本廣雅, 有田大作, 谷口倫一郎: "実時間ビジョンシステムのための信頼度駆動メモリ"情報処理学会論文誌. 44・10. 2428-2436 (2003)

    • Related Report
      2003 Annual Research Report
  • [Publications] H.Yoshimoto, N.Date, D.Arita, R.Taniguchi: "Vision-based Latency-free Real-time Human Motion Sensing"Proceedings of 1Oth Korea-Japan Joint Workshop on Frontiers of Computer Vision. 244-249 (2003)

    • Related Report
      2003 Annual Research Report
  • [Publications] Hiromasa YOSHIMOTO, Daisaku Arita, Rin-ichiro Taniguchi: "Confidence-driven Memory Architecture for Real-Time Vision System"Proceedings of Workshop on Computer Vision System Control Architectures (VSCA2003). 15-18 (2003)

    • Related Report
      2003 Annual Research Report
  • [Publications] H.YOSHIMOTO, N.Date, D.Arita, R.Taniguchi: "Vision-based Real-time Motion Capture System Using Multiple Cameras"Proceedings of IEEE International Conference on Multisensor Fusion and Integration for Intelligent Systems (MFI2003). 247-251 (2003)

    • Related Report
      2003 Annual Research Report
  • [Publications] 谷口倫一郎: "実時間多視点画像解析とその応用"画像電子学会第31回年次大会予稿集. 139-145 (2003)

    • Related Report
      2003 Annual Research Report
  • [Publications] 吉本廣雅, 有田大作, 谷口倫一郎: "実時間分散画像処理システムのための信頼度駆動アーキテクチャ"「ハイパフォーマンスコンピューティングとアーキテクチャの評価」に関する北海道ワークショップ(HOKKE-2004). (発表予定). (2003)

    • Related Report
      2003 Annual Research Report
  • [Publications] 吉本廣雅, 有田大作, 谷口倫一郎: "Confidence driven Memory architecture : A real-time communication for distributed vision processing"Proc. of International Workshop on Information Engineering. 349-354 (2002)

    • Related Report
      2002 Annual Research Report
  • [Publications] 谷口倫一郎: "分散画像処理の動向と課題"精密工学会画像応用技術専門委員会研究会報告. 1-10 (2002)

    • Related Report
      2002 Annual Research Report
  • [Publications] 吉本廣雅, 有田大作, 谷口倫一郎: "実時間ビジョンシステムのための信頼度駆動メモリ"画像の認識・理解シンポジウム講演論文集. II. 295-302 (2002)

    • Related Report
      2002 Annual Research Report
  • [Publications] 伊達直人, 吉本廣雅, 有田大作, 米元聡, 谷口倫一郎: "ビジョンベース実時間モーションキャプチャシステムの精度評価"電子情報通信学会2003年総合全国大会講演論文集. (発表予定). (2003)

    • Related Report
      2002 Annual Research Report
  • [Publications] 伊達直人, 吉本廣雅, 有田大作, 米元聡, 谷口倫一郎: "Performance Evaluation of Vision-based Real-time Motion Capture"Workshop on Parallel Distributed Image Processing, Video Processing, and Multimedia (PDIVM'2003). (発表予定). (2003)

    • Related Report
      2002 Annual Research Report
  • [Publications] 吉本廣雅, 有田大作, 谷口倫一郎: "# Confidence-driven Memory Architecture for Real-Time Vision"Workshop on Computer Vision System Control Architectures (VSCA2003). (発表予定). (2003)

    • Related Report
      2002 Annual Research Report

URL: 

Published: 2002-04-01   Modified: 2016-04-21  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi