• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

Detecting the moving objects of special trajectories by fusing laser range scanners and video cameras

Research Project

Project/Area Number 17300057
Research Category

Grant-in-Aid for Scientific Research (B)

Allocation TypeSingle-year Grants
Section一般
Research Field Perception information processing/Intelligent robotics
Research InstitutionThe University of Tokyo

Principal Investigator

ZHAO Huijing  Univ. of Tokyo, Center for Spatial Information Science, Visiting Associate Professor, 空間情報科学研究センター, 外国人客員教授 (80396796)

Co-Investigator(Kenkyū-buntansha) SHIBASAKI Ryosuke  Univ. of Tokyo, Center for Spatial Information Science, Professor, 空間情報科学研究センター, 教授 (70206126)
Project Period (FY) 2005 – 2006
Project Status Completed (Fiscal Year 2006)
Budget Amount *help
¥15,700,000 (Direct Cost: ¥15,700,000)
Fiscal Year 2006: ¥4,400,000 (Direct Cost: ¥4,400,000)
Fiscal Year 2005: ¥11,300,000 (Direct Cost: ¥11,300,000)
Keywordslaser scanner / moving object / tracking / detection / classification / behavior analysis / video camera
Research Abstract

In this two years project, the following results are achieved.
1. Algorithms for moving objects' detection, tracking and classification using laser scan data.
The topic is studied in two levels. 1) In the environment such as an intersection, where different kinds of moving objects exist, an algorithm is developed for joint detection, tracking and classification of moving objects using laser scan data. 2) In the environment where there are pedestrians only, in order to precisely detected walking pattern, and estimate walking trajectories, a detailed walking model is defined, and algorithms of tracking pedestrians in dense crowded situations using particle filter are studied.
2. Algorithms for fusing laser with vision. It includes the following sub-topics : 1) extracting image attribute; 2) matching for the same person, 3) laser and video based tracking.
In the case of dense crowded situation, there are limitations in precise tracking based only on laser data. Also laser-based tracking can n … More ot obtain the other information except the sequence of XY coordinates. So that a measurement system by fusing laser with vision, an algorithm of extracting image attributes, an algorithm of matching on both trajectory and image attributes to look for the same moving objects, and a tracking by fusing both laser and vision are developed.
3. Behavior analysis - looking for special trajectories. It includes the following sub-topics : 1) walking parameters extraction and gait recognition, 2) personal behavior analysis, 3) group behavior analysis.
A detailed walking model is defined, the walking parameters such as stride, speed and acceleration of both feet are extracted, an algorithm is developed to recognize personal gait characteristics based on the above walking parameters. On the other hand, personal walking behavior is studied based on both gait and trajectory parameters. An algorithm is developed to divide the personal behaviors into normal and abnormal ones. In addition, algorithm is developed to find the main streams from the mass of trajectories, and an application of the results for advanced air-conditioning control is proposed and tested on simulation.
4. A number of field experiments are conducted to acquire real data. All the algorithms in this project are developed and examined on the true data and aiming for true applications. Less

Report

(3 results)
  • 2006 Annual Research Report   Final Research Report Summary
  • 2005 Annual Research Report
  • Research Products

    (32 results)

All 2007 2006 2005

All Journal Article (30 results) Book (2 results)

  • [Journal Article] Monitoring a populated environment using single-row laser range scanners from a mobile platform2007

    • Author(s)
      Zhao, H., Chen, Y., Shao, X.W., Katabira, K., Shibasaki, R.
    • Journal Title

      IEEE Int. Conf. on Robotics and Automation (ICRA)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2006 Final Research Report Summary
  • [Journal Article] レーザスキャナを用いた歩容解析に基づく非定常歩行の認識2007

    • Author(s)
      中村克行, 邵 肖偉, 趙 卉菁, 柴崎亮介
    • Journal Title

      電気学会論文誌C(電子・情報・システム部門誌) vol. 127, no. 4(印刷中)

    • NAID

      130000090509

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2006 Final Research Report Summary
  • [Journal Article] Laser-based Detection and Tracking of Multiple People in Crowds2007

    • Author(s)
      Cui, J., Zha, H., Zhao, H., Shibasaki, R.
    • Journal Title

      Computer Vision and Image Understanding (CVIU) (印刷中)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2006 Final Research Report Summary
  • [Journal Article] Laser-based Detection and Tracking of Multiple People in Crowds2007

    • Author(s)
      Cui, J., H.Zha, H.Zhao, R.Shibasaki
    • Journal Title

      Computer Vision and Image Understanding (CVIU), special issue on "Advances in Vision Algorithms and Systems Beyond the Visible Spectrum

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2006 Final Research Report Summary
  • [Journal Article] An approach of laser-based vehicle monitor2007

    • Author(s)
      Li, W., Zhang, R., Liu, Z., Zhao, H., Shibasaki, R.
    • Journal Title

      Applied Mathematics and Computation 185

      Pages: 953-962

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2006 Final Research Report Summary
  • [Journal Article] Monitoring a populated environment using single-row laser range scanners from a mobile platform2007

    • Author(s)
      Zhao, H., Chen, Y, Shao, X.W., Katabira, K., Shibasaki, R.
    • Journal Title

      IEEE Int.Conf.on Robotics and Automation (ICRA)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2006 Final Research Report Summary
  • [Journal Article] Tracking pedestrians using multiple single-row laser range scanners and its reliability evaluation2006

    • Author(s)
      Nakamura, K., Zhao, H., Shibasaki, R., Sakamoto, K., Ohga, T., Suzukawa, N.
    • Journal Title

      Systems and computers in Japan vol.37, no. 7

      Pages: 1-11

    • NAID

      10016795882

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2006 Final Research Report Summary
  • [Journal Article] Joint tracking and classification of moving objects in cross road using single-row laser range scanner2006

    • Author(s)
      Zhao, H., Shao, X.W., Katabira, K., Shibasaki, R.
    • Journal Title

      IEEE Int. Conf. on Intelligent Transportation Systems (ITSC06)

      Pages: 287-294

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2006 Final Research Report Summary
  • [Journal Article] Analyzing Pedestrians' Walking Patterns Using Single-Row Laser Range Scanners2006

    • Author(s)
      Shao, X.W., Zhao, H., Nakamura, K., Shibasaki, R.
    • Journal Title

      IEEE Int. Conf. on Systems, Man, and Cybernetics (SMC06).

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2006 Final Research Report Summary
  • [Journal Article] Tracking pedestrians using multiple single-row laser range scanners and its reliability evaluation2006

    • Author(s)
      Nakamura, K., Zhao, H., Shibasaki, R., Sakamoto, K., Ohga, T., Suzukawa, N.
    • Journal Title

      Systems and computers in Japan vol.37, no.7

      Pages: 1-11

    • NAID

      10016795882

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2006 Final Research Report Summary
  • [Journal Article] Joint tracking and classification of moving objects in cross road using single-row laser range scanner2006

    • Author(s)
      Zhao, H., Shao, X.W., Katabira, K., Shibasaki, R.
    • Journal Title

      IEEE Int.Conf.on Intelligent Transportation Systems (ITSC06)

      Pages: 287-294

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2006 Final Research Report Summary
  • [Journal Article] Analyzing Pedestrians' Walking Patterns Using Single-Row Laser Range Scanners2006

    • Author(s)
      Shao, X.W., Zhao, H., Nakamura, K., Shibasaki, R.
    • Journal Title

      IEEE Int.Conf.on Systems, Man, and Cybernetics (SMC06)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2006 Final Research Report Summary
  • [Journal Article] Laser-based Interacting People Tracking Using Multi-level Observations2006

    • Author(s)
      Cui, J., Zha, H., Zhao, H., Shibasaki, R.
    • Journal Title

      IEEE/RSJ Int.Conf.on Intelligent Robots and Systems (IROS06)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2006 Final Research Report Summary
  • [Journal Article] Detection incorporated joint particle filter for laser based multiple people tracking2006

    • Author(s)
      Cui, J., Zha, H., Zhao, H., Shibasaki, R.
    • Journal Title

      IEEE Int.Conf.on Computer Vision and Pattern Recognition (CVPRO6)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2006 Final Research Report Summary
  • [Journal Article] Real-time monitoring for people behavior and indoor temperature distribution using laser range scanners and sensor networks for advanced air conditioning control2006

    • Author(s)
      Katabira, K., Zhao, H., Shibasaki, R., Ariyama, I.
    • Journal Title

      Proc.Int.Conf.on Network Sensing Systems (INSS06)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2006 Final Research Report Summary
  • [Journal Article] A Method for Human Extraction in Crowded Scenes by using Multiple Laser Range Scanners and CCD Cameras2006

    • Author(s)
      Takahashi, H., Nakamura, K., Zhao, H., Shibasaki, R.
    • Journal Title

      The 27th Asian Conference on Remote Sensing, Mongolia

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2006 Final Research Report Summary
  • [Journal Article] Tracking pedestrians using multiple single-row laser range scanners and its reliability evaluation2006

    • Author(s)
      Nakamura, K., Zhao, H., Shibasaki, K., Sakamoto, K., Ohga, T., Suzukawa, N.
    • Journal Title

      Systems and computers in Japan Vol. 37, no. 7

      Pages: 1-11

    • NAID

      10016795882

    • Related Report
      2006 Annual Research Report
  • [Journal Article] Joint tracking and classification of moving objects in cross road using single-row laser range scanner2006

    • Author(s)
      Zhao, H., Shao, X.W., Katabira, K., Shibasaki, R.
    • Journal Title

      Proc. IEEE Int. Conf. on Intelligent Transportation Systems (ITSCO6)

      Pages: 287-294

    • Related Report
      2006 Annual Research Report
  • [Journal Article] Analyzing Pedestrians' Walking Patterns Using Single-Row Laser Range Scanners2006

    • Author(s)
      Shao, X.W., Zhao, H., Nakamura, K., Shibasaki, R.
    • Journal Title

      Proc. IEEE Int. Conf. on Systems, Man, and Cybernetics (SMC06).

    • Related Report
      2006 Annual Research Report
  • [Journal Article] Laser-based Interacting People Tracking Using Multi-level Observations2006

    • Author(s)
      Cui, J., Zha, H., Zhao, H., Shibasaki, R.
    • Journal Title

      IEEE/RSJ Int. Cont. on Intelligent Robots and Systems (IROS06)

      Pages: 1799-1784

    • Related Report
      2006 Annual Research Report
  • [Journal Article] One Class SVMを用いた非定常歩行の検出2006

    • Author(s)
      中村克行, 趙 卉菁, 柴崎亮介
    • Journal Title

      電子情報通信学会2006総合大会 情報・システム講演論文集2 D-12-61

    • Related Report
      2006 Annual Research Report
  • [Journal Article] レーザスキャナを用いた群集の歩容抽出と行動認識2006

    • Author(s)
      中村克行, 邵肖偉, 趙卉菁, 柴崎亮介
    • Journal Title

      第12回 画像センシングシンポジウム

    • Related Report
      2006 Annual Research Report
  • [Journal Article] Chapter 4. A laser scanner system for acquiring walking trajectory data and its possible applications to behavioral science2005

    • Author(s)
      Zhao, H., K.Nakamura, R.Shibasaki
    • Journal Title

      GIS-based Studies in the Humanties and Social Sciences. (Taylor & Francis)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2006 Final Research Report Summary
  • [Journal Article] A real-time system for monitoring pedestrians2005

    • Author(s)
      Zhao, H., R.Shibasaki
    • Journal Title

      Proc.of 7^<th> IEEE Workshop on Applications of Computer Vision

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2006 Final Research Report Summary
  • [Journal Article] レーザスキャナと画像センサの融合による歩行者追跡2005

    • Author(s)
      中村克行, 趙卉菁, 柴崎亮介
    • Journal Title

      第11回画像センシングシンポジウム講演論文集

      Pages: 177-180

    • Related Report
      2005 Annual Research Report
  • [Journal Article] 複数のレーザレンジスキャナを用いた歩行者トラッキングとその信頼性評価2005

    • Author(s)
      中村克行, 趙 卉菁, 柴崎亮介, 坂本圭司, 大鋸朋生, 鈴川尚毅
    • Journal Title

      電子情報通信学会論文誌D-II J88-D-11-7

      Pages: 1143-1152

    • Related Report
      2005 Annual Research Report
  • [Journal Article] 遮蔽に頑健な広域群集追跡2005

    • Author(s)
      中村克行, 趙 卉菁, 柴崎亮介
    • Journal Title

      日本工業出版画像ラボ 16-11

      Pages: 32-35

    • Related Report
      2005 Annual Research Report
  • [Journal Article] Tracking multiple people using laser and vision2005

    • Author(s)
      Cui, J., Zha, H., Zhao, H., Shibasaki, R.
    • Journal Title

      Proc. of IEEE/RSJ International Conference on Intelligent Robots and Systems

      Pages: 1301-1306

    • Related Report
      2005 Annual Research Report
  • [Journal Article] A novel system for tracking pedestrians using multiple single-row laser range scanners2005

    • Author(s)
      Zhao, H., Shibasaki, R.
    • Journal Title

      IEEE Trans. SMC Part A: Systems and Humans 35/2

      Pages: 283-291

    • Related Report
      2005 Annual Research Report
  • [Journal Article] A real-time system for monitoring pedestrians2005

    • Author(s)
      Zhao, H., Shibasaki, R.
    • Journal Title

      Proc. of 7th IEEE Workshop on Applications of Computer Vision

      Pages: 378-385

    • Related Report
      2005 Annual Research Report
  • [Book] GIS-based Studies in the Humanties and Social Sciences : Chapter 4. A laser scanner system for acquiring walking trajectory data and its possible applications to behavioral science2005

    • Author(s)
      Zhao, H., K.Nakamura, R.Shibasaki
    • Publisher
      Taylor & Francis
    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2006 Final Research Report Summary
  • [Book] GIS-based Studies in the Humanties and Social Sciences: Chapter 4. A laser scanner system for acquiring walking trajectory data and its possible applications to behavioral science2005

    • Author(s)
      Zhao, H., K.Nakamura, R.Shibasaki
    • Publisher
      Taylor & Francis
    • Related Report
      2005 Annual Research Report

URL: 

Published: 2005-04-01   Modified: 2016-04-21  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi