• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to project page

2006 Fiscal Year Final Research Report Summary

Detecting the moving objects of special trajectories by fusing laser range scanners and video cameras

Research Project

Project/Area Number 17300057
Research Category

Grant-in-Aid for Scientific Research (B)

Allocation TypeSingle-year Grants
Section一般
Research Field Perception information processing/Intelligent robotics
Research InstitutionThe University of Tokyo

Principal Investigator

ZHAO Huijing  Univ. of Tokyo, Center for Spatial Information Science, Visiting Associate Professor, 空間情報科学研究センター, 外国人客員教授 (80396796)

Co-Investigator(Kenkyū-buntansha) SHIBASAKI Ryosuke  Univ. of Tokyo, Center for Spatial Information Science, Professor, 空間情報科学研究センター, 教授 (70206126)
Project Period (FY) 2005 – 2006
Keywordslaser scanner / moving object / tracking / detection / classification / behavior analysis / video camera
Research Abstract

In this two years project, the following results are achieved.
1. Algorithms for moving objects' detection, tracking and classification using laser scan data.
The topic is studied in two levels. 1) In the environment such as an intersection, where different kinds of moving objects exist, an algorithm is developed for joint detection, tracking and classification of moving objects using laser scan data. 2) In the environment where there are pedestrians only, in order to precisely detected walking pattern, and estimate walking trajectories, a detailed walking model is defined, and algorithms of tracking pedestrians in dense crowded situations using particle filter are studied.
2. Algorithms for fusing laser with vision. It includes the following sub-topics : 1) extracting image attribute; 2) matching for the same person, 3) laser and video based tracking.
In the case of dense crowded situation, there are limitations in precise tracking based only on laser data. Also laser-based tracking can n … More ot obtain the other information except the sequence of XY coordinates. So that a measurement system by fusing laser with vision, an algorithm of extracting image attributes, an algorithm of matching on both trajectory and image attributes to look for the same moving objects, and a tracking by fusing both laser and vision are developed.
3. Behavior analysis - looking for special trajectories. It includes the following sub-topics : 1) walking parameters extraction and gait recognition, 2) personal behavior analysis, 3) group behavior analysis.
A detailed walking model is defined, the walking parameters such as stride, speed and acceleration of both feet are extracted, an algorithm is developed to recognize personal gait characteristics based on the above walking parameters. On the other hand, personal walking behavior is studied based on both gait and trajectory parameters. An algorithm is developed to divide the personal behaviors into normal and abnormal ones. In addition, algorithm is developed to find the main streams from the mass of trajectories, and an application of the results for advanced air-conditioning control is proposed and tested on simulation.
4. A number of field experiments are conducted to acquire real data. All the algorithms in this project are developed and examined on the true data and aiming for true applications. Less

  • Research Products

    (19 results)

All 2007 2006 2005

All Journal Article (18 results) Book (1 results)

  • [Journal Article] Monitoring a populated environment using single-row laser range scanners from a mobile platform2007

    • Author(s)
      Zhao, H., Chen, Y., Shao, X.W., Katabira, K., Shibasaki, R.
    • Journal Title

      IEEE Int. Conf. on Robotics and Automation (ICRA)

    • Description
      「研究成果報告書概要(和文)」より
  • [Journal Article] レーザスキャナを用いた歩容解析に基づく非定常歩行の認識2007

    • Author(s)
      中村克行, 邵 肖偉, 趙 卉菁, 柴崎亮介
    • Journal Title

      電気学会論文誌C(電子・情報・システム部門誌) vol. 127, no. 4(印刷中)

    • Description
      「研究成果報告書概要(和文)」より
  • [Journal Article] Laser-based Detection and Tracking of Multiple People in Crowds2007

    • Author(s)
      Cui, J., Zha, H., Zhao, H., Shibasaki, R.
    • Journal Title

      Computer Vision and Image Understanding (CVIU) (印刷中)

    • Description
      「研究成果報告書概要(和文)」より
  • [Journal Article] Laser-based Detection and Tracking of Multiple People in Crowds2007

    • Author(s)
      Cui, J., H.Zha, H.Zhao, R.Shibasaki
    • Journal Title

      Computer Vision and Image Understanding (CVIU), special issue on "Advances in Vision Algorithms and Systems Beyond the Visible Spectrum

    • Description
      「研究成果報告書概要(欧文)」より
  • [Journal Article] An approach of laser-based vehicle monitor2007

    • Author(s)
      Li, W., Zhang, R., Liu, Z., Zhao, H., Shibasaki, R.
    • Journal Title

      Applied Mathematics and Computation 185

      Pages: 953-962

    • Description
      「研究成果報告書概要(欧文)」より
  • [Journal Article] Monitoring a populated environment using single-row laser range scanners from a mobile platform2007

    • Author(s)
      Zhao, H., Chen, Y, Shao, X.W., Katabira, K., Shibasaki, R.
    • Journal Title

      IEEE Int.Conf.on Robotics and Automation (ICRA)

    • Description
      「研究成果報告書概要(欧文)」より
  • [Journal Article] Tracking pedestrians using multiple single-row laser range scanners and its reliability evaluation2006

    • Author(s)
      Nakamura, K., Zhao, H., Shibasaki, R., Sakamoto, K., Ohga, T., Suzukawa, N.
    • Journal Title

      Systems and computers in Japan vol.37, no. 7

      Pages: 1-11

    • Description
      「研究成果報告書概要(和文)」より
  • [Journal Article] Joint tracking and classification of moving objects in cross road using single-row laser range scanner2006

    • Author(s)
      Zhao, H., Shao, X.W., Katabira, K., Shibasaki, R.
    • Journal Title

      IEEE Int. Conf. on Intelligent Transportation Systems (ITSC06)

      Pages: 287-294

    • Description
      「研究成果報告書概要(和文)」より
  • [Journal Article] Analyzing Pedestrians' Walking Patterns Using Single-Row Laser Range Scanners2006

    • Author(s)
      Shao, X.W., Zhao, H., Nakamura, K., Shibasaki, R.
    • Journal Title

      IEEE Int. Conf. on Systems, Man, and Cybernetics (SMC06).

    • Description
      「研究成果報告書概要(和文)」より
  • [Journal Article] Tracking pedestrians using multiple single-row laser range scanners and its reliability evaluation2006

    • Author(s)
      Nakamura, K., Zhao, H., Shibasaki, R., Sakamoto, K., Ohga, T., Suzukawa, N.
    • Journal Title

      Systems and computers in Japan vol.37, no.7

      Pages: 1-11

    • Description
      「研究成果報告書概要(欧文)」より
  • [Journal Article] Joint tracking and classification of moving objects in cross road using single-row laser range scanner2006

    • Author(s)
      Zhao, H., Shao, X.W., Katabira, K., Shibasaki, R.
    • Journal Title

      IEEE Int.Conf.on Intelligent Transportation Systems (ITSC06)

      Pages: 287-294

    • Description
      「研究成果報告書概要(欧文)」より
  • [Journal Article] Analyzing Pedestrians' Walking Patterns Using Single-Row Laser Range Scanners2006

    • Author(s)
      Shao, X.W., Zhao, H., Nakamura, K., Shibasaki, R.
    • Journal Title

      IEEE Int.Conf.on Systems, Man, and Cybernetics (SMC06)

    • Description
      「研究成果報告書概要(欧文)」より
  • [Journal Article] Laser-based Interacting People Tracking Using Multi-level Observations2006

    • Author(s)
      Cui, J., Zha, H., Zhao, H., Shibasaki, R.
    • Journal Title

      IEEE/RSJ Int.Conf.on Intelligent Robots and Systems (IROS06)

    • Description
      「研究成果報告書概要(欧文)」より
  • [Journal Article] Detection incorporated joint particle filter for laser based multiple people tracking2006

    • Author(s)
      Cui, J., Zha, H., Zhao, H., Shibasaki, R.
    • Journal Title

      IEEE Int.Conf.on Computer Vision and Pattern Recognition (CVPRO6)

    • Description
      「研究成果報告書概要(欧文)」より
  • [Journal Article] Real-time monitoring for people behavior and indoor temperature distribution using laser range scanners and sensor networks for advanced air conditioning control2006

    • Author(s)
      Katabira, K., Zhao, H., Shibasaki, R., Ariyama, I.
    • Journal Title

      Proc.Int.Conf.on Network Sensing Systems (INSS06)

    • Description
      「研究成果報告書概要(欧文)」より
  • [Journal Article] A Method for Human Extraction in Crowded Scenes by using Multiple Laser Range Scanners and CCD Cameras2006

    • Author(s)
      Takahashi, H., Nakamura, K., Zhao, H., Shibasaki, R.
    • Journal Title

      The 27th Asian Conference on Remote Sensing, Mongolia

    • Description
      「研究成果報告書概要(欧文)」より
  • [Journal Article] Chapter 4. A laser scanner system for acquiring walking trajectory data and its possible applications to behavioral science2005

    • Author(s)
      Zhao, H., K.Nakamura, R.Shibasaki
    • Journal Title

      GIS-based Studies in the Humanties and Social Sciences. (Taylor & Francis)

    • Description
      「研究成果報告書概要(欧文)」より
  • [Journal Article] A real-time system for monitoring pedestrians2005

    • Author(s)
      Zhao, H., R.Shibasaki
    • Journal Title

      Proc.of 7^<th> IEEE Workshop on Applications of Computer Vision

    • Description
      「研究成果報告書概要(欧文)」より
  • [Book] GIS-based Studies in the Humanties and Social Sciences : Chapter 4. A laser scanner system for acquiring walking trajectory data and its possible applications to behavioral science2005

    • Author(s)
      Zhao, H., K.Nakamura, R.Shibasaki
    • Publisher
      Taylor & Francis
    • Description
      「研究成果報告書概要(和文)」より

URL: 

Published: 2008-05-27  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi