mathematical modeling of human behavior in video image

• Project/Area Number: 15KT0021
• Research Category: Grant-in-Aid for Scientific Research (B)
• Allocation Type: Multi-year Fund
• Section: 特設分野
• Research Field: Mathematical Sciences in Search of New Cooperation
• Research Institution: Hosei University (2018); Kogakuin University (2015-2017)
• Principal Investigator: KONISHI KATSUMI 法政大学, 情報科学部, 教授 (20339138)
• Co-Investigator(Kenkyū-buntansha): 古川 利博 東京理科大学, 工学部情報工学科, 教授 (00190140)
• Project Period (FY): 2015-07-10 – 2019-03-31
• Project Status: Completed (Fiscal Year 2018)
• Budget Amount: ¥12,480,000 (Direct Cost: ¥9,600,000、Indirect Cost: ¥2,880,000); Fiscal Year 2018: ¥2,860,000 (Direct Cost: ¥2,200,000、Indirect Cost: ¥660,000); Fiscal Year 2017: ¥2,860,000 (Direct Cost: ¥2,200,000、Indirect Cost: ¥660,000); Fiscal Year 2016: ¥2,210,000 (Direct Cost: ¥1,700,000、Indirect Cost: ¥510,000); Fiscal Year 2015: ¥4,550,000 (Direct Cost: ¥3,500,000、Indirect Cost: ¥1,050,000)
• Keywords: 圧縮センシング / 行列ランク最小化 / 信号修復 / 低ランクアプローチ / 多様体学習 / 動画像推定 / 信号推定

Outline of Final Research Achievements

This work provided a estimation method for unoberved human behavior in video image and proposed a new mathematical model to describe human behavior in video image by a weighted combination of linear systems.

Academic Significance and Societal Importance of the Research Achievements

本研究により、防犯カメラ等で撮影された人物行動のうち、障害物により遮蔽されて観測できなかった行動を精度高く推定することが可能となった。これにより、本来であれば見えない行動も見えるようになり、防犯カメラの犯罪抑止能力の向上へとつながる。また、人物行動の推定は、低次元多様体上の信号修復問題と定式化され、本研究により、同問題を効率良く解く手法が導出された。この点に、本研究の信号処理分野における学術的意義がある。

Research Products

• [Journal Article] Image Colorization Based on Locally Linear Embedding (2018)
  • Author(s): Aiyoshizawa Takeshi、Konishi Katsumi、Uruma Kazunori、Sasaki Ryohei、Takahashi Tomohiro、Furukawa Toshihiro
  • Journal Title: Journal of Signal Processing Volume: 22 Issue: 4 Pages: 203-206
  • DOI: 10.2299/jsp.22.203
  • NAID: 130007419290
  • ISSN: 1342-6230, 1880-1013
  • Year and Date: 2018-07-25
  • Peer Reviewed
• [Journal Article] Multiple Matrix Rank Minimization Approach to Audio Declipping (2018)
  • Author(s): R. Sasaki, K. Konishi, T. Takahashi, T. Furukawa
  • Journal Title: IEICE Transactions on Information and Systems Volume: E101.D Issue: 3 Pages: 821-825
  • DOI: 10.1587/transinf.2017EDL8129
  • NAID: 130006414077
  • ISSN: 0916-8532, 1745-1361
  • Peer Reviewed / Open Access
• [Presentation] 教師なし学習と制御 (2019)
  • Author(s): 小西克巳
  • Organizer: 計測自動制御学会 第６回 制御部門マルチシンポジウム
  • Invited
• [Presentation] Multi resolution block Hankel matrices rank minimization based image inpainting (2019)
  • Author(s): T. Takahashi, K. Konishi, K. Uruma and T. Furukawa
  • Organizer: RISP International Workshop on NCSP
  • Int'l Joint Research
• [Presentation] 局所次元削減に基づく多様体上の部分欠損修復と画像修復への応用 (2018)
  • Author(s): 佐々木 亮平, 小西 克巳, 高橋 智博, 古川 利博
  • Organizer: 第31回回路とシステムワークショップ
• [Presentation] Locally Low Rank Approach to Human Motion Modeling and Inpainting (2018)
  • Author(s): Atushi Kanayama, Tomoki Shise, Takashi Takekawa and Katsumi Konishi
  • Organizer: SICE annual conference
  • Int'l Joint Research
• [Presentation] Low-Rank and Locally Linear Embedding Approach to Image Inpainting (2018)
  • Author(s): R. Sasaki, K. Konishi, T. Takahashi, T. Furukawa
  • Organizer: IEEE VCIP
  • Int'l Joint Research
• [Presentation] グラフ分割を用いた局所低ランク化に基づく非線形行列完成手法の高速化 (2018)
  • Author(s): 至勢 智貴，小西 克巳，佐々木 亮平，古川 利博
  • Organizer: 第３３回信号処理シンポジウム
• [Presentation] 局所低ランク行列アプローチによる多様体上の信号修復手法 (2018)
  • Author(s): 小西克巳，至勢智貴，佐々木亮平，古川利博
  • Organizer: 第５回制御部門マルチシンポジウム
• [Presentation] Matrix Rank Minimization and Locally Linear Embedding Approach to Nonlinear Matrix Completion Problems (2018)
  • Author(s): Tomoki Shise, Ryohei Sasaki, Katsumi Konishi, Toshihiro Furukawa
  • Organizer: RISP International Workshop on Nonlinear Circuits, Communications and Signal Processing
  • Int'l Joint Research
• [Presentation] Estimation of walking movement based on particle filter using past observed signals (2017)
  • Author(s): Yurie Tajima, Yuho Tanaka, Ryohei Sasaki, Katsumi Konishi, Tomohiro Takahashi, Toshihiro Furukawa
  • Organizer: RISP International Workshop on Nonlinear Circuits, Communications and Signal Processing
  • Place of Presentation: 米国グアム
  • Year and Date: 2017-02-28
  • Int'l Joint Research
• [Presentation] An Emergency Detection Algorithm for A Security Camera using Optical Flow (2017)
  • Author(s): Akira Horinouchi and Katsumi Konishi
  • Organizer: RISP International Workshop on Nonlinear Circuits, Communications and Signal Processing
  • Place of Presentation: 米国グアム
  • Year and Date: 2017-02-28
  • Int'l Joint Research
• [Presentation] Matrix Rank Minimization Approach to Signal Recovery and Nonlinear Function Estimation for Nonlinear ARX Model with Input Nonlinearity (2017)
  • Author(s): K. Konishi, M. Fujii, K. Kuniya, S. Uda and S. Kuroda
  • Organizer: Asian Control Conference
  • Int'l Joint Research
• [Presentation] Estimation of Walking Movement of Human by Applying Particle Filter (2016)
  • Author(s): Shots Kikuchi, Katsumi Konishi, Tomohiro Takahashi and Toshihiro Furukawa
  • Organizer: RISP International Workshop on Nonlinear Circuits, Communications and Signal Processing
  • Place of Presentation: 米国ハワイ州ホノルル
  • Year and Date: 2016-03-06
  • Int'l Joint Research
• [Presentation] Pedestrian Motion Estimation Based on Just-In-Time Method (2016)
  • Author(s): Alateeq Salman and Katsumi Konishi
  • Organizer: RISP International Workshop on Nonlinear Circuits, Communications and Signal Processing
  • Place of Presentation: 米国ハワイ州ホノルル
  • Year and Date: 2016-03-06
  • Int'l Joint Research