Recognition of very low quality images using history of a large amount of spatial-temporal information

• Project/Area Number: 20300065
• Research Category: Grant-in-Aid for Scientific Research (B)
• Allocation Type: Single-year Grants
• Section: 一般
• Research Field: Perception information processing/Intelligent robotics
• Research Institution: Nagoya University
• Principal Investigator: HIROSHI Murase (MURASE Hiroshi) 名古屋大学, 情報科学研究科, 教授 (90362293)
• Co-Investigator(Kenkyū-buntansha): IDE Ichiro 名古屋大学, 大学院・情報科学研究科, 准教授 (10332157) ; DEGUCHI Daisuke 名古屋大学, 大学院・情報科学研究科, 准教授 (20437081) ; MEKADA Yoshito 中京大学, 情報理工学部, 教授 (00282377) ; TAKAHASHI Tomokazu 岐阜聖徳学園大学, 経済情報学部, 准教授 (90397448)
• Project Period (FY): 2008 – 2011
• Project Status: Completed (Fiscal Year 2011)
• Budget Amount: ¥16,250,000 (Direct Cost: ¥12,500,000、Indirect Cost: ¥3,750,000); Fiscal Year 2011: ¥3,510,000 (Direct Cost: ¥2,700,000、Indirect Cost: ¥810,000); Fiscal Year 2010: ¥3,380,000 (Direct Cost: ¥2,600,000、Indirect Cost: ¥780,000); Fiscal Year 2009: ¥3,380,000 (Direct Cost: ¥2,600,000、Indirect Cost: ¥780,000); Fiscal Year 2008: ¥5,980,000 (Direct Cost: ¥4,600,000、Indirect Cost: ¥1,380,000)
• Keywords: パタン認識 / 画像処理 / 監視カメラ / 車載カメラ / 低品質画像 / 履歴情報 / 画像認識

Research Abstract

The purpose of this research is to develop an accurate recognition algorithm for low quality images such as image sequences from in-vehicle cameras or surveillancecameras. We proposed several new algorithms using generative learning method based on generative models, or using super-resolution from multiple input images. Experimental results on real-world data demonstrated the superiority of the proposed methods in terms of recognition rate.

Research Products

• [Journal Article] 遡及型追跡に基づく標識画像の自動収集を用いた標識検出器の高精度化 (2012)
  • Author(s): 出口 大輔, 道満 恵介, 井手 一郎, 村瀬 洋
  • Journal Title: 電子情報通信学会論文誌 Volume: J95-D, No.1 Pages: 76-84
  • NAID: 110008897588
  • Peer Reviewed
• [Journal Article] コントラスト特徴とアピアランス特徴の統合による道路標識の視認性推定 (2012)
  • Author(s): 道満 恵介, 出口 大輔, 高橋 友和, 目加田 慶人, 井手 一郎, 村瀬 洋, 玉津 幸政
  • Journal Title: 電子情報通信学会論文誌 Volume: J95-D, No.1 Pages: 122-130
  • NAID: 110008897592
  • Peer Reviewed
• [Journal Article] 空撮画像と車載カメラ画像からの特徴点の時系列対応付けによる自車位置推定の高精度化 (2012)
  • Author(s): 野田 雅文, 高橋 友和, 出口 大輔, 井手 一郎, 村瀬 洋, 小島 祥子, 内藤 貴志
  • Journal Title: 電子情報通信学会論文誌 Volume: J95-D, No.1 Pages: 111-121
  • NAID: 110008897591
  • Peer Reviewed
• [Journal Article] 空撮画像と車載カメラ画像からの特徴点の時系列対応付けによる自車位置推定の高精度化 (2012)
  • Author(s): 野田雅文, 高橋友和, 出口大輔, 井手一郎, 村瀬洋, 小島祥子, 内藤貴志
  • Journal Title: 電子情報通信学会論文誌 Volume: J95-D,No.1 Pages: 111-121
  • NAID: 110008897591
  • Peer Reviewed
• [Journal Article] 遡及型追跡に基づく標識画像の自動収集を用いた標識検出器の高精度化 (2012)
  • Author(s): 出口大輔, 道満恵介, 井手一郎, 村瀬洋
  • Journal Title: 電子情報通信学会論文誌 Volume: J95-D,No.1 Pages: 76-84
  • NAID: 110008897588
  • Peer Reviewed
• [Journal Article] 複数画像系列の部分画像選択に基づく移動物体を含まない車載カメラ映像の生成 (2011)
  • Author(s): 内山 寛之, 高橋 友和, 出口 大輔, 井手 一郎, 村瀬 洋
  • Journal Title: 電子情報通信学会論文誌 Volume: J94-D, No.12 Pages: 2093-2104
  • NAID: 120005572414
  • Peer Reviewed
• [Journal Article] MEMS ジャイロセンサと単眼カメラを利用した高精度で頑健な姿勢推定 (2011)
  • Author(s): 小堀 訓成, 出口 大輔, 高橋 友和, 井手 一郎, 村瀬 洋
  • Journal Title: 計測自動制御学会論文集 Volume: 47(10) Pages: 442-449
  • NAID: 10030165325
  • Peer Reviewed
• [Journal Article] 位置依存型識別器を用いた車載カメラ画像からの路面標示検出 (2011)
  • Author(s): 野田 雅文, 高橋 友和, 出口 大輔, 井手 一郎, 村瀬 洋, 小島 祥子, 内藤 貴志
  • Journal Title: 電気学会論文誌 D Volume: 131(4) Pages: 466-474
  • NAID: 10027980415
  • Peer Reviewed
• [Journal Article] 複数画像系列の部分画像選択に基づく移動物体を含まない車載カメラ映像の生成 (2011)
  • Author(s): 内山寛之, 高橋友和, 出口大輔, 井手一郎, 村瀬洋
  • Journal Title: 電子情報通信学会論文誌 Volume: J94-D,No.12 Pages: 2093-2104
  • NAID: 120005572414
  • Peer Reviewed
• [Journal Article] 拡張 DP マッチングを用いた視野角の異なるカメラ映像間の時空間対応付けによる自車位置推定 (2010)
  • Author(s): 内山 寛之, 出口 大輔, 高橋 友和, 井手 一郎, 村瀬 洋
  • Journal Title: 電子情報通信学会論文誌 Volume: J93-D, No.12 Pages: 2659-2665
  • NAID: 120003117675
  • Peer Reviewed
• [Journal Article] 属性に基づく学習型人物検索 (2010)
  • Author(s): 井尻 善久, 勞 世〓, 村瀬 洋
  • Journal Title: 電子情報通信学会論文誌 Volume: J93-D, No.11 Pages: 2495-2504
  • NAID: 120004043679
  • Peer Reviewed
• [Journal Article] 色変動を考慮した生成型学習法による道路標識検出器の構築 (2010)
  • Author(s): 道満 恵介, 出口 大輔, 高橋 友和, 目加田 慶人, 井手 一郎, 村瀬 洋
  • Journal Title: 電子情報通信学会論文誌 Volume: 93-D, No.8 Pages: 1375-1385
  • NAID: 120003117624
  • Peer Reviewed
• [Journal Article] A Hilbert warping method for handwriting gesture recognition (2010)
  • Author(s): Hiroyuki Ishida, Tomokazu Takahashi, Ichiro Ide, Hiroshi Murase
  • Journal Title: Pattern Recognition Volume: Vol.43 Pages: 2799-2806
  • Peer Reviewed
• [Journal Article] 運転者支援のための交通信号機視認性数値化手法 (2010)
  • Author(s): 木村 文香, 目加田 慶人, 高橋 友和, 井手 一郎, 村瀬 洋, 玉津 幸政
  • Journal Title: 電気学会論文誌 C Volume: 130(6) Pages: 1034-1041
  • NAID: 10026382812
  • Peer Reviewed
• [Journal Article] 拡張DPマッチングを用いた視野角の異なるカメラ映像間の時空間対応付けによる自車位置推定 (2010)
  • Author(s): 内山寛之, 出口大輔, 高橋友和, 井手一郎, 村瀬洋
  • Journal Title: 電子情報通信学会論文誌D J93, 12 Pages: 2654-2665
  • NAID: 120003117675
  • Peer Reviewed
• [Journal Article] 色変動を考慮した生成型学習法による道路標識検出器の構築 (2010)
  • Author(s): 道満恵介, 出口大輔, 高橋友和, 目加田慶人, 井手一郎, 村瀬洋
  • Journal Title: 電子情報通信学会論文誌D J93, 8 Pages: 1375-1385
  • NAID: 120003117624
  • Peer Reviewed
• [Journal Article] 運転者支援のための交通信号機視認性数値化手法 (2010)
  • Author(s): 木村文香, 目加田慶人, 高橋友和, 井手一郎, 村瀬洋, 玉津幸政
  • Journal Title: 電気学会論文誌 Volume: C-130-6 Pages: 1034-1041
  • NAID: 10026382812
  • Peer Reviewed
• [Journal Article] 色変動を考慮した生成型学習法による道路標識検出器の構築 (2010)
  • Author(s): 道満恵介, 出口大輔, 高橋友和, 目加田慶人, 井手一郎, 村瀬洋
  • Journal Title: 電子情報通信学会論文誌 Volume: J93-D-8 Pages: 1375-1385
  • NAID: 120003117624
  • Peer Reviewed
• [Journal Article] 拡張DPマッチングを用いた視野角の異なるカメラ映像間の時空間対応付けによる自車位置推定 (2010)
  • Author(s): 内山寛之, 出口大輔, 高橋友和, 井手一郎, 村瀬洋
  • Journal Title: 電子情報通信学会論文誌 Volume: J93-D-12 Pages: 2654-2665
  • NAID: 120003117675
  • Peer Reviewed
• [Journal Article] 一般物体認識のためのマルチモーダル星座モデル (2009)
  • Author(s): 神谷 保徳, 高橋 友和, 井手 一郎, 村瀬 洋
  • Journal Title: 電子情報通信学会論文誌 Volume: J92-D, No.8 Pages: 1105-1114
  • NAID: 110007361110
  • Peer Reviewed
• [Journal Article] ドライバの注視行動を利用した視線計測システムの自動較正 (2009)
  • Author(s): 山城 賢二, 高橋 友和, 井手 一郎, 村瀬 洋, 樋口 和則, 内藤 貴志
  • Journal Title: 電子情報通信学会論文誌 Volume: J92-D, No.8 Pages: 1308-1316
  • Peer Reviewed
• [Journal Article] 一般物体認識のためのタイプの異なる局所特徴の統合利用 (2009)
  • Author(s): 神谷 保徳, 矢野 良和, 大熊 繁, 高橋友和, 井手 一郎, 村瀬 洋
  • Journal Title: 電子情報通信学会論文誌 Volume: J92-D, No.5 Pages: 628-638
  • NAID: 120005572407
  • Peer Reviewed
• [Journal Article] Incremental unsupervised-learning of appearance manifold with view-dependent covariance matrix for face recognition from video sequences (2009)
  • Author(s): Lina, Tomokazu Takahashi, Ichiro Ide, Hiroshi Murase
  • Journal Title: IEICE Transactions on Information and Systems Volume: E92-D, No.4 Pages: 642-652
  • NAID: 10026808471
  • Peer Reviewed
• [Journal Article] 車載レーザスキャナによる距離データマップの構築と高精度自車位置推定 (2009)
  • Author(s): 渋久 奈保, 高橋 友和, 井手 一郎, 村瀬 洋, 小島 祥子, 高橋 新
  • Journal Title: 電子情報通信学会論文誌 Volume: J92-D, No.2 Pages: 215-225
  • NAID: 110007380035
  • Peer Reviewed
• [Journal Article] Incremental Unsupervised-Learning of Appearance Manifold with View-Dependent Covariance Matrix for Face Recognition from Video Sequences (2009)
  • Author(s): Lina, 高橋友和, 井手一郎, 村瀬洋
  • Journal Title: IEICE Transaction on Information and Systems Vol.E92-D Pages: 642-652
  • NAID: 10026808471
  • Peer Reviewed
• [Journal Article] 一般物体認識のためのタイプの異なる局所特徴の統合利用 (2009)
  • Author(s): 神谷保徳, 矢野良和, 大熊繁, 高橋友和, 井手一郎, 村瀬洋
  • Journal Title: 電子情報通信学会論文誌 J92-D-5 Pages: 628-638
  • NAID: 120005572407
  • Peer Reviewed
• [Journal Article] ドライバの注視行動を利用した視線計測システムの自動校正 (2009)
  • Author(s): 山城賢二, 高橋友和, 井手一郎, 村瀬洋, 樋口和則, 内藤貴志
  • Journal Title: 電子情報通信学会論文誌 J92-D-8 Pages: 1308-1316
  • NAID: 120005572408
  • Peer Reviewed
• [Journal Article] 車載レーザスキャナによる距離データマップの構築と高精度自車位置推定 (2009)
  • Author(s): 渋久奈保, 高橋友和, 井手一郎, 村瀬洋, 小島祥子, 高橋新
  • Journal Title: 電子情報通信学会論文誌 J92-D-2 Pages: 215-225
  • NAID: 110007380035
  • Peer Reviewed
• [Journal Article] Recognition of camera-captured low-quality characters using motion blur information (2008)
  • Author(s): Hiroyuki Ishida, Tomokazu Takahashi, Ichiro Ide, Yoshito Mekada, Hiroshi Murase
  • Journal Title: Pattern Recognition Volume: 41(7) Pages: 2253-2262
  • Peer Reviewed
• [Journal Article] Construction of Appearance Manifold with Embedded View-Dependent Covariance Matrix for 3D Object Recognition (2008)
  • Author(s): Lina, Tomokazu Takahashi, Ichiro Ide, Hiroshi Murase
  • Journal Title: IEICE Transactions on Information and Systems Volume: E91-D, No.4 Pages: 1091-1100
  • NAID: 10026802875
  • Peer Reviewed
• [Journal Article] Construction of Appearance Manifold with Embedded View-Dependent Convariance Matrix for 3D Object Recognition (2008)
  • Author(s): Lina, Tomokazu Takahashi, Ichiro Ide, Hiroshi Murase
  • Journal Title: IEICE Transaction on Information and Systems D E91, 4 Pages: 1091-1100
  • Peer Reviewed
• [Journal Article] Construction of Appearance Manifold with Embedded View-Dependent Covariance Matrix for 3D Object Recognition (2008)
  • Author(s): Lina, Tomokazu Takahashi, Ichiro Ide, Hiroshi Murase
  • Journal Title: IEICE Transaction on Information and Systems Vol. E91-D No. 4 Pages: 1091-1100
  • NAID: 10026802875
  • Peer Reviewed
• [Journal Article] Recognition of camera-captured low-quality characters using motion blur information (2008)
  • Author(s): Hiroyuki Ishida, Tomokazu Takahashi, Ichiro Ide, Yoshito Mekada, Hiroshi Murase
  • Journal Title: Pattern Recognition Vol. 41 Pages: 2253-2262
  • Peer Reviewed
• [Presentation] Low resolution QR-code recognition by applying super-resolution using the property of QR-codes (2011)
  • Author(s): Yuji Kato, Daisuke Deguchi, Tomokazu Takahashi, Ichiro Ide, Hiroshi Murase
  • Organizer: Proceedings of the 11th International Conference on Document Analysis and Recognition (ICDAR2011)
  • Place of Presentation: Beijing, China
  • Year and Date: 2011-09-20
• [Presentation] Low resolution QR-code recognition by applying super-resolution using the property of QR-codes (2011)
  • Author(s): Yuji Kato, Daisuke Deguchi, Tomokazu Takahashi, Ichiro Ide, Hiroshi Murase
  • Organizer: 11th International Conference on Document Analysis and Recognition (ICDAR2011)
  • Place of Presentation: Beijing, China
  • Year and Date: 2011-09-20
• [Presentation] On-road Obstacle Detection by Comparing Present and Past In-vehicle Camera Images (2011)
  • Author(s): Haruya Kyutoku, Daisuke Deguchi, Tomokazu Takahashi, Yoshito Mekada, Ichiro Ide, Hiroshi Murase
  • Organizer: Proceedings of IAPR Conference on Machine Vision Applications (MVA) 2011
  • Place of Presentation: Nara
  • Year and Date: 2011-06-14
• [Presentation] Road Image Update using In-vehicle Camera Images and Aerial Image (2011)
  • Author(s): Masafumi Noda, Tomokazu Takahashi, Daisuke Deguchi, Ichiro Ide, Hiroshi Murase, Yoshiko Kojima, Takashi Naito
  • Organizer: Proceedings of 2011 IEEE Intelligent Vehicles Symposium (IV2011)
  • Place of Presentation: Baden-Baden, Germany
  • Year and Date: 2011-06-07
• [Presentation] Road Image Update using In-vehicle Camera Images and Aerial Image (2011)
  • Author(s): Masafumi Noda, Tomokazu Takahashi, Daisuke Deguchi, Ichiro Ide, Hiroshi Murase, Yoshiko Kojima, Takashi Naito
  • Organizer: IEEE Intelligent Vehicles Symposium (IV2011)
  • Place of Presentation: Baden-Baden, Germany
  • Year and Date: 2011-06-07
• [Presentation] 3-D Line Segment Reconstruction Using an In-Vehicle Camera for Free Space Detection (2011)
  • Author(s): Hiroyuki Uchiyama, Daisuke Deguchi, Tomokazu Takahashi, Ichiro Ide, Hiroshi Murase
  • Organizer: Proceedings of 2011 IEEE Intelligent Vehicles Symposium (IV2011)
  • Place of Presentation: Baden-Baden, Germany
  • Year and Date: 2011-06-06
• [Presentation] Region-based Image Transform for Transition between Object Appearances (2010)
  • Author(s): Tomokazu Takahashi, Yuki Kono, Ichiro Ide, Hiroshi Murase
  • Organizer: International Conference on Pattern Recognition
  • Place of Presentation: Istanbul, Turkey
  • Year and Date: 2010-08-23
• [Presentation] Estimation of Traffic Sing Visibility Toward Smart Driver Assistance (2010)
  • Author(s): Keisuke Doman, Daisuke Deguchi, Tomokazu Takahashi, Yoshito Mekada, Ichiro Ide, Hiroshi Murase, Yukimasa Tamatsu
  • Organizer: IEEE Intelligent Vehicles Symposium
  • Place of Presentation: San Diego, USA
  • Year and Date: 2010-06-21
• [Presentation] Frontal Face Generation from Multiple Low-Resolution Non-Frontal Faces for Face Recognition (2010)
  • Author(s): Yuki Kono, Tomokazu Takahashi, Daisuke Deguchi, Ichiro Ide, Hiroshi Murase
  • Organizer: Proceedings of the 10th International Workshop on Visual Surveillance 2010
  • Place of Presentation: Queenstown, NZ
• [Presentation] Region-based Image Transform for Transition between Object Appearances (2010)
  • Author(s): Tomokazu Takahashi, Yuki Kono, Ichiro Ide, Hiroshi Murase
  • Organizer: International Conference on Pattern Recognition, pp.2106-2109
• [Presentation] Low-resolution Character Recognition by Video-based Super-resolution (2009)
  • Author(s): Ataru Ohkura, Daisuke Deguchi, Tomokazu Takahashi, Ichiro Ide, Hiroshi Murase
  • Organizer: Proceedings of the 10th International Conference on Document Analysis and Recognition (ICDAR2009)
  • Place of Presentation: Barcelona, Spain
• [Presentation] A Multimodal Constellation Model for Object Category Recognition (2009)
  • Author(s): Yasunori Kamiya, Tomokazu Takahashi, Ichiro Ide, Hiroshi Murase
  • Organizer: Proceedings of the 15th International Conference on Multimedia Modeling (MMM2009)
  • Place of Presentation: Sophia-Antipolis,France
• [Presentation] Low-resolution Character Recognition by Video-based Super-resolution (2009)
  • Author(s): Ataru Ohkura, Daisuke Deguchi, Tomokazu Takahashi, Ichiro Ide, Hiroshi Murase
  • Organizer: International Conference on Document Analysis and Recognition, pp.191-195
• [Presentation] Low-resolution Character Recognition by Video-based Super-resolution (2009)
  • Author(s): Ataru Ohkura, Daisuke Deguchi, Tomokazu Takahashi, Ichiro Ide, Hiroshi Murase
  • Organizer: International Conference on Document Analys is and Recognition
  • Place of Presentation: Barcelona, Spain
• [Presentation] 生成型学習とカスケード型識別器による道路標識検出・認識 (2008)
  • Author(s): 道満恵介, 高橋友和, 目加田慶人, 井手一郎, 村瀬洋
  • Organizer: 画像の認識・理解シンポジウム
  • Place of Presentation: 軽井沢プリンスホテル
  • Year and Date: 2008-07-28
• [Presentation] Eigenspace Interpolation for Appearance-Based Object Recognition (2008)
  • Author(s): Tomokazu Takahashi, Lina, Ichiro Ide, Yoshito Mekada, Hiroshi Murase
  • Organizer: Proceedings of the 19th International Conference on Pattern Recognition(ICPR2008)
  • Place of Presentation: Tampa,USA
• [Presentation] A Hilbert Warping Algorithm for Recognizing Characters from Moving Camera (2008)
  • Author(s): Hiroyuki Ishida, Ichiro Ide, Hiroshi Murase, Tomokazu Takahashi
  • Organizer: Workshop on Document Analysis Systems, pp.21-27
• [Remarks]
  • URL: http://www.murase.nuie.nagoya-u.ac.jp/~murase/index.html
• [Patent(Industrial Property Rights)] 画像処理装置、および画像処理プログラム (2011)
  • Inventor(s): 村瀬洋 , 出口大輔 , 高橋友和 , 吉田智成 , 労世紅 , 倉田剛
  • Industrial Property Rights Holder: オムロン
  • Industrial Property Number: 2011-181307
  • Filing Date: 2011-11-18