Integrated system of visible light communication and fast vehicle ahead recognition by high-speed stereo camera and visible light ID

• Project/Area Number: 16H04364
• Research Category: Grant-in-Aid for Scientific Research (B)
• Allocation Type: Single-year Grants
• Section: 一般
• Research Field: Communication/Network engineering
• Research Institution: Nagoya University
• Principal Investigator: Yamazato Takaya 名古屋大学, 教養教育院, 教授 (20252265)
• Research Collaborator: Kinoshita Masayuki
• Project Period (FY): 2016-04-01 – 2019-03-31
• Project Status: Completed (Fiscal Year 2018)
• Budget Amount: ¥16,770,000 (Direct Cost: ¥12,900,000、Indirect Cost: ¥3,870,000); Fiscal Year 2018: ¥2,990,000 (Direct Cost: ¥2,300,000、Indirect Cost: ¥690,000); Fiscal Year 2017: ¥6,240,000 (Direct Cost: ¥4,800,000、Indirect Cost: ¥1,440,000); Fiscal Year 2016: ¥7,540,000 (Direct Cost: ¥5,800,000、Indirect Cost: ¥1,740,000)
• Keywords: 可視光通信 / 高速認識 / 高速二眼カメラ / 高速認識・通信統合システム / イメージセンサ通信 / 車車間路車間通信 / 可視光ID / 車輌周辺環境の高速認識 / 高速度カメラ / 信号処理

Outline of Final Research Achievements

The purpose of this research is to realize an integrated visible light communication (VLC) system that not only perform communication but also achieve range estimation.
The system adopts two high-speed cameras and analyzes a spatial-temporal image and a spatial-temporal cross image. Based on the analysis, we enable diversity reception for image-sensor based VLC. As a result, maximal ratio combining is also valid for image-sensor based VLC, and the system achieves a precious range estimation using sub-pixel estimation.

Academic Significance and Societal Importance of the Research Achievements

本研究の成果は，可視光通信によるインフラ協調型安全運転支援システムに適用できる．とりわけ，本研究で明らかにしたサブピクセル単位での距離推定手法では，60m の距離で数10cm以下の測距特性を実現でき，有効性が高い．また，それに必要な演算処理も少なく，実用的である．なお，イメージセンタ可視光通信を対象に検討してきたが，LED信号機が点滅していることを考えると，測距については，十分適応可能であり，今後，その評価を行いたい．

Research Products

• [Int'l Joint Research] Kookmin University(韓国)
• [Journal Article] 高速二眼カメラによる画素選択/最大比合成受信を適用した可視光通信性能の評価実験 (2019)
  • Author(s): 木下雅之，山里敬也，岡田啓，藤井俊彰，荒井伸太郎，圓道知博，鎌倉浩嗣
  • Journal Title: 電子情報通信学会論文誌 Volume: J102-B Pages: 90-97
  • Peer Reviewed
• [Journal Article] Technical Issues on IEEE 802.15.7m Image Sensor Communication Standardization (2018)
  • Author(s): T. Nguyen, A. Islam, T. Yamazato, Y. M. Jang
  • Journal Title: IEEE Communications Magazine Volume: 56 Issue: 2 Pages: 213-218
  • DOI: 10.1109/mcom.2018.1700134
  • Peer Reviewed / Int'l Joint Research
• [Journal Article] Simplified Vehicle Vibration Modeling for Image Sensor Communication (2018)
  • Author(s): M. Kinoshita, T. Yamazato, H, Okada, T. Fujii, S. Arai, T. Yendo, K. Kamakura
  • Journal Title: IEICE Transactions on Fundamentals of Electronics, Communications and Computer Sciences Volume: E101.A Issue: 1 Pages: 176-184
  • DOI: 10.1587/transfun.E101.A.176
  • NAID: 130006300823
  • ISSN: 0916-8508, 1745-1337
  • Peer Reviewed
• [Journal Article] 可視光通信実用化技術 (2018)
  • Author(s): 山里敬也，岡田啓
  • Journal Title: 電子情報通信学会誌 Volume: 101 Pages: 59-65
  • Peer Reviewed
• [Journal Article] V2X communications with an image sensor (2017)
  • Author(s): Takaya Yamazato
  • Journal Title: Journal of Communications and Information Networks Volume: 2 Issue: 4 Pages: 65-74
  • DOI: 10.1007/s41650-017-0044-4
  • Peer Reviewed / Open Access
• [Journal Article] The Uplink Visible Light Communication Beacon System for Universal Traffic Management (2017)
  • Author(s): T. Yamazato, N. Kawagita, H. Okada, T. Fujii, T. Yendo, S. Arai, K. Kamakura
  • Journal Title: IEEE Access Volume: 5 Pages: 22282-22290
  • DOI: 10.1109/access.2017.2759179
  • Peer Reviewed / Open Access
• [Journal Article] A New Automotive VLC System Using Optical Communication Image Sensor (2016)
  • Author(s): Yuki Goto, Isamu Takai, Takaya Yamazato, Hiraku Okada, Toshiaki Fujii, Shoji Kawahito, Shintaro Arai, Tomohiro Yendo, Koji Kamakura
  • Journal Title: IEEE Photonics Journal Volume: 8 Issue: 3 Pages: 1-17
  • DOI: 10.1109/jphot.2016.2555582
  • Peer Reviewed / Open Access
• [Presentation] An LED Transmitter Detection using Linear SVM and CNN for ITS Image Sensor Communication (2019)
  • Author(s): Masahiro HORI, Masayuki KINOSHITA, Takaya YAMAZATO , Hiraku OKADA, Toshiaki FUJII, Koji KAMAKURA, Tomohiro YENDO, and Shintaro ARAI
  • Organizer: 3rd International Conference and Exhibition on Visible Light Communications (ICELVC2019)
  • Int'l Joint Research / Invited
• [Presentation] DMDプロジェクタを用いたITS可視光通信の送信パターンの基礎検討 (2018)
  • Author(s): 有末知矢，木下雅之，山里敬也，岡田啓，藤井俊彰，荒井伸太郎，圓道知博，鎌倉浩嗣
  • Organizer: 電子情報通信学会技術研究報告, WBS2018-70, pp.237-241
• [Presentation] A Comparison of Reception Methods for Visible Light Communication Using High-speed Stereo Cameras (2018)
  • Author(s): M. Kinoshita, T. Yamazato, H, Okada, T. Fujii, S. Arai, T. Yendo, K. Kamakura
  • Organizer: IEEE Global Communications Conference (GLOBECOM)
  • Int'l Joint Research
• [Presentation] Performance Evaluation of Precoded Pulse Width Modulation for Image Sensor Communication (2018)
  • Author(s): S. Kamegawa, M. Kinoshita, T. Yamazato, H. Okada, T. Fujii, K. Kamakura, T. Yendo, S. Arai
  • Organizer: IEEE GLOBECOM Workshop on Optical Wireless Communications
  • Int'l Joint Research
• [Presentation] ［奨励講演］ITSイメージセンサ通信における画像上の送信機位置に影響を与える車両振動のモデル化 (2018)
  • Author(s): 木下雅之，山里敬也，岡田啓，藤井俊彰，荒井伸太郎，圓道知博，鎌倉浩嗣
  • Organizer: 電子情報通信学会技術研究報告, WBS2018-26, pp.47-52
• [Presentation] Image Sensor Communications for Automotive (2018)
  • Author(s): T. Yamazato
  • Organizer: Progress In Electromagnetics Research Symposium (PIERS)
  • Int'l Joint Research / Invited
• [Presentation] Overview of image-sensor communication (2018)
  • Author(s): T. Yamazato
  • Organizer: Visible Light Communications Workshop, Pacific Rim Conference on Lasers and Electro-Optics (CLEO-PR)
  • Int'l Joint Research / Invited
• [Presentation] 時間勾配を特徴量とした機械学習による可視光通信送信機検出 (2018)
  • Author(s): 堀将大，木下雅之，山里敬也，岡田啓，藤井俊彰，鎌倉浩嗣，圓道知博，荒井伸太郎
  • Organizer: 電子情報通信学会技術研究報告, ASN2018-30, pp.85-90
• [Presentation] イメージセンサ可視光通信へのプリコーディングの導入と静止環境における性能評価 (2018)
  • Author(s): 亀川智史，山里敬也，岡田啓，藤井俊彰，荒井伸太郎，圓道知博，鎌倉浩嗣
  • Organizer: 電子情報通信学会技術研究報告, ASN2018-16, pp.1-6
• [Presentation] Image Sensor Communications for future ITS (2018)
  • Author(s): T. Yamazato
  • Organizer: 2018 Advanced Photonics Conference
  • Int'l Joint Research / Invited
• [Presentation] 高速二眼カメラを用いた ITS 可視光通信のための最大比合成による通信性能改善手法 (2018)
  • Author(s): 木下雅之，山里敬也，岡田啓，藤井俊彰，荒井伸太郎，圓道知博，鎌倉浩嗣
  • Organizer: 電子情報通信学会 総合大会, A-9-8, p.95
• [Presentation] ITSのためのイメージセンサ通信 (2018)
  • Author(s): 山里敬也
  • Organizer: 電子情報通信学会 総合大会, CI-2-5, pp.SS-17-SS-18
  • Invited
• [Presentation] Performance Enhancement for Image Sensor Communication in an Intelligent Transport System Using a High-speed Stereo Camera (2018)
  • Author(s): M. Kinoshita, T. Yamazato, H. Okada, T. Fujii, S. Arai, T. Yendo, K. Kamakura
  • Organizer: International Conference and Exhibition on Visible Light Communications (ICEVLC)
  • Int'l Joint Research
• [Presentation] Overview of visible light communications with emphasis on image sensor communications (2017)
  • Author(s): Takaya Yamazato
  • Organizer: Asia-Pacific Conference on Communications (APCC)
  • Int'l Joint Research / Invited
• [Presentation] N-Stream Superimposed System with m-Point DFT for Image-Sensor-Based Visible Light Communication (2017)
  • Author(s): S. Kibe, K. Kamakura, T. Yamazato
  • Organizer: IEEE Global Communications Conference (GLOBECOM), pp. 1-6
  • Int'l Joint Research
• [Presentation] m点DFTを用いたN情報系列重畳イメージセンサ型可視光通信システム (2017)
  • Author(s): 木部修斗，鎌倉浩嗣，山里敬也
  • Organizer: 電子情報通信学会技術研究報告, CS2017-58, pp.21-2
• [Presentation] Modulation and coding for image sensor communication (2017)
  • Author(s): K. Kamakura, T. Yamazato
  • Organizer: IEEE Photonics Conference (IPC), pp.235-236
  • Int'l Joint Research / Invited
• [Presentation] ITSイメージセンサ通信における高速二眼カメラを用いた通信性能改善手法 (2017)
  • Author(s): 木下雅之，山里敬也，岡田啓，藤井俊彰，荒井伸太郎，圓道知博，鎌倉浩嗣
  • Organizer: 電子情報通信学会ソサイエティ大会, A-9-7, p.92
• [Presentation] ITS イメージセンサ可視光通信の高速化に適する伝送方式の比較 (2017)
  • Author(s): 亀川智史,山里敬也，岡田啓，藤井俊彰，荒井伸太郎，圓道知博，鎌倉浩嗣
  • Organizer: 電子情報通信学会技術研究報告, RCS2017-69, pp.115-120
• [Presentation] Modeling and Parameter Estimation of Vehicle Vibration Inducing Transmitter Displacement in ITS Image Sensor Communication (2017)
  • Author(s): M. Kinoshita, T. Yamazato, H. Okada, T. Fujii, S. Arai, T. Yendo, K. Kamakura
  • Organizer: IEEE International Conference on Communications Workshop on Optical Wireless Communications, pp.144-149
  • Int'l Joint Research
• [Presentation] 車輌振動測定に基づく ITS イメージセンサ通信における 通信路変動のパラメータ推定 (2017)
  • Author(s): 木下雅之，山里敬也，岡田啓，藤井俊彰，荒井伸太郎，圓道知博，鎌倉浩嗣
  • Organizer: 電子情報通信学会 総合大会, A-9-14, p.123
• [Presentation] ITS イメージセンサ通信における互いに非同期な 複数光源からの情報同時受信手法に関する実験系の構築 (2017)
  • Author(s): 新井雄大，山里敬也，岡田啓，藤井俊彰，荒井伸太郎，圓道知博，鎌倉浩嗣
  • Organizer: 電子情報通信学会 総合大会, A-9-15, p.124
• [Presentation] イメージセンサ可視光通信の高速化のための伝送方式の初期検討 (2017)
  • Author(s): 亀川智史,山里敬也，岡田啓，藤井俊彰，荒井伸太郎，圓道知博，鎌倉浩嗣,
  • Organizer: 電子情報通信学会 総合大会, A-9-13, p.122
• [Presentation] 汎用カメラを用いた可視光通信のための位相推定法 (2017)
  • Author(s): 木原渉，圓道知博，荒井伸太郎，山里敬也，岡田啓，鎌倉浩嗣
  • Organizer: 電子情報通信学会 総合大会, A-9-10, p.119
• [Presentation] 車を支える無線通信システム (2017)
  • Author(s): 山里敬也
  • Organizer: 電子情報通信学会 総合大会, BI-10-2, pp.SS-81 - SS-82
  • Invited
• [Presentation] イメージセンサ型可視光通信における階層的時空間符号化への位置変調の適用 (2017)
  • Author(s): 増田圭亮，鎌倉浩嗣，山里敬也
  • Organizer: 電子情報通信学会 総合大会, B-10-57, p.310
• [Presentation] Vehicle to Infrastructure Visible Light Communication using DCO-OFDM (2017)
  • Author(s): N. Kawagita, T. Yamazato, H. Okada, T. Fujii, S. Arai, T. Yendo, K.Kamakura
  • Organizer: RISP International Workshop on Nonlinear Circuits, Communications and Signal Processing (NCSP), pp.129-132
  • Int'l Joint Research
• [Presentation] A Modulation Method to Detect Phase Shift from Asynchronous Camera Image for Visible Light Communication (2017)
  • Author(s): W. Kihara, T. Yendo, S. Arai, T. Yamazato, H. Okada, K. Kamakura
  • Organizer: ISP International Workshop on Nonlinear Circuits, Communications and Signal Processing (NCSP), pp.133-136
  • Int'l Joint Research
• [Presentation] 車路間可視光通信への時空間ブロック符号化DCO-OFDM適用の一検討 (2016)
  • Author(s): 川北直明，山里敬也，岡田啓，藤井俊彰，荒井伸太郎，圓道知博，鎌倉浩嗣
  • Organizer: 情報理論とその応用シンポジウム, pp.555-560
• [Presentation] Position estimation of LED matrix in image sensor communication (2016)
  • Author(s): T. Asai, T. Yendo, S. Arai, T. Yamazato, H. Okada, T. Fujii, K. Kamakura
  • Organizer: Asia-Pacific Signal and Information Processing Association Annual Summit and Conference (APSIPA), pp.1 - 5
  • Int'l Joint Research
• [Presentation] ehicle Vibration Model that Induces Channel Fluctuation in ITS Image Sensor Communication (2016)
  • Author(s): M. Kinoshita, T. Yamazato, H, Okada, T. Fujii, S. Arai, T. Yendo, K. Kamakura
  • Organizer: Cambodia-Japan Joint Workshop on Ambient Intelligence and Sensor Networks
  • Int'l Joint Research
• [Presentation] [ポスター講演]デジタル映像コンテンツへの情報埋め込みを用いたイメージセンサ可視光通信における映像品質と通信品質の評価 (2016)
  • Author(s): 佐藤 翔, 岡田 啓, 山里 敬也, 和田 忠浩, 小林健太郎, 片山 正昭
  • Organizer: 可視光通信ワークショップVLCWS2016
• [Presentation] Channel Measurement of Infrastructure-to-Vehicle Image Sensor Communication (2016)
  • Author(s): M. Kinoshita, T. Yamazato, H, Okada, T. Fujii, S. Arai, T. Yendo, K. Kamakura
  • Organizer: 23rd World Congress on Intelligent Transport Systems
  • Int'l Joint Research
• [Presentation] Visible Light Communication Systems Using Blue Color Difference Modulation for Digital Signage (2016)
  • Author(s): S. Sato, H. Okada, K. Kobayashi, T. Yamazato, M. Katayama
  • Organizer: IEEE International Symposium on Personal, Indoor and Mobile Radio Communication (PIMRC), pp.1242-1247
  • Int'l Joint Research
• [Presentation] Spatial Modulation in Layered Space-Time Coding for Image-Sensor-Based Visible Light Communication (2016)
  • Author(s): K. Masuda, K. Kamakura, T. Yamazato
  • Organizer: IEEE International Symposium on Personal, Indoor and Mobile Radio Communication (PIMRC), pp.1254-1259
  • Int'l Joint Research
• [Presentation] [ポスター講演] ITSイメージセンサ通信における車輌振動及び路面凹凸が与える通信路パラメータフィッティング (2016)
  • Author(s): 木下雅之，山里敬也，岡田啓，藤井俊彰，荒井伸太郎，圓道知博，鎌倉浩嗣
  • Organizer: 電子情報通信学会技術研究報告, RCS2016-112, pp.99-103
• [Presentation] 高速イメージセンサ通信の路車間・車車間通信への応用 (2016)
  • Author(s): 山里敬也
  • Organizer: JIEP主催2016最先端実装技術シンポジウム
  • Invited
• [Presentation] Range estimation scheme for integrated I2V-VLC using a high-speed image sensor (2016)
  • Author(s): T. Yamazato, A. Ohmura, H. Okada, T. Fujii, T. Yendo; S. Arai, K. Kamakura
  • Organizer: IEEE International Conference on Communications Workshops (ICC), pp.326-330
  • Int'l Joint Research
• [Presentation] 700MHz帯路車協調システムを用いた交通流制御に関する一検討 (2016)
  • Author(s): 大野良太, 山里敬也
  • Organizer: 電子情報通信学会技術研究報告, RCS2016-3, pp.13-18