A Learning Environment that Ennances Creativity through Real-world Collaboratve Sensing using Mobile Devices

• Project/Area Number: 16H03070
• Research Category: Grant-in-Aid for Scientific Research (B)
• Allocation Type: Single-year Grants
• Section: 一般
• Research Field: Educational technology
• Research Institution: Hokkaido University
• Principal Investigator: Sugimoto Masanori 北海道大学, 情報科学研究科, 教授 (90280560)
• Co-Investigator(Kenkyū-buntansha): 稲垣 成哲 神戸大学, 人間発達環境学研究科, 教授 (70176387)
• Research Collaborator: HASHIZUME Hiromichi
• Project Period (FY): 2016-04-01 – 2019-03-31
• Project Status: Completed (Fiscal Year 2018)
• Budget Amount: ¥17,420,000 (Direct Cost: ¥13,400,000、Indirect Cost: ¥4,020,000); Fiscal Year 2018: ¥6,630,000 (Direct Cost: ¥5,100,000、Indirect Cost: ¥1,530,000); Fiscal Year 2017: ¥5,330,000 (Direct Cost: ¥4,100,000、Indirect Cost: ¥1,230,000); Fiscal Year 2016: ¥5,460,000 (Direct Cost: ¥4,200,000、Indirect Cost: ¥1,260,000)
• Keywords: モバイル協調学習支援 / 携帯端末 / 実世界センシング / 教育工学

Outline of Final Research Achievements

A system that allows users to collaboratively collect and create learning materials through real-world sensing technologies using mobile devices. Achievements of the project are summarized as follows:
1. System development: A highly-precise time-synchronization technique between smartphones using illuminations and that for 3D localization of smartphones using acoustic signals are investigated. By using these techniques, a 3D reconstruction and motion-capture system by integrating multiple smartphone built-in cameras are implemented.
2. System evaluation and research outcomes presentation: The performance evaluations of the proposed system and user studies were conducted. Research outcomes were presented in academic meetings and published in a journal paper.

Academic Significance and Societal Importance of the Research Achievements

積極的な学習者(active learner)としての活動を強化するため、自身が学習素材を取得し、互いに協調しつつそれを編集することで、学習コンテンツを作成できる創造的学習支援環境の構築である。スマートフォン等の個人向け携帯端末で実現できる点で有用性は高いと言える。さらに、携帯端末間の高精度時刻同期技術、屋内での3次元位置認識技術、それらの技術に統合することによる3次元形状復元およびモーションキャプチャシステムは、技術的難易度が高く挑戦的な研究である。他分野への応用も考えられ学術的な意義も大きい。

Research Products

• [Journal Article] CMOSイメージセンサを用いたOFDM高速可視光通信 (2019)
  • Author(s): 嶋田，橋爪，杉本
  • Journal Title: 電子情報通信学会論文誌 B Volume: 印刷中
  • Peer Reviewed
• [Journal Article] Time-of-Arrival-Based Indoor Smartphone Localization Using Light-Synchronized Acoustic Waves (2017)
  • Author(s): Akiyama, T., Sugimoto, M., Hashizume, H.
  • Journal Title: IEICE Transactions on Fundamentals of Electronics, Communications and Computer Sciences Volume: E100.A Issue: 9 Pages: 2001-2012
  • DOI: 10.1587/transfun.E100.A.2001
  • NAID: 130006038250
  • ISSN: 0916-8508, 1745-1337
  • Peer Reviewed
• [Journal Article] Optimally Modulated Illumination for Rapid and Accurate Time Synchronization (2017)
  • Author(s): Masanori Sugimoto, Hayato Kumaki, Takayuki Akiyama Hiromichi Hashizume
  • Journal Title: IEEE Transactions on Signal Processing Volume: 65 Issue: 2 Pages: 505-516
  • DOI: 10.1109/tsp.2016.2612176
  • Peer Reviewed / Open Access / Acknowledgement Compliant
• [Journal Article] 音響信号を用いたスマートフォンの高速・高精度屋内3次元位置認識手法 (2016)
  • Author(s): 中村 将成，秋山 尚之，杉本 雅則，橋爪 宏達
  • Journal Title: 情報処理学会論文誌 Volume: 57 Pages: 2489-2500
  • NAID: 170000131105
  • Peer Reviewed
• [Journal Article] 可聴周波数帯域を用いることによるスポット制御可能な情報伝送手法 (2016)
  • Author(s): 中村 将成，秋山 尚之，杉本 雅則，橋爪 宏達
  • Journal Title: 情報処理学会論文誌 Volume: 57 Pages: 2501-2514
  • NAID: 170000131106
  • Peer Reviewed
• [Presentation] Illegal Photograph Detection under Modulated LED Illumination (2019)
  • Author(s): Uno, K., Hirano,A., Hashizume, H., Sugimoto, M.
  • Organizer: IEEE PerCom 2019
  • Int'l Joint Research
• [Presentation] Smartphone Localization using Active-Passive Acoustic Sensing (2018)
  • Author(s): Murakami, H., Nakamura, M., Yamasaki, S., Hashizume, H., Sugimoto, M.
  • Organizer: IEEE IPIN 2018
  • Int'l Joint Research
• [Presentation] 変調光LED照明下における違法撮影画像の検出手法の提案 (2018)
  • Author(s): 宇野, 平野, 橋爪, 杉本
  • Organizer: 情報処理北海道シンポジウム2018
• [Presentation] Indoor Positioning Using Reflected Light and a Video Camera (2018)
  • Author(s): Shimada, S., Hashizume, H., Sugimoto, M.
  • Organizer: IEEE IPIN 2018
  • Int'l Joint Research
• [Presentation] Smartphone Inertial Sensor-based Indoor Localization using Acoustic Signal (2017)
  • Author(s): Murakami, H., Hashizume, H., Sugimoto, M.
  • Organizer: IEEE IPIN2017
  • Int'l Joint Research
• [Presentation] GPS Signal Generation Platform for Seamless Localization (2017)
  • Author(s): Kamada, M., Hashizume, H., Sugimoto, M.
  • Organizer: IEEE IPIN 2017
  • Int'l Joint Research
• [Presentation] Time-of-arrival-based Smartphone Localization Using Visible Light Communication (2017)
  • Author(s): Akiyama, T., Sugimoto, M., Hashizume, H.
  • Organizer: IEEE IPIN 2017
  • Int'l Joint Research
• [Presentation] Multicamera Synchronization for Smartphones using Optimally Modulated Illuminations (2017)
  • Author(s): Kudo, K., Akiyama, T., Hashizume, M., Sugimoto, M.
  • Organizer: ACM MobiSys 2017
  • Int'l Joint Research
• [Presentation] Augmented Indoors: Another AI Technology for Our Life (2017)
  • Author(s): 杉本, 橋爪
  • Organizer: 情報処理学会第168回コンピュータグラフィックスとビジュアル情報学研究会
  • Invited
• [Presentation] 音響信号を用いた頑健かつ高精度なPDR (2017)
  • Author(s): 村上，橋爪，杉本
  • Organizer: 情報処理北海道シンポジウム2017
• [Presentation] LED照明を用いた複数スマートフォンカメラ間時刻同期の検討 (2017)
  • Author(s): 寺本，橋爪，杉本
  • Organizer: 情報処理北海道シンポジウム2017
• [Presentation] 音響信号を用いることによる屋内測位技術 (2017)
  • Author(s): 杉本, 橋爪
  • Organizer: DICOMO 2017シンポジウム
  • Invited
• [Presentation] A Spot-controllable Data Transfer Technique Using COTS Speakers (2016)
  • Author(s): Nakamura, M., Akiyama, T., Hashizume, M., Sugimoto, M.
  • Organizer: IEEE IPIN2016
  • Place of Presentation: Mardid (Spain)
  • Year and Date: 2016-10-04
  • Int'l Joint Research
• [Presentation] 3D Indoor Positioning and Rapid Data Transfer Technique using Modulated Illumination (2016)
  • Author(s): Kumaki, H., Akiyama, T., Hashizume, M., Sugimoto, M.
  • Organizer: IEEE IPIN2016
  • Place of Presentation: Mardid (Spain)
  • Year and Date: 2016-10-04
  • Int'l Joint Research
• [Presentation] 変調光を用いた高速データ通信と屋内3次元測位 (2016)
  • Author(s): 熊木，秋山，橋爪，杉本
  • Organizer: 電子情報通信学会ソサイエティ大会
  • Place of Presentation: 北海道大学（北海道札幌市）
  • Year and Date: 2016-09-20
• [Presentation] 汎用動画カメラを用いたフリッカレス高速可視光通信 (2016)
  • Author(s): 嶋田，秋山，橋爪，杉本
  • Organizer: 電子情報通信学会ソサイエティ大会
  • Place of Presentation: 北海道大学（北海道札幌市）
  • Year and Date: 2016-09-20
• [Presentation] 汎用カメラとLED照明を用いた高速データ通信・屋内3次元測位システム (2016)
  • Author(s): 熊木，秋山，橋爪，杉本
  • Organizer: 情報処理北海道シンポジウム2016
  • Place of Presentation: 釧路公立大学(北海道釧路市)
• [Patent(Industrial Property Rights)] 情報送信装置、情報受信装置、情報伝送システム及びプログラム (2017)
  • Inventor(s): 橋爪、杉本
  • Industrial Property Rights Holder: 橋爪、杉本
  • Industrial Property Rights Type: 特許
  • Filing Date: 2017
• [Funded Workshop] The 3rd International Conference on Digital Learning Strategies and Applications (DLSA 2018) (2018)