Act-Learning Model using Real-world Sensing Data and Design of Learning Support Environment

• Project/Area Number: 19H04222
• Research Category: Grant-in-Aid for Scientific Research (B)
• Allocation Type: Single-year Grants
• Section: 一般
• Review Section: Basic Section 62030:Learning support system-related
• Research Institution: Hokkaido University
• Principal Investigator: Sugimoto Masanori 北海道大学, 情報科学研究院, 教授 (90280560)
• Co-Investigator(Kenkyū-buntansha): 稲垣 成哲 立教大学, 文学部, 特任教授 (70176387)
• Project Period (FY): 2019-04-01 – 2022-03-31
• Project Status: Completed (Fiscal Year 2022)
• Budget Amount: ¥17,290,000 (Direct Cost: ¥13,300,000、Indirect Cost: ¥3,990,000); Fiscal Year 2021: ¥5,590,000 (Direct Cost: ¥4,300,000、Indirect Cost: ¥1,290,000); Fiscal Year 2020: ¥5,070,000 (Direct Cost: ¥3,900,000、Indirect Cost: ¥1,170,000); Fiscal Year 2019: ¥6,630,000 (Direct Cost: ¥5,100,000、Indirect Cost: ¥1,530,000)
• Keywords: 実世界センシング / 学習支援環境

Outline of Research at the Start

実世界センシングにより学習者の行動を常時取得し、構築される大規模時空間データを利活用する。これは、離散的なスポットでのインタラクションを主な対象とするモバイルユビキタス学習（MUL）や、教室あるいはオンライン学習環境で得た大規模データを用いるラーニングアナリティクス（LA）などの従来研究では実現されていない。申請者がこれまでに開発した屋内位置認識、ジェスチャ認識、3次元再構築技術を統合、発展させることで、既存設備を利用した低負荷、低コストの行動取得システムを実装する。実証実験とその評価を通して実世界学習支援環境設計のガイドラインの提案を目指す。

Outline of Final Research Achievements

A system for capturing users’ real-time activity to construct a novel learning support environment using a large-scale temporal-spatial data. The outcomes of this research are summarized as follows:(1) A visitor tracking system in a museum: To achieve the goal of this research, a real-time tracking using acoustic signals are developed and evaluated. Through experiments, the positioning performance was improved. In addition, a method for alleviating the performance deterioration in NLOS (non-line-of-sight) environments was devised and additional tracking functions using visible lights and PDR (pedestrian dead reckoning) are implemented, (2) Publications: The outcomes of this research are published in domestic/international journals and conferences.

Academic Significance and Societal Importance of the Research Achievements

本研究は、博物館等に代表される学校教育以外での学習活動データを通して、適切な学習文脈において適切な支援を行う学習環境の構築を目標とした点で従来研究と大きく異なる。本研究の特徴の１つは、測位システム技術を核とした情報学と実践を中心とする教育学の知見との融合であり、学術的意義が高いと言える。さらに、人工知能技術（計算機）の急速な進展による学習（人間）の危機が叫ばれている昨今の状況から、体験に基づく真の学習に　接近するための手法の提案として、その社会的意義は非常に高いと考える。

Research Products

• [Int'l Joint Research] KMITL(タイ)
• [Journal Article] 変調光照明の振幅および位相情報を用いた違法写真撮影判定手法 (2022)
  • Author(s): 中道，渡邉，橋爪，杉本
  • Journal Title: 情報処理学会論文誌 Volume: 63(11) Pages: 1644-1652
  • Peer Reviewed
• [Journal Article] RefRec+: Six Degree-of-freedom Estimation for Smartphone using Floor Reflecting Light (2022)
  • Author(s): Sugimoto, M.,Shimada, S., Hashizume, H.
  • Journal Title: Frontiers in Computer Science Volume: 4
  • DOI: 10.3389/fcomp.2022.856942
  • Peer Reviewed
• [Journal Article] NLOS環境における音響センシングを用いたスマートフォン間測距手法 (2022)
  • Author(s): 神鳥，村上，須崎，中村，渡邉，橋爪，杉本
  • Journal Title: 情報処理学会論文誌 Volume: 63
  • Peer Reviewed
• [Journal Article] 単一のスピーカを用いたモノラルマイクロフォンの屋内測位手法 (2022)
  • Author(s): 中村，藤本，村上，橋爪，杉本
  • Journal Title: 情報処理学会論文誌 Volume: 63
  • Peer Reviewed
• [Journal Article] 汎用スピーカを用いた短時間かつ適応的なスポット通信手法 (2022)
  • Author(s): 中村, 山崎, 橋爪, 杉本
  • Journal Title: 情報処理学会論文誌 Volume: 63
  • Peer Reviewed
• [Journal Article] Visible Light Positioning Using Smartphone Ambient Light Sensor (2021)
  • Author(s): 佐藤, 嶋田, 村上, 渡邊, 橋爪, 杉本
  • Journal Title: 情報処理学会論文誌 Volume: 62 Issue: 5 Pages: 1275-1287
  • DOI: 10.20729/00211099
  • NAID: 170000184878
  • Year and Date: 2021-05-15
  • Peer Reviewed
• [Journal Article] Visible Light Positioning System for Smartphone using Floor-Reflected LED Light (2021)
  • Author(s): 嶋田，橋爪，杉本
  • Journal Title: 電子情報通信学会論文誌D 情報・システム Volume: J104-D Issue: 4 Pages: 308-317
  • DOI: 10.14923/transinfj.2020PDP0029
  • ISSN: 1880-4535, 1881-0225
  • Year and Date: 2021-04-01
  • Peer Reviewed
• [Journal Article] Simultaneous Localization and Communication Method using Short-time and Narrow-band Dual-carrier Acoustic Signals (2021)
  • Author(s): Nakamura, M., Hashizume, H., Sugimoto, M.
  • Journal Title: IEEE Sensors Journal Volume: 22 Issue: 6 Pages: 5163-5172
  • DOI: 10.1109/jsen.2021.3107849
  • Peer Reviewed
• [Journal Article] ALiSA: a Visible-Light Positioning System using the Ambient Light Sensor Assembly in a Smartphone (2021)
  • Author(s): Sato, T., Shimada, S., Murakami, H., Watanabe, H., Hashizume, H., Sugimoto, M.
  • Journal Title: IEEE Sensors Journal Volume: 22 Issue: 6 Pages: 4989-5000
  • DOI: 10.1109/jsen.2021.3074580
  • Peer Reviewed
• [Journal Article] Short-time Spot Communication using COTS Stereo Speaker (2021)
  • Author(s): Nakamura, M., Hashizume, H., Sugimoto, M.
  • Journal Title: IEEE Sensors Journal Volume: 22 Issue: 6 Pages: 5001-5010
  • DOI: 10.1109/jsen.2021.3074979
  • Peer Reviewed
• [Journal Article] 変調光照明を用いた違法写真撮影判定手法の提案とその評価 (2020)
  • Author(s): 宇野, 平野，嶋田，渡邊，橋爪，杉本
  • Journal Title: 情報処理学会論文誌 Volume: 61 Pages: 628-637
  • NAID: 170000181790
  • Peer Reviewed
• [Journal Article] OFDM High-Speed Visible Light Communication Using CMOS Image Sensor (2019)
  • Author(s): 嶋田，橋爪，杉本
  • Volume: J102-B
  • Issue: 8
  • Pages: 605-613
  • DOI: 10.14923/transcomj.2018WFP0003
  • ISSN: 1344-4697
  • Year and Date: 2019-08-01
  • Peer Reviewed
• [Journal Article] Square Wave Quadrature Amplitude Modulation for Visible Light Communication using Image Sensor (2019)
  • Author(s): Alfarozi, S, Hashizume, H, Pasupa, K, Woraratpanya, K, Sugimoto, M
  • Journal Title: IEEE Access Volume: Vol.7 Pages: 94806-94821
  • DOI: 10.1109/access.2019.2928417
  • Peer Reviewed / Open Access
• [Journal Article] 鏡像スピーカを用いたスマートフォン高精度3次元測位手法 (2019)
  • Author(s): 村上, 中村，橋爪，杉本
  • Journal Title: 情報処理学会論文誌 Volume: 60 Pages: 2314-2324
  • NAID: 170000181220
  • Peer Reviewed
• [Journal Article] Robust and Unified VLC Decoding System for Square Wave Quadrature Amplitude Modulation Using Deep Learning Approach (2019)
  • Author(s): Alfarozi, S., Pasupa, K., Hashizume, H., Woraratpanya, K., Sugimoto, M.
  • Journal Title: IEEE Access Volume: 7 Pages: 163262-163276
  • DOI: 10.1109/access.2019.2952465
  • Peer Reviewed / Open Access
• [Presentation] 床面反射光を用いることによる高精度屋内ドローントラッキング (2022)
  • Author(s): 大西，渡邉，橋爪，杉本
  • Organizer: 情報処理北海道シンポジウム2022
• [Presentation] Expanding the Positioning Area for Acoustic Localization Using COTS Mobile Devices (2021)
  • Author(s): Suzaki, T., Nakamura, M., Murakami, Watanabe, H., Hashizume, H., Sugimoto, M.
  • Organizer: Proceedings of MobiQuitous 2021
  • Int'l Joint Research
• [Presentation] A Localization Method Using Reflected Luminance Distribution (2021)
  • Author(s): Yamashita, Y., Shimada, S., Watanabe, H., Hashizume, H., Sugimoto, M.
  • Organizer: Proceedings of MobiQuitous 2021
  • Int'l Joint Research
• [Presentation] Smartphone Positioning Using an Ambient Light Sensor and Reflected Visible Light (2021)
  • Author(s): Abe, K., Sato, T., Watanabe, H., Hashizume, H., Sugimoto, M.
  • Organizer: Proceedings of IPIN 2021
  • Int'l Joint Research
• [Presentation] NL-Beep: A Ranging System between Multiple Smartphones Using Acoustic Sensing in NLOS Environments (2021)
  • Author(s): Murakami, H., Kandori, Y., Suzaki, T., Nakamura, M., Watanabe, H., Hashizume, H., Sugimoto, M.
  • Organizer: Proceedings of IPIN 2021
  • Int'l Joint Research
• [Presentation] Short-time and Adaptive Controllable Spot Communication using COTS Speaker (2021)
  • Author(s): Nakamura, M., Hashizume, H., Sugimoto, M.
  • Organizer: Proceedings of IPIN 2021
  • Int'l Joint Research
• [Presentation] Indoor Localization Method For a Microphone Using a Single Speaker (2021)
  • Author(s): Nakamura, M., Hashizume, H., Sugimoto, M.
  • Organizer: Proceedings of IPIN 2021
  • Int'l Joint Research
• [Presentation] Indoor Positioning for Smartphones (2021)
  • Author(s): Sugimoto, M.
  • Organizer: Proceedings of IEEE ICITEE 2021
  • Int'l Joint Research / Invited
• [Presentation] 単一のスピーカを用いたスマートフォン内蔵マイクロフォンの屋内測位手法 (2021)
  • Author(s): 舟田，中村，須崎，渡邉，橋爪，杉本
  • Organizer: 情報処理北海道シンポジウム2021
• [Presentation] スマートフォンの測距・測位を目的とした音響センシングに基づく時刻同期手法 (2021)
  • Author(s): 須崎，村上，中村，渡邉，橋爪，杉本
  • Organizer: 情報処理北海道シンポジウム2021
• [Presentation] Design and Implementation of Selective Visible Light Communication for Multiple Video Cameras using a Single LED Illumination (2019)
  • Author(s): Hirano, A., Shimada, S., Watanabe, H., Hashizume, H., Sugimoto, M.
  • Organizer: Proceedings of Workshop on OWC2
  • Int'l Joint Research
• [Presentation] Footsteps and Inertial Data-based Road Surface Condition Recognition Method (2019)
  • Author(s): Mitake, H., Watanabe, H., Sugimoto, M.
  • Organizer: Proceedings of MUM 2019
  • Int'l Joint Research
• [Presentation] 3-D Localization for Smartphones using a Single Speaker (2019)
  • Author(s): Murakami, H., Nakamura, M., Hashizume, H., Sugimoto, M.
  • Organizer: Proceedings of IPIN2019
  • Int'l Joint Research
• [Presentation] 3D Tracking Using Smartphones for a Marker-Based Optical Motion Capture System (2019)
  • Author(s): Teramoto, K., Mukainakano, R., Watanabe, H., Hashizume, H., Sugimoto, M.
  • Organizer: Proceedings of IPIN2019
  • Int'l Joint Research
• [Presentation] Facial Expression Recognition Using Ear Canal Transfer Function (2019)
  • Author(s): Amesaka, T., Watanabe, H., Sugimoto, M.
  • Organizer: Proceedings of ISWC 2019
  • Int'l Joint Research
• [Presentation] スマートフォン環境光センサを用いることによる可視光測位に関する基礎検討 (2019)
  • Author(s): 佐藤, 渡邊, 橋爪, 杉本
  • Organizer: 情報処理北海道シンポジウム2019
• [Presentation] 鏡像スピーカを用いた方向推定手法の提案 (2019)
  • Author(s): 須崎, 村上, 石橋, 橋爪, 杉本
  • Organizer: 情報処理北海道シンポジウム2019
• [Presentation] 汎用スピーカによる通信スポット制御の検討 (2019)
  • Author(s): 山崎, 中村, 渡邉, 橋爪, 杉本
  • Organizer: 情報処理北海道シンポジウム2019