• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

Spot context collection through multi-modal sensing and mobile federated learning

Research Project

Project/Area Number 21H03431
Research Category

Grant-in-Aid for Scientific Research (B)

Allocation TypeSingle-year Grants
Section一般
Review Section Basic Section 60060:Information network-related
Research InstitutionNara Institute of Science and Technology

Principal Investigator

Yasumoto Keiichi  奈良先端科学技術大学院大学, 先端科学技術研究科, 教授 (40273396)

Co-Investigator(Kenkyū-buntansha) 諏訪 博彦  奈良先端科学技術大学院大学, 先端科学技術研究科, 准教授 (70447580)
水本 旭洋  大阪大学, 大学院情報科学研究科, 特任准教授(常勤) (80780006)
松田 裕貴  奈良先端科学技術大学院大学, 先端科学技術研究科, 客員准教授 (90809708)
Project Period (FY) 2021-04-01 – 2024-03-31
Project Status Completed (Fiscal Year 2024)
Budget Amount *help
¥17,160,000 (Direct Cost: ¥13,200,000、Indirect Cost: ¥3,960,000)
Fiscal Year 2023: ¥6,630,000 (Direct Cost: ¥5,100,000、Indirect Cost: ¥1,530,000)
Fiscal Year 2022: ¥6,110,000 (Direct Cost: ¥4,700,000、Indirect Cost: ¥1,410,000)
Fiscal Year 2021: ¥4,420,000 (Direct Cost: ¥3,400,000、Indirect Cost: ¥1,020,000)
Keywordsユーザ参加型センシング / 連合学習 / ハイレベルコンテキスト推定 / プライバシー保護 / スマートシティ応用 / 場所のコンテキスト推定 / マルチモーダルセンシング / モバイル連合学習 / 参加型センシング / オブジェクト認識 / ハイレベル場所コンテキス収集 / ハイレベル場所コンテキスト収集 / モバイルフェデレーション学習
Outline of Research at the Start

本研究では、ユーザがモバイル・ウェラブルデバイスを使って日頃から収集しているセンサ値や写真などのデータから場所に関連するハイレベルコンテキスト(混雑、風景や人の感情など)をオンデバイスで学習し、認識結果とモデルパラメタのみを他デバイスとフェデレーションラーニングにより共有することで、プライバシー情報の開示なしに、場所に関連したハイレベルコンテキストを広域から収集可能にする技術を開発する。開発した技術を組み込んだ参加型ハイレベルコンテキスト収集基盤およびアプリケーションを実現し、実証実験を通して有効性を示す。

Outline of Final Research Achievements

In this study, we developed a novel participatory sensing platform that achieves a balance between privacy protection and real-time capability. The system enables on-device estimation of location context and user emotions, combined with federated learning for knowledge sharing, and delivers high-precision urban PoI congestion prediction and an emotion estimation method that does not require eye-tracking or physiological sensors. Furthermore, we proposed and implemented federated learning for tourism object recognition, an opportunistic learning framework for Android devices, an automated image generation system reflecting current tourist site context, and an image differential privacy + k-anonymity method for crowd tracking, demonstrating the system’s practical applicability in the fields of tourism and urban services.

Academic Significance and Societal Importance of the Research Achievements

本研究は、ユーザ参加型センシングにおいてプライバシー保護とリアルタイム性を両立する新たなセンシング基盤を構築し、オンデバイス推定とフェデレーション学習を組み合わせた知識共有の枠組みを実現した。都市PoI混雑予測や視線・生体センサ不要な感情推定、画像差分プライバシー+k-匿名性手法などの成果は、学術的にセンシング技術の高度化とプライバシー配慮型AI応用の新展開を示すものである。加えて、観光・都市サービス分野での実用的価値を示しており、今後のスマートシティや持続可能な都市社会の実現に貢献する意義がある。

Report

(4 results)
  • 2024 Final Research Report ( PDF )
  • 2023 Annual Research Report
  • 2022 Annual Research Report
  • 2021 Annual Research Report
  • Research Products

    (19 results)

All 2025 2024 2023 2022 2021 Other

All Int'l Joint Research (1 results) Journal Article (4 results) (of which Int'l Joint Research: 2 results,  Peer Reviewed: 4 results,  Open Access: 3 results) Presentation (14 results) (of which Int'l Joint Research: 10 results,  Invited: 1 results)

  • [Int'l Joint Research] ミズーリ科学技術大学/Vanderbilt University/Western Michigan University(米国)

    • Related Report
      2023 Annual Research Report
  • [Journal Article] Image Differential Privacy and K-anonymity for Pedestrian Image Data: Impact on Cross-camera Person Re-identification & Demographic Predictions2025

    • Author(s)
      Lucas Maris, Yuki Matsuda, Keiichi Yasumoto
    • Journal Title

      ACM Transactions on Cyber-Physical Systems

      Volume: -

    • Related Report
      2023 Annual Research Report
    • Peer Reviewed
  • [Journal Article] Preserving Data Utility in Differentially Private Smart Home Data2024

    • Author(s)
      Stirapongsasuti Sopicha、Tiausas Francis Jerome、Nakamura Yugo、Yasumoto Keiichi
    • Journal Title

      IEEE Access

      Volume: 12 Pages: 56571-56581

    • DOI

      10.1109/access.2024.3390039

    • Related Report
      2023 Annual Research Report
    • Peer Reviewed / Open Access / Int'l Joint Research
  • [Journal Article] HPRoP: Hierarchical Privacy-preserving Route Planning for Smart Cities2023

    • Author(s)
      Tiausas Francis、Yasumoto Keiichi、Talusan Jose Paolo、Yamana Hayato、Yamaguchi Hirozumi、Bhattacharjee Shameek、Dubey Abhishek、Das Sajal K.
    • Journal Title

      ACM Transactions on Cyber-Physical Systems

      Volume: 7 Issue: 4 Pages: 1-25

    • DOI

      10.1145/3616874

    • Related Report
      2023 Annual Research Report
    • Peer Reviewed / Open Access / Int'l Joint Research
  • [Journal Article] PATROL: Participatory Activity Tracking and Risk Assessment for Anonymous Elderly Monitoring2022

    • Author(s)
      Research Dawadi, Teruhiro Mizumoto, Yuki Matsuda, Keiichi Yasumoto
    • Journal Title

      Sensors

      Volume: 22(18) Issue: 18 Pages: 6965-6965

    • DOI

      10.3390/s22186965

    • Related Report
      2022 Annual Research Report
    • Peer Reviewed / Open Access
  • [Presentation] OPTIMIST: Opportunistic Federated Transfer Learning for Mobile Devices Using Sequential Independent Subnetwork Training2025

    • Author(s)
      Victor Romero
    • Organizer
      IEEE PerCom 2025 Workshops
    • Related Report
      2023 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Crowd Flow Prediction from Mobile Traces Through Time Series PoI Stay Counts2024

    • Author(s)
      Osamu Yamada
    • Organizer
      IEEE SMARTCOMP 2024 Workshops
    • Related Report
      2023 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Protecting Cross-Camera Person Re-Identification Data with Image Differential Privacy2024

    • Author(s)
      Lucas Maris
    • Organizer
      IEEE SMARTCOMP 2024 Workshops
    • Related Report
      2023 Annual Research Report
    • Int'l Joint Research
  • [Presentation] A Method for City-Wide PoI-Level Congestion Prediction via Assimilation of Actual and Simulation-Based PoI Congestion Data2024

    • Author(s)
      Haruka Sakagami
    • Organizer
      IEEE SMARTCOMP 2024
    • Related Report
      2023 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Towards Opportunistic Federated Learning Using Independent Subnetwork Training2024

    • Author(s)
      Victor Romero
    • Organizer
      IEEE SMARTCOMP 2024
    • Related Report
      2023 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Automated Image Generation Reflecting Current Status of PoIs for Supporting On-Site Tourist Destination Selection2023

    • Author(s)
      Masaki Kawanaka
    • Organizer
      IoT 2023
    • Related Report
      2023 Annual Research Report
    • Int'l Joint Research
  • [Presentation] A QoS-Aware 3D Point Cloud Streaming from Real Space for Interaction in Metaverse2023

    • Author(s)
      Hiroki Ishimaru, Yugo Nakamura , Manato Fujimoto3, Hirohiko Suwa, Keiichi Yasumoto
    • Organizer
      Cloud2Things 2023: 3rd Workshop on From Cloud to Things: harnessing pervasive data in the Computing Continuum
    • Related Report
      2022 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Towards Cheaper Tourists' Emotion and Satisfaction Estimation with PCA and Subgroup Analysis2023

    • Author(s)
      Lucas Maris, Yuki Matsuda, Ramin Sadre, Keiichi Yasumoto
    • Organizer
      PerAwareCity 2023: 8th International Workshop on Pervasive Context-Aware Smart Cities and Intelligent Transportation Systems
    • Related Report
      2022 Annual Research Report
    • Int'l Joint Research
  • [Presentation] 観光における次訪問スポット決定支援のためのPoI現況画像の自動生成法と評価2023

    • Author(s)
      河中昌樹, 中村優吾, 諏訪博彦, 安本慶一
    • Organizer
      情報処理学会 第194回マルチメディア通信と分散処理研究会
    • Related Report
      2022 Annual Research Report
  • [Presentation] PAVEMENT: Passing Vehicle Detection System with Autonomous Incremental Learning using Camera and Vibration Data2022

    • Author(s)
      Arnan Maipradit, Yumiko Moriyama, Tomoki Okuro, Makoto Yoshida1,2, Nobuya Tachimori, Sinya Akiyama,Hirohiko Suwa, Keiichi Yasumoto
    • Organizer
      IEEE 96th Vehicular Technology Conference (VTC Fall 2022)
    • Related Report
      2022 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Toward Realizing Smart World by IoT and EdgeAI2022

    • Author(s)
      Keiichi Yasumoto
    • Organizer
      IEEE Global Conference on Artificial Intelligence & Internet of Things (2022 IEEE GCAIoT)
    • Related Report
      2022 Annual Research Report
    • Invited
  • [Presentation] FedTour: Participatory Federated Learning of Tourism Object Recognition Models with Minimal Parameter Exchanges between User Devices2022

    • Author(s)
      Shusaku Tomita, Jose Paolo Talusan, Yugo Nakamura, Hirohiko Suwa, Keiichi Yasumoto
    • Organizer
      The 1st Workshop on Serverless computing for pervasive cloud-edge-device systems and services (StarLESS ’22)
    • Related Report
      2021 Annual Research Report
    • Int'l Joint Research
  • [Presentation] 端末間の近距離通信を使ったFederated Learningによる観光オブジェクト認識モデルの参加型学習法とその評価2021

    • Author(s)
      冨田 周作, 中村 優吾, 諏訪 博彦, 安本 慶一
    • Organizer
      第29回マルチメディア通信と分散処理ワークショップ(DPSWS2021)
    • Related Report
      2021 Annual Research Report
  • [Presentation] 観光オブジェクト認識モデルのユーザ参加型構築手法の提案2021

    • Author(s)
      冨田 周作, 中村優吾, 諏訪博彦, 安本慶一
    • Organizer
      マルチメディア、分散、協調とモバイル (DICOMO2021) シンポジウム
    • Related Report
      2021 Annual Research Report

URL: 

Published: 2021-04-28   Modified: 2026-01-16  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi