• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

強縦断的な生体医学信号の深層学習と健康関連の人工知能応用

Research Project

Project/Area Number 19F19081
Research Category

Grant-in-Aid for JSPS Fellows

Allocation TypeSingle-year Grants
Section外国
Review Section Basic Section 62010:Life, health and medical informatics-related
Research InstitutionThe University of Tokyo

Principal Investigator

山本 義春  東京大学, 大学院教育学研究科(教育学部), 教授 (60251427)

Co-Investigator(Kenkyū-buntansha) QIAN KUN  東京大学, 教育学研究科(研究院), 外国人特別研究員
Project Period (FY) 2019-10-11 – 2022-03-31
Project Status Completed (Fiscal Year 2021)
Budget Amount *help
¥2,300,000 (Direct Cost: ¥2,300,000)
Fiscal Year 2021: ¥600,000 (Direct Cost: ¥600,000)
Fiscal Year 2020: ¥1,100,000 (Direct Cost: ¥1,100,000)
Fiscal Year 2019: ¥600,000 (Direct Cost: ¥600,000)
KeywordsSignal Processing / Internet of Things / Artificial Intelligence
Outline of Research at the Start

This research aims to leverage the power of AI for analyzing and monitoring the daily behavior of the patients suffering from psychiatric diseases via the biomedical intensive longitudinal data. We will investigate the state-of-the-art techniques of machine learning, deep learning, and signal processing for their capacity on screening the patients from the healthy control. In addition, we will explore the feasibility to use the paradigm of AI to implement an automatic monitoring and evaluation system for subject’s health status by IoT sensor data.

Outline of Annual Research Achievements

In the FY2021, we have experienced a productive research achievement. We have successfully published an overview paper on the topic of using artificial intelligence and internet of things (AIoT) technologies to better the ageing society. This paper has been published by the prestigious top journal, IEEE Signal Processing Magazine, and can itself be a good guidance for a broad community. In addition, this overview paper summarized the main ideas and/or techniques that learnt from our research project. We have used IoT sensor data to monitor the physical and mental status of elderly people (who are living alone), which has been found efficient and published in the IEEE Internet of Things Journal. Moreover, we have published our paper on using the state-of-the-art computer audition (CA) techniques to measure the health status of patients suffering from the COVID-19. The results were published by the IEEE Internet of Things Journal. A multi-modal learning system for monitoring the driver’s drowsiness level was accepted and published online by the top journal IEEE Transactions on Intelligent Transportation Systems. A systematic review on CA methods for snore site localization was published by the IEEE Journal of Biomedical and Health Informatics. Moreover, we have some collaborative works with other colleagues.

Research Progress Status

令和3年度が最終年度であるため、記入しない。

Strategy for Future Research Activity

令和3年度が最終年度であるため、記入しない。

Report

(3 results)
  • 2021 Annual Research Report
  • 2020 Annual Research Report
  • 2019 Annual Research Report
  • Research Products

    (23 results)

All 2021 2020 2019

All Journal Article (23 results) (of which Int'l Joint Research: 23 results,  Peer Reviewed: 23 results,  Open Access: 3 results)

  • [Journal Article] Artificial Intelligence Internet of Things for the Elderly: From Assisted Living to Health-Care Monitoring2021

    • Author(s)
      Qian Kun、Zhang Zixing、Yamamoto Yoshiharu、Schuller Bjoern W.
    • Journal Title

      IEEE Signal Processing Magazine

      Volume: 38 Issue: 4 Pages: 78-88

    • DOI

      10.1109/msp.2021.3057298

    • Related Report
      2021 Annual Research Report
    • Peer Reviewed / Int'l Joint Research
  • [Journal Article] Computer Audition for Fighting the SARS-CoV-2 Corona Crisis ? Introducing the Multi-task Speech Corpus for COVID-192021

    • Author(s)
      Qian Kun、Schmitt Maximilian、Zheng Huaiyuan、Koike Tomoya、Han Jing、Liu Juan、Ji Wei、Duan Junjun、Song Meishu、Yang Zijiang、Ren Zhao、Liu Shuo、Zhang Zixing、Yamamoto Yoshiharu、Schuller Bjorn W.
    • Journal Title

      IEEE Internet of Things Journal

      Volume: - Issue: 21 Pages: 1-1

    • DOI

      10.1109/jiot.2021.3067605

    • Related Report
      2021 Annual Research Report 2020 Annual Research Report
    • Peer Reviewed / Int'l Joint Research
  • [Journal Article] Learning Multimodal Representations for Drowsiness Detection2021

    • Author(s)
      Qian Kun、Koike Tomoya、Nakamura Toru、Schuller Bjorn、Yamamoto Yoshiharu
    • Journal Title

      IEEE Transactions on Intelligent Transportation Systems

      Volume: in press Issue: 8 Pages: 1-10

    • DOI

      10.1109/tits.2021.3105326

    • Related Report
      2021 Annual Research Report
    • Peer Reviewed / Int'l Joint Research
  • [Journal Article] Can Machine Learning Assist Locating the Excitation of Snore Sound? A Review2021

    • Author(s)
      Qian Kun、Janott Christoph、Schmitt Maximilian、Zhang Zixing、Heiser Clemens、Hemmert Werner、Yamamoto Yoshiharu、Schuller Bjorn W.
    • Journal Title

      IEEE Journal of Biomedical and Health Informatics

      Volume: 25 Issue: 4 Pages: 1233-1246

    • DOI

      10.1109/jbhi.2020.3012666

    • Related Report
      2021 Annual Research Report 2020 Annual Research Report
    • Peer Reviewed / Int'l Joint Research
  • [Journal Article] Editorial: Machine Learning for Non/Less-Invasive Methods in Health Informatics2021

    • Author(s)
      Qian Kun、Zhang Liang、Li Kezhi、Liu Juan
    • Journal Title

      Frontiers in Digital Health

      Volume: 3 Pages: 1-1

    • DOI

      10.3389/fdgth.2021.763109

    • Related Report
      2021 Annual Research Report
    • Peer Reviewed / Open Access / Int'l Joint Research
  • [Journal Article] An Online Robot Collision Detection and Identification Scheme by Supervised Learning and Bayesian Decision Theory2021

    • Author(s)
      Zhang Zengjie、Qian Kun、Schuller Bjorn W.、Wollherr Dirk
    • Journal Title

      IEEE Transactions on Automation Science and Engineering

      Volume: 18 Issue: 3 Pages: 1144-1156

    • DOI

      10.1109/tase.2020.2997094

    • Related Report
      2021 Annual Research Report
    • Peer Reviewed / Int'l Joint Research
  • [Journal Article] Prediction on Mechanical Properties of Non-Equiatomic High-Entropy Alloy by Atomistic Simulation and Machine Learning2021

    • Author(s)
      Zhang Liang、Qian Kun、Schuller Bj?rn W.、Shibuta Yasushi
    • Journal Title

      Metals

      Volume: 11 Issue: 6 Pages: 922-922

    • DOI

      10.3390/met11060922

    • Related Report
      2021 Annual Research Report
    • Peer Reviewed / Int'l Joint Research
  • [Journal Article] Learning audio sequence representations for acoustic event classification2021

    • Author(s)
      Zhang Zixing、Liu Ding、Han Jing、Qian Kun、Schuller Bj?rn W.
    • Journal Title

      Expert Systems with Applications

      Volume: 178 Pages: 115007-115007

    • DOI

      10.1016/j.eswa.2021.115007

    • Related Report
      2021 Annual Research Report
    • Peer Reviewed / Int'l Joint Research
  • [Journal Article] COVID-19 and Computer Audition: An Overview on What Speech & Sound Analysis Could Contribute in the SARS-CoV-2 Corona Crisis2021

    • Author(s)
      Schuller Bjorn W.、Schuller Dagmar M.、Qian Kun、Liu Juan、Zheng Huaiyuan、Li Xiao
    • Journal Title

      Frontiers in Digital Health

      Volume: 3 Pages: 1-1

    • DOI

      10.3389/fdgth.2021.564906

    • Related Report
      2021 Annual Research Report 2020 Annual Research Report
    • Peer Reviewed / Open Access / Int'l Joint Research
  • [Journal Article] Artificial Intelligence Internet of Things for the Elderly: From Assisted Living to Health-Care Monitoring.2021

    • Author(s)
      Kun Qian, Zixing Zhang, Yoshiharu Yamamoto, and Bjoern W. Schuller.
    • Journal Title

      IEEE Signal Processing Magazine

      Volume: 38 Pages: 1-11

    • Related Report
      2020 Annual Research Report
    • Peer Reviewed / Int'l Joint Research
  • [Journal Article] Recent Advances in Computer Audition for Diagnosing COVID-19: An Overview.2021

    • Author(s)
      Kun Qian, Bjorn W. Schuller, and Yoshiharu Yamamoto
    • Journal Title

      Proceedings of LifeTech

      Volume: - Pages: 185-186

    • Related Report
      2020 Annual Research Report
    • Peer Reviewed / Int'l Joint Research
  • [Journal Article] Predicting Group Work Performance from Physical Handwriting Features in a Smart English Classroom.2021

    • Author(s)
      Meishu Song, Kun Qian, Bin Chen, Keiju Okabayashi, Emilia Parada-Cabaleiro, Zijiang Yang, Shuo Liu, Kazumasa Togami, Ichiro Hidaka, Yueheng Wang, Bjorn W. Schuller, and Yoshiharu Yamamoto.
    • Journal Title

      Proceedings of ICDSP

      Volume: - Pages: 1-5

    • Related Report
      2020 Annual Research Report
    • Peer Reviewed / Int'l Joint Research
  • [Journal Article] Can Appliances Understand the Behaviour of Elderly via Machine Learning? A Feasibility Study2020

    • Author(s)
      Qian Kun、Koike Tomoya、Yoshiuchi Kazuhiro、Schuller Bjorn W.、Yamamoto Yoshiharu
    • Journal Title

      IEEE Internet of Things Journal

      Volume: - Issue: 10 Pages: 1-1

    • DOI

      10.1109/jiot.2020.3045009

    • Related Report
      2021 Annual Research Report 2020 Annual Research Report
    • Peer Reviewed / Open Access / Int'l Joint Research
  • [Journal Article] Learning Higher Representations from Pre-Trained Deep Models with Data Augmentation for the COMPARE 2020 Challenge Mask Task2020

    • Author(s)
      Koike Tomoya、Qian Kun、Schuller Bjorn W.、Yamamoto Yoshiharu
    • Journal Title

      Proceedings of INTERSPEECH

      Volume: - Pages: 2047-2051

    • DOI

      10.21437/interspeech.2020-1552

    • Related Report
      2020 Annual Research Report
    • Peer Reviewed / Int'l Joint Research
  • [Journal Article] Learning Higher Representations from Bioacoustics: A Sequence-to-Sequence Deep Learning Approach for Bird Sound Classification2020

    • Author(s)
      Qiao Yu、Qian Kun、Zhao Ziping
    • Journal Title

      Proceedings of ICONIP

      Volume: - Pages: 130-138

    • DOI

      10.1007/978-3-030-63823-8_16

    • ISBN
      9783030638221, 9783030638238
    • Related Report
      2020 Annual Research Report
    • Peer Reviewed / Int'l Joint Research
  • [Journal Article] An Early Study on Intelligent Analysis of Speech Under COVID-19: Severity, Sleep Quality, Fatigue, and Anxiety2020

    • Author(s)
      Han Jing、Qian Kun、Song Meishu、Yang Zijiang、Ren Zhao、Liu Shuo、Liu Juan、Zheng Huaiyuan、Ji Wei、Koike Tomoya、Li Xiao、Zhang Zixing、Yamamoto Yoshiharu、Schuller Bj?rn W.
    • Journal Title

      Proceedings of INTERSPEECH

      Volume: - Pages: 4946-4950

    • DOI

      10.21437/interspeech.2020-2223

    • Related Report
      2020 Annual Research Report
    • Peer Reviewed / Int'l Joint Research
  • [Journal Article] An Online Robot Collision Detection and Identification Scheme by Supervised Learning and Bayesian Decision Theory2020

    • Author(s)
      Zengjie Zhang, Kun Qian, Bjoern W. Schuller, and Dirk Wollherr
    • Journal Title

      IEEE Transactions on Automation Science and Engineering

      Volume: -

    • Related Report
      2019 Annual Research Report
    • Peer Reviewed / Int'l Joint Research
  • [Journal Article] Can Affective Computing Better the Mental Status of the Electronic Games Player? A Perspective2020

    • Author(s)
      Yueheng Wang, Kun Qian, Jacob Nelson, Hiromichi Yagi, Akifumi Kishi, Kenji Morita, and Yoshiharu Yamamoto
    • Journal Title

      Proceedings of the Global Conference on Life Sciences and Technologies (LifeTech)

      Volume: - Pages: 366-367

    • Related Report
      2019 Annual Research Report
    • Peer Reviewed / Int'l Joint Research
  • [Journal Article] Audio for Audio is Better? An Investigation on Transfer Learning Models for Heart Sound Classification2020

    • Author(s)
      Tomoya Koike, Kun Qian, Qiuqiang Kong, Mark D. Plumbley, Bjoern W. Schuller, and Yoshiharu Yamamoto
    • Journal Title

      Proceedings of the Annual International Conference of the IEEE Engineering in Medicine & Biology Society (EMBC)

      Volume: -

    • Related Report
      2019 Annual Research Report
    • Peer Reviewed / Int'l Joint Research
  • [Journal Article] Computer Audition for Healthcare: Opportunities and Challenges2020

    • Author(s)
      Kun Qian, Xiao Li, Haifeng Li, Shengchen Li, Wei Li, Zuoliang Ning, Shuai Yu, Limin Hou, Gang Tang, Jing Lu, Feng Li, Shufei Duan, Chengcheng Du, Yao Cheng, Yujun Wang, Lin Gan, Yoshiharu Yamamoto, and Bjoern W. Schuller
    • Journal Title

      Frontiers in Digital Health

      Volume: -

    • Related Report
      2019 Annual Research Report
    • Peer Reviewed / Int'l Joint Research
  • [Journal Article] Machine Listening for Heart Status Monitoring: Introducing and Benchmarking HSS; the Heart Sounds Shenzhen Corpus2019

    • Author(s)
      Fengquan Dong, Kun Qian, Zhao Ren, Alice Baird, Xinjian Li, Zhenyu Dai, Bo Dong, Florian Metze, Yoshiharu Yamamoto, and Bjoern W. Schuller
    • Journal Title

      IEEE Journal of Biomedical and Health Informatics

      Volume: -

    • Related Report
      2019 Annual Research Report
    • Peer Reviewed / Int'l Joint Research
  • [Journal Article] Deep Wavelets for Heart Sound Classification2019

    • Author(s)
      Kun Qian, Zhao Ren, Fengquan Dong, Wen-Hsing Lai, Bjoern W. Schuller, and Yoshiharu Yamamoto
    • Journal Title

      Proceedings of the International Symposium on Intelligent Signal Processing and Communication Systems (ISPACS)

      Volume: - Pages: 1-2

    • Related Report
      2019 Annual Research Report
    • Peer Reviewed / Int'l Joint Research
  • [Journal Article] Can Active Learning Benefit the Smart Grid? A Perspective on Overcoming the Data Scarcity2019

    • Author(s)
      Wei Guo, Xiang Zha, Kun Qian, and Tao Che
    • Journal Title

      Proceedings of the International Conference on Electronics and Communication Engineering (ICECE)

      Volume: - Pages: 346-350

    • Related Report
      2019 Annual Research Report
    • Peer Reviewed / Int'l Joint Research

URL: 

Published: 2019-10-15   Modified: 2024-03-26  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi