• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to project page

2020 Fiscal Year Annual Research Report

強縦断的な生体医学信号の深層学習と健康関連の人工知能応用

Research Project

Project/Area Number 19F19081
Research InstitutionThe University of Tokyo

Principal Investigator

山本 義春  東京大学, 大学院教育学研究科(教育学部), 教授 (60251427)

Co-Investigator(Kenkyū-buntansha) QIAN KUN  東京大学, 教育学研究科(研究院), 外国人特別研究員
Project Period (FY) 2019-10-11 – 2022-03-31
KeywordsSignal Processing / Internet of Things / Artificial Intelligence
Outline of Annual Research Achievements

In summary, we have achieved plenty of milestones during the FY2020. We introduced a novel paradigm that utilises the usage recorded data from smart appliances to analyse the elderly’s behaviour in a long duration. This non-intrusive approach can facilitate the combination of artificial intelligence and internet of things (AIoT) for making a more convenient and flexible life for the ageing population. This work was published online by the top journal IEEE Internet of Things Journal (with an impact factor of 9.936). Moreover, we systematically summarised the scenarios, data modalities, and methodologies for AIoT-enabled applications for the specific elderly group. We also indicated the benchmarks and limitations of the existing studies and gave our perspectives on future work. This article has been accepted and will be published by the prestigious journal IEEE Signal Processing Magazine (with an impact factor of 11.350). A comprehensive review was done and invited to be published by the IEEE Journal of Biomedical and Health Informatics (with an impact factor of 5.223). This review article concluded the state-of-the-art of audio-based methods for localising the snore site in the past three decades. In addition, we formed a team to collaboratively propose a novel approach for monitoring the confirmed COVID-19 patients on their sleep quality, fatigue, and anxiety. The relevant studies were published in the IEEE Internet of Things Journal and ISCA INTERSPEECH conference.

Current Status of Research Progress
Current Status of Research Progress

2: Research has progressed on the whole more than it was originally planned.

Reason

We are now working towards transferring our methods to more general purposes, e.g., monitoring the drowsiness of drivers via the spontaneous physical activity data. We are also investigating the advanced data augmentation methods for coping with the data scarcity challenge among the several applications, e.g., the audio-based COVID-19 diagnosis problem. Furthermore, we are exploring the optimal time-frequency methods for analysing the body sound signals. Some preliminary results have already been achieved in recent study on heart sound analysis work.

Strategy for Future Research Activity

We will continuously collect more human behaviour data in near future, which may include multiple modalities, e.g., audio, video, and wearable sensors. We also want to build an explainable AI system for understanding the human behaviour in a high-level paradigm, which can benefit improving the model’s generalisation for multiple tasks.

  • Research Products

    (10 results)

All 2021 2020

All Journal Article (10 results) (of which Int'l Joint Research: 10 results,  Peer Reviewed: 10 results,  Open Access: 1 results)

  • [Journal Article] Can Machine Learning Assist Locating the Excitation of Snore Sound? A Review2021

    • Author(s)
      Qian Kun、Janott Christoph、Schmitt Maximilian、Zhang Zixing、Heiser Clemens、Hemmert Werner、Yamamoto Yoshiharu、Schuller Bjorn W.
    • Journal Title

      IEEE Journal of Biomedical and Health Informatics

      Volume: 25 Pages: 1233~1246

    • DOI

      10.1109/JBHI.2020.3012666

    • Peer Reviewed / Int'l Joint Research
  • [Journal Article] COVID-19 and Computer Audition: An Overview on What Speech & Sound Analysis Could Contribute in the SARS-CoV-2 Corona Crisis2021

    • Author(s)
      Schuller Bjorn W.、Schuller Dagmar M.、Qian Kun、Liu Juan、Zheng Huaiyuan、Li Xiao
    • Journal Title

      Frontiers in Digital Health

      Volume: 3 Pages: -

    • DOI

      10.3389/fdgth.2021.564906

    • Peer Reviewed / Open Access / Int'l Joint Research
  • [Journal Article] Computer Audition for Fighting the SARS-CoV-2 Corona Crisis ? Introducing the Multi-task Speech Corpus for COVID-192021

    • Author(s)
      Qian Kun、Schmitt Maximilian、Zheng Huaiyuan、Koike Tomoya、Han Jing、Liu Juan、Ji Wei、Duan Junjun、Song Meishu、Yang Zijiang、Ren Zhao、Liu Shuo、Zhang Zixing、Yamamoto Yoshiharu、Schuller Bjorn W.
    • Journal Title

      IEEE Internet of Things Journal

      Volume: - Pages: 1~1

    • DOI

      10.1109/JIOT.2021.3067605

    • Peer Reviewed / Int'l Joint Research
  • [Journal Article] Artificial Intelligence Internet of Things for the Elderly: From Assisted Living to Health-Care Monitoring.2021

    • Author(s)
      Kun Qian, Zixing Zhang, Yoshiharu Yamamoto, and Bjoern W. Schuller.
    • Journal Title

      IEEE Signal Processing Magazine

      Volume: 38 Pages: 1~11

    • Peer Reviewed / Int'l Joint Research
  • [Journal Article] Recent Advances in Computer Audition for Diagnosing COVID-19: An Overview.2021

    • Author(s)
      Kun Qian, Bjorn W. Schuller, and Yoshiharu Yamamoto
    • Journal Title

      Proceedings of LifeTech

      Volume: - Pages: 185~186

    • Peer Reviewed / Int'l Joint Research
  • [Journal Article] Predicting Group Work Performance from Physical Handwriting Features in a Smart English Classroom.2021

    • Author(s)
      Meishu Song, Kun Qian, Bin Chen, Keiju Okabayashi, Emilia Parada-Cabaleiro, Zijiang Yang, Shuo Liu, Kazumasa Togami, Ichiro Hidaka, Yueheng Wang, Bjorn W. Schuller, and Yoshiharu Yamamoto.
    • Journal Title

      Proceedings of ICDSP

      Volume: - Pages: 1~5

    • Peer Reviewed / Int'l Joint Research
  • [Journal Article] Can Appliances Understand the Behaviour of Elderly via Machine Learning? A Feasibility Study2020

    • Author(s)
      Qian Kun、Koike Tomoya、Yoshiuchi Kazuhiro、Schuller Bjorn W.、Yamamoto Yoshiharu
    • Journal Title

      IEEE Internet of Things Journal

      Volume: - Pages: 1~1

    • DOI

      10.1109/JIOT.2020.3045009

    • Peer Reviewed / Int'l Joint Research
  • [Journal Article] Learning Higher Representations from Pre-Trained Deep Models with Data Augmentation for the COMPARE 2020 Challenge Mask Task2020

    • Author(s)
      Koike Tomoya、Qian Kun、Schuller Bjorn W.、Yamamoto Yoshiharu
    • Journal Title

      Proceedings of INTERSPEECH

      Volume: - Pages: 2047~2051

    • DOI

      10.21437/Interspeech.2020-1552

    • Peer Reviewed / Int'l Joint Research
  • [Journal Article] Learning Higher Representations from Bioacoustics: A Sequence-to-Sequence Deep Learning Approach for Bird Sound Classification2020

    • Author(s)
      Qiao Yu、Qian Kun、Zhao Ziping
    • Journal Title

      Proceedings of ICONIP

      Volume: - Pages: 130~138

    • DOI

      10.1007/978-3-030-63823-8_16

    • Peer Reviewed / Int'l Joint Research
  • [Journal Article] An Early Study on Intelligent Analysis of Speech Under COVID-19: Severity, Sleep Quality, Fatigue, and Anxiety2020

    • Author(s)
      Han Jing、Qian Kun、Song Meishu、Yang Zijiang、Ren Zhao、Liu Shuo、Liu Juan、Zheng Huaiyuan、Ji Wei、Koike Tomoya、Li Xiao、Zhang Zixing、Yamamoto Yoshiharu、Schuller Bj?rn W.
    • Journal Title

      Proceedings of INTERSPEECH

      Volume: - Pages: 4946~4950

    • DOI

      10.21437/Interspeech.2020-2223

    • Peer Reviewed / Int'l Joint Research

URL: 

Published: 2021-12-27  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi