• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

Audio-visual learning in neural network for elderly surveillance

Research Project

Project/Area Number 19K20335
Research Category

Grant-in-Aid for Early-Career Scientists

Allocation TypeMulti-year Fund
Review Section Basic Section 61030:Intelligent informatics-related
Research InstitutionNational Institute of Advanced Industrial Science and Technology (2021-2022)
University of Tsukuba (2019-2020)

Principal Investigator

Gatto Bernardo  国立研究開発法人産業技術総合研究所, 情報・人間工学領域, 産総研特別研究員 (10826267)

Project Period (FY) 2019-04-01 – 2023-03-31
Project Status Discontinued (Fiscal Year 2022)
Budget Amount *help
¥4,160,000 (Direct Cost: ¥3,200,000、Indirect Cost: ¥960,000)
Fiscal Year 2022: ¥1,300,000 (Direct Cost: ¥1,000,000、Indirect Cost: ¥300,000)
Fiscal Year 2021: ¥1,170,000 (Direct Cost: ¥900,000、Indirect Cost: ¥270,000)
Fiscal Year 2020: ¥650,000 (Direct Cost: ¥500,000、Indirect Cost: ¥150,000)
Fiscal Year 2019: ¥1,040,000 (Direct Cost: ¥800,000、Indirect Cost: ¥240,000)
Keywordselderly surveillance / subspace representation / image recognition / deep learning
Outline of Research at the Start

We will investigate the fusion of visual and acoustic data to support the safe life of the elderly living alone. We will employ information from visual and acoustic sensors (e.g., cameras and microphones) and recognize events, such as domestic activities or abnormal events. In this research, we develop the following technologies: (1) fast neural networks for extraction of visual characteristics from videos, (2) neural networks for acoustic data analysis and, (3) data fusion for event recognition.

Outline of Annual Research Achievements

Motivated by applications of subspace analysis, two new groups of methods were presented in this project: (1) Shallow networks for image classification; and (2) Subspaces for tensor representation and classification. New representations are proposed to preserve the spatial structure and maintain a fast processing time. A new method to keep the temporal structure was also given.

These solutions were evaluated over problems involving person detection, action, and gesture representation. We focused on the fusion of visual and acoustic data to support the safe life of the elderly living alone.

Report

(4 results)
  • 2022 Annual Research Report
  • 2021 Research-status Report
  • 2020 Research-status Report
  • 2019 Research-status Report
  • Research Products

    (12 results)

All 2023 2022 2021 2020 2019

All Journal Article (11 results) (of which Int'l Joint Research: 9 results,  Peer Reviewed: 9 results,  Open Access: 5 results) Presentation (1 results) (of which Int'l Joint Research: 1 results)

  • [Journal Article] Discriminative Singular Spectrum Classifier with applications on bioacoustic signal recognition2023

    • Author(s)
      Gatto Bernardo Bentes、Colonna Juan Gabriel、dos Santos Eulanda Miranda、Lameiras Koerich Alessandro、Fukui Kazuhiro
    • Journal Title

      Digital Signal Processing

      Volume: 133 Pages: 103858-103858

    • DOI

      10.1016/j.dsp.2022.103858

    • Related Report
      2022 Annual Research Report
  • [Journal Article] Grassmannian learning mutual subspace method for image set recognition2023

    • Author(s)
      Lincon S. Souza, Naoya Sogi, Bernardo B. Gatto, Takumi Kobayashi, Kazuhiro Fukui
    • Journal Title

      Neurocomputing

      Volume: 517 Pages: 20-33

    • DOI

      10.1016/j.neucom.2022.10.040

    • Related Report
      2022 Annual Research Report
    • Peer Reviewed / Int'l Joint Research
  • [Journal Article] Pattern-set Representations using Linear, Shallow and Tensor Subspaces2022

    • Author(s)
      Gatto Bernardo B、M. dos Santos Eulanda、S. S. Junior Waldir
    • Journal Title

      CLEI Electronic Journal

      Volume: 25 Issue: 1 Pages: 1-19

    • DOI

      10.19153/cleiej.25.1.5

    • Related Report
      2021 Research-status Report
    • Peer Reviewed / Open Access / Int'l Joint Research
  • [Journal Article] Bojan Batalo, Souza, L.S., Sogi, N., Gatto, B.B., Sogi, N. and Fukui, K.2022

    • Author(s)
      Temporal-Stochastic Tensor Features for Action Recognition
    • Journal Title

      Machine Learning with Applications

      Volume: 25 Pages: 1-33

    • Related Report
      2021 Research-status Report
  • [Journal Article] Bojan Batalo, Souza, L.S., Sogi, N., Gatto, B.B., Sogi, N. and Fukui, K.2022

    • Author(s)
      Analysis of Temporal Tensor Datasets on Product Grassmann Manifold
    • Journal Title

      Conference on Computer Vision and Pattern Recognition Workshop

      Volume: 25 Pages: 1-9

    • Related Report
      2021 Research-status Report
    • Peer Reviewed / Open Access / Int'l Joint Research
  • [Journal Article] Gatto Bernardo B、Fukui K, M. dos Santos Eulanda、S. S. Junior Waldir2021

    • Author(s)
      Advances in subspace learning and its applications
    • Journal Title

      Conference on Graphics, Patterns and Images (SIBGRAPI)

      Volume: 25 Pages: 1-7

    • Related Report
      2021 Research-status Report
    • Peer Reviewed / Open Access / Int'l Joint Research
  • [Journal Article] Multilinear Clustering via Tensor Fukunaga-Koontz Transform with Fisher Eigenspectrum Regularization2021

    • Author(s)
      Gatto Bernardo B., Molinetti Marco A. F., dos Santos Eulanda M., Fukui Kazuhiro
    • Journal Title

      Applied Soft Computing

      Volume: -

    • Related Report
      2020 Research-status Report
    • Peer Reviewed / Int'l Joint Research
  • [Journal Article] Tensor analysis with n-mode generalized difference subspace2021

    • Author(s)
      Gatto Bernardo B., dos Santos Eulanda M., Koerich Alessandro L., Fukui Kazuhiro, S. Junior Waldir S.
    • Journal Title

      Expert Systems with Applications

      Volume: 171 Pages: 114559-114559

    • DOI

      10.1016/j.eswa.2020.114559

    • Related Report
      2020 Research-status Report
    • Peer Reviewed / Int'l Joint Research
  • [Journal Article] Discriminative Singular Spectrum Analysis for Bioacoustic Classification2020

    • Author(s)
      Gatto Bernardo B., Santos Eulanda M. dos, Colonna Juan G., Sogi Naoya, Souza Lincon S., Fukui Kazuhiro
    • Journal Title

      Proc. Interspeech 2020

      Volume: - Pages: 2887-2891

    • DOI

      10.21437/interspeech.2020-2134

    • Related Report
      2020 Research-status Report
    • Peer Reviewed / Int'l Joint Research
  • [Journal Article] Fukunaga?Koontz Convolutional Network with Applications on Character Classification2020

    • Author(s)
      Gatto Bernardo B., dos Santos Eulanda M., Fukui Kazuhiro, Junior Waldir S. S., dos Santos Kenny V.
    • Journal Title

      Neural Processing Letters

      Volume: - Issue: 1 Pages: 443-465

    • DOI

      10.1007/s11063-020-10244-5

    • Related Report
      2019 Research-status Report
    • Peer Reviewed / Open Access / Int'l Joint Research
  • [Journal Article] A semi-supervised convolutional neural network based on subspace representation for image classification2020

    • Author(s)
      Gatto Bernardo B., Souza Lincon S., dos Santos Eulanda M., Fukui Kazuhiro, Junior Waldir S. S., dos Santos Kenny V.
    • Journal Title

      EURASIP Journal on Image and Video Processing

      Volume: - Issue: 1

    • DOI

      10.1186/s13640-020-00507-5

    • Related Report
      2019 Research-status Report
    • Peer Reviewed / Open Access / Int'l Joint Research
  • [Presentation] Tensor Fukunaga-Koontz Transform for Hierarchical Clustering2019

    • Author(s)
      Gatto Bernardo B., Molinetti Marco A. F., dos Santos Eulanda M., Fukui Kazuhiro
    • Organizer
      2019 8th Brazilian Conference on Intelligent Systems (BRACIS)
    • Related Report
      2019 Research-status Report
    • Int'l Joint Research

URL: 

Published: 2019-04-18   Modified: 2023-12-25  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi