• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

Development of deep neural network architecture for multitask learning

Research Project

Project/Area Number 18K11348
Research Category

Grant-in-Aid for Scientific Research (C)

Allocation TypeMulti-year Fund
Section一般
Review Section Basic Section 61010:Perceptual information processing-related
Research InstitutionTokyo Institute of Technology (2020)
The University of Tokyo (2018-2019)

Principal Investigator

Kawakami Rei  東京工業大学, 情報理工学院, 特任准教授 (90591305)

Project Period (FY) 2018-04-01 – 2021-03-31
Project Status Completed (Fiscal Year 2020)
Budget Amount *help
¥4,420,000 (Direct Cost: ¥3,400,000、Indirect Cost: ¥1,020,000)
Fiscal Year 2020: ¥1,040,000 (Direct Cost: ¥800,000、Indirect Cost: ¥240,000)
Fiscal Year 2019: ¥1,170,000 (Direct Cost: ¥900,000、Indirect Cost: ¥270,000)
Fiscal Year 2018: ¥2,210,000 (Direct Cost: ¥1,700,000、Indirect Cost: ¥510,000)
Keywords深層学習 / マルチタスク学習 / ニューラルネットワーク / 物体検出 / 物体追跡 / 領域分割 / 汎化性能 / MTL
Outline of Final Research Achievements

In this project, the applicant has developed a deep learner that performs multitask learning (MTL, Multitask Learning), in particular, MTL for the combination of object detection and semantic segmentation, and object tracking and detection. We have selected task combinations and data sets, proposed and improved cross-connections to realize MTL, and confirmed the improvement of generalization performance by MTL. The convolution of the cross-connections was replaced by a convolutional recurrent neural network, and a network for processing time-series data was designed, achieving performance improvement over conventional methods.

Academic Significance and Societal Importance of the Research Achievements

マルチタスク学習を行う深層学習器は今後,人に変わって認識を行うAIにおいて広く普及することになるだろう.本事業はそのマルチタスクの基本的な組み合わせにおいて,設計を吟味し,全般的な性能改善と汎化性能の向上に関する先駆的な結果を得た.一般的にマルチタスク学習では組み合わせても結果が向上するとは限らず,世界的にも様々な試みが提案されている中で,先駆的な結果を得たことは学術的にも社会的にも有意義である.

Report

(4 results)
  • 2020 Annual Research Report   Final Research Report ( PDF )
  • 2019 Research-status Report
  • 2018 Research-status Report
  • Research Products

    (28 results)

All 2021 2020 2019 2018 Other

All Int'l Joint Research (1 results) Journal Article (9 results) (of which Int'l Joint Research: 5 results,  Open Access: 6 results,  Peer Reviewed: 3 results) Presentation (13 results) (of which Int'l Joint Research: 3 results,  Invited: 1 results) Remarks (5 results)

  • [Int'l Joint Research] University of Amsterdam(オランダ)

    • Related Report
      2020 Annual Research Report
  • [Journal Article] Finding a Needle in a Haystack: Tiny Flying Object Detection in 4K Videos using a Joint Detection-and-Tracking Approach2021

    • Author(s)
      Ryota Yoshihashi, Rei Kawakami, Shaodi You, Tu Tuan Trinh, Makoto Iida, Takeshi Naemura
    • Journal Title

      arxiv

      Volume: 05 Pages: 1-18

    • Related Report
      2020 Annual Research Report
    • Open Access / Int'l Joint Research
  • [Journal Article] OUR Shurijo みんなの首里城デジタル復元プロジェクト2020

    • Author(s)
      川上玲
    • Journal Title

      情報処理

      Volume: 61 Pages: 138-140

    • NAID

      40022146186

    • Related Report
      2019 Research-status Report
    • Open Access
  • [Journal Article] Cattle detection and counting in UAV images based on convolutional neural networks2019

    • Author(s)
      Shao Wen、Kawakami Rei、Yoshihashi Ryota、You Shaodi、Kawase Hidemichi、Naemura Takeshi
    • Journal Title

      International Journal of Remote Sensing

      Volume: 41 Issue: 1 Pages: 31-52

    • DOI

      10.1080/01431161.2019.1624858

    • Related Report
      2019 Research-status Report
    • Peer Reviewed / Open Access / Int'l Joint Research
  • [Journal Article] Unsupervised anomaly detection with compact deep features for wind turbine blade images taken by a drone2019

    • Author(s)
      Wang Yinan、Yoshihashi Ryota、Kawakami Rei、You Shaodi、Harano Tohru、Ito Masahiko、Komagome Katsura、Iida Makoto、Naemura Takeshi
    • Journal Title

      IPSJ Transactions on Computer Vision and Applications

      Volume: 11 Issue: 1 Pages: 1-7

    • DOI

      10.1186/s41074-019-0056-0

    • Related Report
      2019 Research-status Report
    • Peer Reviewed / Open Access / Int'l Joint Research
  • [Journal Article] Pedestrian detection with motion features via two-stream ConvNets2018

    • Author(s)
      Yoshihashi Ryota、Trinh Tu Tuan、Kawakami Rei、You Shaodi、Iida Makoto、Naemura Takeshi
    • Journal Title

      IPSJ Transactions on Computer Vision and Applications

      Volume: 10 Issue: 1

    • DOI

      10.1186/s41074-018-0048-5

    • Related Report
      2018 Research-status Report
    • Peer Reviewed / Open Access / Int'l Joint Research
  • [Journal Article] Cross-connected Networks for Multi-task Learning of Detection and Segmentation2018

    • Author(s)
      Seiichiro Fukuda, Ryota Yoshihashi, Rei Kawakami, Shaodi You, Makoto Iida, Takeshi Naemura
    • Journal Title

      arXiv:1805.05569v1

      Volume: 5

    • Related Report
      2018 Research-status Report
    • Open Access / Int'l Joint Research
  • [Journal Article] 5分で分かる!? 有名論文ナナメ読み Geoffrey E. Hinton, Simon Osindero and Yee-Whye Teh : A Fast Learning Algorithm for Deep Belief Nets2018

    • Author(s)
      川上玲
    • Journal Title

      情報処理

      Volume: 59 Pages: 946-948

    • Related Report
      2018 Research-status Report
  • [Journal Article] 第98回 私の研究開発ツール マイクロソフトコグニティブサービス2018

    • Author(s)
      川上玲
    • Journal Title

      映像情報メディア学会誌

      Volume: 72 Pages: 423-426

    • Related Report
      2018 Research-status Report
  • [Journal Article] CVPR 2018 参加報告2018

    • Author(s)
      谷合竜典, 川上玲
    • Journal Title

      情報処理

      Volume: 59 Pages: 1044-1046

    • NAID

      40021708112

    • Related Report
      2018 Research-status Report
  • [Presentation] RNN-based Motion Prediction in Competitive Fencing Considering Interaction between Players2020

    • Author(s)
      Yutaro Honda, Rei Kawakami, Takeshi Naemura
    • Organizer
      British Machine Vision Conference
    • Related Report
      2020 Annual Research Report
    • Int'l Joint Research
  • [Presentation] 映像生成による時間順序の並べ替えで学習した時空間コンテキストに基づく異常検知2020

    • Author(s)
      邵文, 川上玲, 苗村健
    • Organizer
      画像の認識・理解シンポジウム(MIRU2020)
    • Related Report
      2020 Annual Research Report
  • [Presentation] フェンシングにおける選手間相互作用を考慮したRNNによる姿勢予測2020

    • Author(s)
      本田悠太郎, 川上玲, 苗村健
    • Organizer
      統計関連学会連合大会
    • Related Report
      2020 Annual Research Report
    • Invited
  • [Presentation] フェンシングにおける選手間相互作用を考慮したRNNによる姿勢予測2020

    • Author(s)
      本田悠太郎, 川上玲, 苗村健
    • Organizer
      画像の認識・理解シンポジウム(MIRU2020)
    • Related Report
      2020 Annual Research Report
  • [Presentation] 画像と音声の特徴マッチングによる物体およびシーンを考慮した環境音の生成2020

    • Author(s)
      Chanya Kukulprasong, 川上玲, 苗村健
    • Organizer
      画像の認識・理解シンポジウム(MIRU2020)
    • Related Report
      2020 Annual Research Report
  • [Presentation] Classification-Reconstruction Learning for Open-Set Recognition2019

    • Author(s)
      Ryota Yoshihashi, Wen Shao, Rei Kawakami , Shaodi You, Makoto Iida, and Takeshi Naemura
    • Organizer
      IEEE Computer Society Conference on Computer Vision and Pattern Recognition
    • Related Report
      2019 Research-status Report
    • Int'l Joint Research
  • [Presentation] Cross-connected Networks for Multi-task Learning of Detection and Segmentation2019

    • Author(s)
      Rei Kawakami, Ryota Yoshihashi, Seiichiro Fukuda, Shaodi You, Makoto Iida, Takeshi Naemura
    • Organizer
      IEEE International Confenrence on Image Processing
    • Related Report
      2019 Research-status Report
    • Int'l Joint Research
  • [Presentation] ドローンによる牧場空撮画像における乳牛の個体識別2019

    • Author(s)
      田口航平, 邵文, 川上玲, 川瀬英路, 苗村健
    • Organizer
      画像センシングシンポジウムSSII
    • Related Report
      2019 Research-status Report
  • [Presentation] てんかん診断に向けた神経細胞画像におけるγアミノ酪酸受容体の異常運動の検出2019

    • Author(s)
      児玉悠斗, 川上 玲, 坂内博子, 苗村健
    • Organizer
      画像の認識・理解シンポジウム (MIRU2019)
    • Related Report
      2019 Research-status Report
  • [Presentation] 風車ブレード画像における損傷検知のための教師あり・教師無し学習の比較2019

    • Author(s)
      王亦楠, 川上玲, 原野徹, 伊藤昌彦, 駒込桂, 飯田誠, 苗村健
    • Organizer
      風力エネルギー利用シンポジウム
    • Related Report
      2019 Research-status Report
  • [Presentation] 動き表現の深層学習に基づく小物体の検出と追跡2018

    • Author(s)
      吉橋 亮太,チン トゥアントゥー,川上 玲,尤 少迪,飯田 誠,苗村 健
    • Organizer
      画像の認識・理解シンポジウム (MIRU2018)
    • Related Report
      2018 Research-status Report
  • [Presentation] 風車ブレードのドローンによる空撮画像における異常検知手法の検討2018

    • Author(s)
      王亦楠,吉橋亮太,川上玲,尤少迪,原野徹,伊藤昌彦,駒込桂,飯田誠,苗村健
    • Organizer
      風力エネルギー利用シンポジウム
    • Related Report
      2018 Research-status Report
  • [Presentation] GANを用いた単一画像からのハイダイナミックレンジ画像の生成2018

    • Author(s)
      森脇健太, 吉橋 亮太, 川上 玲, ユウ シャオディ, 苗村 健
    • Organizer
      情報処理学会CVIM研究会
    • Related Report
      2018 Research-status Report
  • [Remarks] Rei Kawakami

    • URL

      https://d-itlab.c.titech.ac.jp/~reikawa/research/research.html

    • Related Report
      2020 Annual Research Report
  • [Remarks] Research

    • URL

      http://nae-lab.org/~rei/research/

    • Related Report
      2019 Research-status Report
  • [Remarks] CORSR: Classification-Reconstruction Learning

    • URL

      https://nae-lab.org/~rei/research/crosr/

    • Related Report
      2019 Research-status Report
  • [Remarks] Cattle detection and counting in UAV images

    • URL

      http://bird.nae-lab.org/cattle/

    • Related Report
      2019 Research-status Report
  • [Remarks] Rei Kawakami

    • URL

      https://nae-lab.org/~rei/research/research.html

    • Related Report
      2018 Research-status Report

URL: 

Published: 2018-04-23   Modified: 2022-01-27  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi