• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to project page

2022 Fiscal Year Research-status Report

Linking Vision and Language through Computational Modelling

Research Project

Project/Area Number 19K12733
Research InstitutionKobe City University of Foreign Studies

Principal Investigator

CHANG Franklin  神戸市外国語大学, 外国語学部, 教授 (60827343)

Project Period (FY) 2019-04-01 – 2024-03-31
KeywordsVision / Language / Learning / Event understanding / Computational model / Deep Learning / Priming / Verbs
Outline of Annual Research Achievements

I have written a paper on a deep learning model of how visual input is used to select verbs. The model is trained on data from human experiments on adults and the model was tested by comparing its verb use to children and adults. This paper has been accepted at Cognitive Science.

Current Status of Research Progress
Current Status of Research Progress

2: Research has progressed on the whole more than it was originally planned.

Reason

I am continuing to do research on structural priming to test the assumptions about prediction error-based learning in the deep learning model. Recently, I have started to examine the lexical boost as well.

Strategy for Future Research Activity

Now that the previous paper is almost done, I will start some new deep learning modeling work.

Causes of Carryover

I was not able to finish using my amount for this year.

  • Research Products

    (3 results)

All 2022

All Journal Article (2 results) (of which Int'l Joint Research: 2 results,  Peer Reviewed: 2 results,  Open Access: 2 results) Presentation (1 results)

  • [Journal Article] Thematic role tracking difficulties across multiple visual events influences role use in language production2022

    • Author(s)
      Jessop Andrew、Chang Franklin
    • Journal Title

      Visual Cognition

      Volume: 30 Pages: 151~173

    • DOI

      10.1080/13506285.2021.2013374

    • Peer Reviewed / Open Access / Int'l Joint Research
  • [Journal Article] Abstract structures and meaning in Japanese dative structural priming2022

    • Author(s)
      Chang Franklin、Tsumura Saki、Minemi Itsuki、Hirose Yuki
    • Journal Title

      Applied Psycholinguistics

      Volume: 43 Pages: 411~433

    • DOI

      10.1017/S0142716421000576

    • Peer Reviewed / Open Access / Int'l Joint Research
  • [Presentation] A deep learning verb production model using input from visual animations2022

    • Author(s)
      Chang, F., Tatsumi, T., Hiranuma, Y., & Bannard, C.
    • Organizer
      Talk presented at the TL/Mental Architecture for Processing and Learning of Language conference.

URL: 

Published: 2023-12-25  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi