• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

Development of a System for Collecting Context Data for Large-Scale Inverse Reinforcement Learning

Research Project

Project/Area Number 17K00295
Research Category

Grant-in-Aid for Scientific Research (C)

Allocation TypeMulti-year Fund
Section一般
Research Field Intelligent informatics
Research InstitutionHokkaido University

Principal Investigator

Rzepka Rafal  北海道大学, 情報科学研究院, 助教 (80396316)

Project Period (FY) 2017-04-01 – 2022-03-31
Project Status Completed (Fiscal Year 2021)
Budget Amount *help
¥4,290,000 (Direct Cost: ¥3,300,000、Indirect Cost: ¥990,000)
Fiscal Year 2020: ¥1,170,000 (Direct Cost: ¥900,000、Indirect Cost: ¥270,000)
Fiscal Year 2019: ¥910,000 (Direct Cost: ¥700,000、Indirect Cost: ¥210,000)
Fiscal Year 2018: ¥910,000 (Direct Cost: ¥700,000、Indirect Cost: ¥210,000)
Fiscal Year 2017: ¥1,300,000 (Direct Cost: ¥1,000,000、Indirect Cost: ¥300,000)
Keywords知識獲得 / 因果関係 / コモンセンス / 文脈処理 / ストーリー処理 / corpus creation / story generation / danger detection / commonsense / common sense / causal relations / story understanding / crowdsourcing / context understanding / knowledge completion / natural language / language models / context processing / implicit knowledge / semantic chains / text generation / data collection / data analysis / knowledge testing / 人工知能
Outline of Final Research Achievements

This project aimed at creating data to be used in machine learning as an equivalent of human supervisor but in a deeper manner than plain statistics of words in corpora usually used today. Common sense knowledge is most often not explicitly expressed and semantic graphs as ConceptNet were proposed to enrich context processing. However, such graphs are not too helpful for inferring causal chains of events. To fill this gap I proposed algorithms for automatic augmentation of events and to examine how small changes of context change results of sentiment recognition task in context of potential danger detection. Although some results were promising, the automatic approach suffered from unnatural completions and there was a problem with evaluation as similar data did not exist for Japanese language. Therefore I created two datasets: a) 21,592 sentences for recognizing influence of contextual changes and b) 8,800 five sentence stories for story understanding experiments.

Academic Significance and Societal Importance of the Research Achievements

本研究の成果のアルゴリズムは、言語モデルの出力を知識ベースとコーパステキストを用いることによって部分的に制御することができることを示した。このアプローチは現在でも広く利用されておらず、制御されない深層学習が危険な判断をする原因になることがあり、社会が人工知能の研究を信用しない原因の一つでもある。本研究で作成したデータセットは、危険検知における文脈変化の影響に関するものとしては世界初で,大量なストーリーのDBとして日本語で初めて作成されたものである。両方のデータセットの公開は、人工知能が日常生活での行動が安全かどうかを検証するための新しいタスクを切り開く可能性がある。

Report

(6 results)
  • 2021 Annual Research Report   Final Research Report ( PDF )
  • 2020 Research-status Report
  • 2019 Research-status Report
  • 2018 Research-status Report
  • 2017 Research-status Report
  • Research Products

    (33 results)

All 2022 2021 2020 2019 2018 2017 Other

All Int'l Joint Research (1 results) Journal Article (2 results) (of which Int'l Joint Research: 1 results,  Peer Reviewed: 1 results) Presentation (30 results) (of which Int'l Joint Research: 17 results,  Invited: 3 results)

  • [Int'l Joint Research] Queensland University of Technology(オーストラリア)

    • Related Report
      2019 Research-status Report
  • [Journal Article] Stepwise Noise Elimination for Better Motivational and Advisory Texts Classification2020

    • Author(s)
      Patrycja Swieczkowska, Rafal Rzepka, and Kenji Araki
    • Journal Title

      Journal of Advanced Computational Intelligence and Intelligent Informatics

      Volume: 24 Issue: 1 Pages: 156-168

    • DOI

      10.20965/jaciii.2020.p0156

    • NAID

      130007788536

    • ISSN
      1343-0130, 1883-8014
    • Year and Date
      2020-01-20
    • Related Report
      2019 Research-status Report
  • [Journal Article] What People Say? - Web-based Casuistry for Artificial Morality Experiments2017

    • Author(s)
      Rafal Rzepka and Kenji Araki
    • Journal Title

      Lecture Notes in Computer Science

      Volume: 10414 Pages: 178-187

    • DOI

      10.1007/978-3-319-63703-7_17

    • ISBN
      9783319637020, 9783319637037
    • Related Report
      2017 Research-status Report
    • Peer Reviewed / Int'l Joint Research
  • [Presentation] Comparison of Zero-Shot Ethical Classification With and Without Automatically Generated Consequences2022

    • Author(s)
      Rafal Rzepka, Yuki Katsumata, Kenji Araki
    • Organizer
      AAAI Spring Symposium on Approaches to Ethical Computing Metrics for Measuring AI’s Proficiency and Competency for Ethical Reasoning
    • Related Report
      2021 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Pitfalls of Current AI Helping To Analyze Japanese Tweets2022

    • Author(s)
      Rafal Rzepka
    • Organizer
      Practicing Japan - 35 years of Japanese Studies in Poznan and Krakow Conference
    • Related Report
      2021 Annual Research Report
    • Int'l Joint Research
  • [Presentation] 文脈による危険度変化の予測のためのデータセット構築2022

    • Author(s)
      勝又友輝, 竹下昌志, ジェプカラファウ, 荒木健治
    • Organizer
      言語処理学会
    • Related Report
      2021 Annual Research Report
  • [Presentation] Current Language Models Might Not Be Suitable For Reverse Engineering Moral Wisdom of Crowds2021

    • Author(s)
      Rafal Rzepka, Yuki Katsumata, Kenji Araki
    • Organizer
      Engineering and Reverse-Engineering Morality Workshop at CogSci 2021
    • Related Report
      2021 Annual Research Report
    • Int'l Joint Research
  • [Presentation] “Language Model-based Context Augmentation for World Knowledge Bases”2020

    • Author(s)
      Rafal Rzepka, Sho Takishita and Kenji Araki
    • Organizer
      Proceedings The 34th Annual Conference of the Japanese Society for Artificial Intelligence, 2D6-OS-18c-03
    • Related Report
      2020 Research-status Report
  • [Presentation] “Cost-Friendly Feature-based Approach for Paraphrase Identification”2020

    • Author(s)
      Liu Xiaodong, Rzepka Rafal and Araki Kenji
    • Organizer
      音声言語および自然言語処理シンポジウム
    • Related Report
      2020 Research-status Report
  • [Presentation] Bacteria Lingualis on BERToids - Concept Expansion for Cognitive Architectures2020

    • Author(s)
      Rafal Rzepka, Sho Takishita and Kenji Araki
    • Organizer
      Technical Report of JSAI Special Interest Group for Artificial General Intelligence, SIG-AGI
    • Related Report
      2019 Research-status Report
  • [Presentation] Convolutional Neural Network for Chinese Sentiment Analysis Considering Chinese Slang Lexicon and Emoticons2019

    • Author(s)
      Da Li, Rafal Rzepka, Michal Ptaszynski and Kenji Araki
    • Organizer
      Proceedings The 33th Annual Conference of the Japanese Society for Artificial Intelligence
    • Related Report
      2019 Research-status Report
  • [Presentation] Comparing Conceptual Metaphor Theory-Related Features in Searching for Figurative Expressions in Japanese Literary Texts2019

    • Author(s)
      Mateusz Babieno, Rafal Rzepka and Kenji Araki
    • Organizer
      IJCAI Workshop on Language Sense on Computer
    • Related Report
      2019 Research-status Report
    • Int'l Joint Research
  • [Presentation] A Convolutional Neural Network For Ranking Advice Quality In Texts For A Motivational Dialogue System2019

    • Author(s)
      Patrycja Swieczkowska, Rafal Rzepka and Kenji Araki
    • Organizer
      IJCAI Workshop on Linguistic and Cognitive Approaches To Dialog Agents Workshop
    • Related Report
      2019 Research-status Report
    • Int'l Joint Research
  • [Presentation] Debate Outcome Prediction using Automatic Persuasiveness Evaluation and Counterargument Relations2019

    • Author(s)
      Daiki Shirafuji, Rafal Rzepka and Kenji Araki
    • Organizer
      IJCAI Workshop on Linguistic and Cognitive Approaches To Dialog Agents Workshop
    • Related Report
      2019 Research-status Report
    • Int'l Joint Research
  • [Presentation] Emoji-Aware Attention-based Bi-directional GRU Network Model for Chinese Sentiment Analysis2019

    • Author(s)
      Da Li, Rafal Rzepka, Michal Ptaszynski and Kenji Araki
    • Organizer
      IJCAI Workshop on Linguistic and Cognitive Approaches To Dialog Agents Workshop
    • Related Report
      2019 Research-status Report
    • Int'l Joint Research
  • [Presentation] Implicit Knowledge Completion Using Relevance Calculation of Distributed Word Representations2019

    • Author(s)
      Sho Takishita, Rafal Rzepka and Kenji Araki
    • Organizer
      IJCAI Workshop on Bridging The Gap Between Human and Automated Reasoning
    • Related Report
      2019 Research-status Report
    • Int'l Joint Research
  • [Presentation] Evaluating Classification Methods for Recognizing Figurative Expressions Within Japanese Literary Texts2019

    • Author(s)
      Mateusz Babieno, Rafal Rzepka and Kenji Araki
    • Organizer
      Proceedings of the 16th International Conference of the Pacific Association for Computational Linguistics, PACLING 2019
    • Related Report
      2019 Research-status Report
    • Int'l Joint Research
  • [Presentation] Creating Reverse Dictionary of English Idiomatic Expressions by Mapping Word Embeddings to Singular Vectors2019

    • Author(s)
      Xiaodong Liu, Rafal Rzepka, Kenji Araki
    • Organizer
      Technical Report of JSAI Special Interest Group for Interactive Information Access and Visualization, SIG-AM
    • Related Report
      2019 Research-status Report
  • [Presentation] Humanizing Machines by Simulating Empathy and Understanding Human Needs"2019

    • Author(s)
      Rafal Rzepka
    • Organizer
      IJCAI Humanizing AI Workshop
    • Related Report
      2019 Research-status Report
    • Int'l Joint Research / Invited
  • [Presentation] AI Ethics for Developers, Users and Legislators - Problems and Solutions2019

    • Author(s)
      Rafal Rzepka
    • Organizer
      Nitobe School, Hokkaido University
    • Related Report
      2019 Research-status Report
    • Invited
  • [Presentation] 単語の分散表現を用いた日本語イベント連鎖の自動構築2019

    • Author(s)
      瀧下祥, Rafal Rzepka, 荒木健治
    • Organizer
      言語処理学会第25回年次大会(NLP2019)
    • Related Report
      2018 Research-status Report
  • [Presentation] Unicorn Story Generation and Limits of Words - On Perspectives of Automatic Tacit Knowledge Addition2019

    • Author(s)
      Rafal Rzepka, Sho Takishita and Kenji Araki
    • Organizer
      JSAI Special Interest Group for Artificial General Intelligence
    • Related Report
      2018 Research-status Report
  • [Presentation] Analyzing motivating texts for modelling human-like motivation techniques in emotionally intelligent dialogue systems2018

    • Author(s)
      Patrycja Swieczkowska, Rafal Rzepka and Kenji Araki
    • Organizer
      Biologically Inspired Cognitive Architectures (BICA 2018) Proceedings, Springer Series on Advances in Intelligent Systems and Computing
    • Related Report
      2018 Research-status Report
    • Int'l Joint Research
  • [Presentation] Emoticon-Aware Recurrent Neural Network Model for Chinese Sentiment Analysis2018

    • Author(s)
      Da Li, Rafal Rzepka, Michal Ptaszynski and Kenji Araki
    • Organizer
      Proceedings of The Ninth IEEE International Conference on Awareness Science and Technology
    • Related Report
      2018 Research-status Report
    • Int'l Joint Research
  • [Presentation] Machine Learning Approach Considering Chinese Slang Lexicon and Emoticons for Chinese Social Media Sentiment Analysis2018

    • Author(s)
      Da Li, Rafal Rzepka, Michal Ptaszynski, Kenji Araki
    • Organizer
      AAAI-19 Workshop on Affective Content Analysis
    • Related Report
      2018 Research-status Report
    • Int'l Joint Research
  • [Presentation] First Trials with Culture-Dependent Moral Commonsense Acquisition2018

    • Author(s)
      Rafal Rzepka, Da Li and Kenji Araki
    • Organizer
      The 32th Annual Conference of the Japanese Society for Artificial Intelligence
    • Related Report
      2018 Research-status Report
  • [Presentation] Preliminary Analysis of Weibo Emojis for Sentiment Analysis of Chinese Social Media2018

    • Author(s)
      Da Li, Rafal Rzepka and Kenji Araki
    • Organizer
      32th Annual Conference of the Japanese Society for Artificial Intelligence
    • Related Report
      2018 Research-status Report
  • [Presentation] Retrieving Metaphorical Sentences from Japanese Literature Using Standard Text Classification Methods2018

    • Author(s)
      Mateusz Babieno, Sho Takishita, Rafal Rzepka and Kenji Araki
    • Organizer
      人工知能学会第2種研究会 ことば工学研究会
    • Related Report
      2018 Research-status Report
  • [Presentation] 常識的知識の自動評価手法及び英日辞書を用いたConceptNetの拡張2018

    • Author(s)
      首藤聖矢,ジェプカ・ラファウ,荒木健治
    • Organizer
      ARG Web インテリジェンスとインタラクション研究会第13回研究会
    • Related Report
      2018 Research-status Report
  • [Presentation] Importance of Contextual Knowledge in Artificial Moral Agents Development2018

    • Author(s)
      Rafal Rzepka and Kenji Araki
    • Organizer
      AAAI 2018 Spring Symposium on AI and Society: Ethics, Safety and Trustworthiness in Intelligent Agents
    • Related Report
      2017 Research-status Report
    • Int'l Joint Research
  • [Presentation] Natural Language Processing for Predicting Everyday Behavior with and without Time and Duration Information2017

    • Author(s)
      Rafal Rzepka and Kenji Araki
    • Organizer
      Proceedings of International Symposium on Forecasting 2017
    • Related Report
      2017 Research-status Report
    • Int'l Joint Research
  • [Presentation] Conscious vs. Unaware Evaluation - Using Collective Intelligence for an Automatic Evaluation of Acts2017

    • Author(s)
      Rafal Rzepka and Kenji Araki
    • Organizer
      The 2nd international IJCAI workshop on evaluating general-purpose AI (EGPAI2017)
    • Related Report
      2017 Research-status Report
    • Int'l Joint Research
  • [Presentation] From Signals, through Words, to Safe Behavior - Value Alignment by Human Experience Analysis2017

    • Author(s)
      Rafal Rzepka
    • Organizer
      The 8th International Workshop on Signal Design and its Applications in Communications (IWSDA’17)
    • Related Report
      2017 Research-status Report
    • Int'l Joint Research / Invited

URL: 

Published: 2017-04-28   Modified: 2023-01-30  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi