Development of advanced inference technologies for huge knowledge graphs in tensor spaces

• Project/Area Number: 18H03288
• Research Category: Grant-in-Aid for Scientific Research (B)
• Allocation Type: Single-year Grants
• Section: 一般
• Review Section: Basic Section 61030:Intelligent informatics-related
• Research Institution: Wakayama University
• Principal Investigator: Sakama Chiaki 和歌山大学, システム工学部, 教授 (20273873)
• Co-Investigator(Kenkyū-buntansha): 井上 克巳 国立情報学研究所, 情報学プリンシプル研究系, 教授 (10252321) ; 林 克彦 東京大学, 大学院情報理工学系研究科, 助教 (50725794)
• Project Period (FY): 2018-04-01 – 2022-03-31
• Project Status: Completed (Fiscal Year 2022)
• Budget Amount: ¥17,030,000 (Direct Cost: ¥13,100,000、Indirect Cost: ¥3,930,000); Fiscal Year 2021: ¥3,900,000 (Direct Cost: ¥3,000,000、Indirect Cost: ¥900,000); Fiscal Year 2020: ¥4,160,000 (Direct Cost: ¥3,200,000、Indirect Cost: ¥960,000); Fiscal Year 2019: ¥4,030,000 (Direct Cost: ¥3,100,000、Indirect Cost: ¥930,000); Fiscal Year 2018: ¥4,940,000 (Direct Cost: ¥3,800,000、Indirect Cost: ¥1,140,000)
• Keywords: テンソル空間 / 線形代数計算 / 論理プログラミング / 演繹推論 / デフォルト推論 / アブダクション / 論理推論 / スパース行列 / 部分計算 / 知識グラフ / 高次推論 / 近似計算 / 人工知能 / 量子化

Outline of Final Research Achievements

In this study, we proposed a new efficient computation method for advanced reasoning in artificial intelligence on a large-scale knowledge base such as a knowledge graph, which is different from conventional theorem proving methods. More precisely, we developed a theory for converting a knowledge base represented as a logic program into an algebraic representation in tensor space, and computing deductive inference, default inference, and abduction using linear algebra. Next we implemented the system and conducted experimental evaluations using both artificial and real data. Furthermore, we developed optimization techniques for computational speed-up and confirmed their effectiveness in experimental verification. The proposed method has the potential to dramatically improve the scalability of symbolic reasoning through parallel algebraic computation using GPUs.

Academic Significance and Societal Importance of the Research Achievements

ニューラルネットワーク(NN)による機械学習の結果に説明可能性を与え信頼性を向上させるための手法として、NNと記号処理を融合したニューロシンボリックAIが提案されている。しかし、従来の記号処理計算を大規模データに適用する場合、計算効率がボトルネックとなる問題があった。本研究で提案したテンソル空間における高次推論技術は、NNで扱われているような高次元のベクトル表現されたデータを使った推論を線形代数的に計算することを可能にする。その学術的意義は、大規模データからのスケーラブルで高速な推論を実現するための新しい計算技術の提案であり、社会的意義はNNと記号処理の融合に向けた要素技術としての貢献である。

Research Products

• [Int'l Joint Research] University of Information Technology/Vietnam National University(ベトナム)
• [Int'l Joint Research] University of Information Technology(ベトナム)
• [Int'l Joint Research] University of Information Technology(ベトナム)
• [Journal Article] Enhancing linear algebraic computation of logic programs using sparse representation (2021)
  • Author(s): Nguyen Tuan Quoc, Katsumi Inoue, Chiaki Sakama
  • Journal Title: New Generation Computing Volume: - Issue: 1 Pages: 225-254
  • DOI: 10.1007/s00354-021-00142-2
  • Peer Reviewed / Open Access / Int'l Joint Research
• [Journal Article] Logic programming in tensor spaces (2021)
  • Author(s): Chiaki Sakama, Katsumi Inoue, Taisuke Sato
  • Journal Title: Annals of Mathematics and AI Volume: 89 Issue: 12 Pages: 1133-1153
  • DOI: 10.1007/s10472-021-09767-x
  • Peer Reviewed
• [Journal Article] An efficient reasoning method on logic programming using partial evaluation in vector spaces (2021)
  • Author(s): Hien D Nguyen, Chiaki Sakama, Taisuke Sato, Katsumi Inoue
  • Journal Title: Journal of Logic and Compuation Volume: 31 Issue: 5 Pages: 1298-1316
  • DOI: 10.1093/logcom/exab010
  • Peer Reviewed / Int'l Joint Research
• [Journal Article] Binarized Embeddings for Fast, Space-Efficient Knowledge Graph Completion (2021)
  • Author(s): Katsuhiko Hayashi、Koki Kishimoto、Masashi Shimbo
  • Journal Title: IEEE Transactions on Knowledge and Data Engineering Volume: -- Pages: 1-13
  • DOI: 10.1109/tkde.2021.3075070
  • Peer Reviewed / Open Access
• [Journal Article] From 3-Valued Semantics to Supported Model Computation for Logic Programs in Vector Spaces (2020)
  • Author(s): Taisuke Sato, Chiaki Sakama, Katsumi Inoue
  • Journal Title: Proceedings of the 12th International Conference on Agents and Artificial Intelligence (ICAART 2020) Volume: 2 Pages: 758-765
  • DOI: 10.5220/0009093407580765
  • Peer Reviewed / Open Access
• [Journal Article] Disjunctive Abduction (2019)
  • Author(s): Katsumi Inoue, Chiaki Sakama
  • Journal Title: New Generation Computing Volume: 37(2) Issue: 2 Pages: 219-243
  • DOI: 10.1007/s00354-019-00059-x
  • Peer Reviewed
• [Journal Article] Binarized Knowledge Graph Embeddings (2019)
  • Author(s): Koki Kishimoto, Katsuhiko Hayashi, Genki Akai, Masashi Shimbo, Kazunori Komatani
  • Journal Title: Advances in Information Retrieval. ECIR 2019. Lecture Notes in Computer Science Volume: 11437 Pages: 181-196
  • DOI: 10.1007/978-3-030-15712-8_12
  • ISBN: 9783030157111, 9783030157128
  • Peer Reviewed
• [Journal Article] Computing Logic Programming Semantics in Linear Algebra (2018)
  • Author(s): Hien D. Nguyen, Chiaki Sakama, Taisuke Sato, Katsumi Inoue
  • Journal Title: In: Proceedings of the 12th International Conference on Multi-disciplinary Trends in Artificial Intelligence (MIWAI 2018), Lecture Notes in Computer Science Volume: 11248 Pages: 32-48
  • DOI: 10.1007/978-3-030-03014-8_3
  • ISBN: 9783030030131, 9783030030148
  • Peer Reviewed / Int'l Joint Research
• [Journal Article] Abducing Relations in Continuous Spaces (2018)
  • Author(s): Taisuke Sato, Katsumi Inoue, Chiaki Sakama
  • Journal Title: In: Proceedings of the 27th International Joint Conference on Artificial Intelligence (IJCAI 2018) Volume: 0 Pages: 1956-1962
  • DOI: 10.24963/ijcai.2018/270
  • Peer Reviewed / Open Access
• [Journal Article] Partial Evaluation of Logic Programs in Vector Spaces (2018)
  • Author(s): Chiaki Sakama, Hien D. Nguyen, Taisuke Sato, Katsumi Inoue
  • Journal Title: Proceedings of the 11th International Workshop on Answer Set Programming and Other Computing Paradigms (ASPOCP 2018), CoRR abs Volume: 1811.11435 Pages: 1-14
  • Peer Reviewed / Open Access / Int'l Joint Research
• [Presentation] Linear Algebraic Abduction with Partial Evaluation (2022)
  • Author(s): Nguyen Tuan Quoc, Katsumi Inoue, Chiaki Sakama
  • Organizer: 25th International Symposium on Practical Aspects of Declarative Languages (PADL 2023)
  • Int'l Joint Research
• [Presentation] Linear Algebraic Computation of Propositional Horn Abduction (2021)
  • Author(s): Tuan Nguyen Quoc, Katsumi Inoue, Chiaki Sakama
  • Organizer: IEEE 33rd International Conference on Tools with Artificial Intelligence (ICTAI)
  • Int'l Joint Research
• [Presentation] Logical inference as cost minimization in vector spaces (2020)
  • Author(s): Taisuke Sato, Ryosuke Kojima
  • Organizer: 4th International Workshop on Declarative Learning Based Programming
  • Int'l Joint Research
• [Presentation] Enhancing Linear Algebraic Computation of Logic Programs Using Sparse Representation (2020)
  • Author(s): Tuan Nguyen Quoc, Katsumi Inoue, Chiaki Sakama
  • Organizer: 36th International Conference on Logic Programming (ICLP)
  • Int'l Joint Research
• [Presentation] Logical inference as cost minimization in vector spaces (2020)
  • Author(s): Taisuke Sato, Ryosuke Kojima
  • Organizer: Fourth International Workshop on Declarative Learning Based Programming(DeLBP 2019)
  • Int'l Joint Research
• [Presentation] T-PRISM: A tensorized logic programming language for data modeling (2020)
  • Author(s): Ryosuke Kojima, Taisuke Sato
  • Organizer: 14th International Workshop on Neural-Symbolic Learning and Reasoning (NeSy'19)
  • Int'l Joint Research
• [Presentation] From 3-valued semantics to supported model computation for logic programs in vector spaces (2020)
  • Author(s): Taisuke Sato, Chiaki Sakama, Katsumi Inoue
  • Organizer: 12th International Conference on Agents and Artificial Intelligence (ICAART 2020)
  • Int'l Joint Research
• [Presentation] バイナリCP分解モデルのビット反転学習法 (2020)
  • Author(s): 林克彦、岸本広輝、新保仁
  • Organizer: 言語処理学会第26回年次大会
• [Presentation] Binarized Knowledge Graph Embeddings (2019)
  • Author(s): Koki Kishimoto, Katsuhiko Hayashi, Genki Akai, Masashi Shimbo, Kazunori Komatani
  • Organizer: 41st European Conference on Information Retrieval
  • Int'l Joint Research
• [Presentation] 知識グラフ埋め込みのための二値化CP分解 (2019)
  • Author(s): 岸本広輝, 林克彦, 赤井元紀, 新保仁, 駒谷和範
  • Organizer: 言語処理学会第25年次大会
• [Book] Handbook of Abductive Cognition (分担執筆) (2023)
  • Author(s): Lorenzo Magnani (ed.)
  • Total Pages: 1948
  • Publisher: Springer
  • ISBN: 9783031101342
• [Remarks] Reviewed Papers
  • URL: http://web.wakayama-u.ac.jp/~sakama/pub.html
• [Remarks]
  • URL: http://web.wakayama-u.ac.jp/~sakama/pub.html
• [Remarks]
  • URL: http://web.wakayama-u.ac.jp/~sakama
• [Remarks] Computing Logic Programming Semantics
  • URL: http://web.wakayama-u.ac.jp/~sakama/abst/miwai2018.html
• [Remarks] Partial Evaluation of Logic Programs
  • URL: http://web.wakayama-u.ac.jp/~sakama/abst/aspocp2018.html
• [Remarks] Abducing Relations in Continuous Spaces
  • URL: http://web.wakayama-u.ac.jp/~sakama/abst/ijcai2018.html