Development of advanced inference technologies for huge knowledge graphs in tensor spaces

• Project/Area Number: 18H03288
• Research Category: Grant-in-Aid for Scientific Research (B)
• Allocation Type: Single-year Grants
• Section: 一般
• Review Section: Basic Section 61030:Intelligent informatics-related
• Research Institution: Wakayama University
• Principal Investigator: 坂間 千秋 和歌山大学, システム工学部, 教授 (20273873)
• Co-Investigator(Kenkyū-buntansha): 井上 克巳 国立情報学研究所, 情報学プリンシプル研究系, 教授 (10252321) ; 林 克彦 東京大学, 大学院情報理工学系研究科, 助教 (50725794)
• Project Period (FY): 2018-04-01 – 2022-03-31
• Project Status: Granted (Fiscal Year 2021)
• Budget Amount: ¥17,030,000 (Direct Cost: ¥13,100,000、Indirect Cost: ¥3,930,000); Fiscal Year 2021: ¥3,900,000 (Direct Cost: ¥3,000,000、Indirect Cost: ¥900,000); Fiscal Year 2020: ¥4,160,000 (Direct Cost: ¥3,200,000、Indirect Cost: ¥960,000); Fiscal Year 2019: ¥4,030,000 (Direct Cost: ¥3,100,000、Indirect Cost: ¥930,000); Fiscal Year 2018: ¥4,940,000 (Direct Cost: ¥3,800,000、Indirect Cost: ¥1,140,000)
• Keywords: 知識グラフ / 高次推論 / テンソル空間 / 近似計算 / 人工知能 / 論理推論 / アブダクション / 量子化

Outline of Annual Research Achievements

本研究の目的は、人工知能における高次推論を知識グラフのような巨大知識ベースにおいて実現するための新しい計算手法を導入することである。研究3年目である2020年度は、(1)テンソル空間における論理推論の高速化と実装評価、(2)テンソル空間におけるアブダクションの効率的計算と実装評価、(3)知識グラフのテンソル分解モデルの自然言語処理応用の３つのサブテーマを設定して研究活動を行った。具体的成果は下記の通りである。

(1) ベクトル空間における論理推論高速化のためにスパース行列の技法を導入し、実験評価を行った。実験の結果、論理プログラムの最新のソルバーの一つである clingo を凌ぐ性能が得られた。
(2) アブダクションを行列計算を使って実現する枠組を開発し、実験評価を行った。実験の結果、提案手法は既存のアルゴリズムと同等もしくはそれ以上の性能を発揮し、並列計算への拡張可能性も確認できた。
(3) テンソル分解法を量子化し知識グラフを低次元のバイナリベクトル空間に埋め込む手法を開発した。この結果、低次元線形空間における高速推論が実現され、バイナリ埋め込みモデルが任意の知識グラフデータベースを再構成できることが保証された。
(4) 線形空間において論理推論の探索問題をコスト関数の極小化問題として捉え、アブダクションおよび確率推論をサンプリングに基づき計算する方式を導入し、実装評価した。

Current Status of Research Progress

2: Research has progressed on the whole more than it was originally planned.

Reason

2020年度は covid-19 の世界的蔓延により海外研究者との研究交流などに支障をきたしたが、国際会議や国際ジャーナルで複数の論文を発表することができ、概ね計画通りに進捗している。

Strategy for Future Research Activity

2021年度は研究計画最終年度であるため、これまでの成果をとりまとめると同時、後継プロジェクトへの発展可能性を検討する。

Research Products

• [Int'l Joint Research] University of Information Technology/Vietnam National University(ベトナム)
• [Int'l Joint Research] University of Information Technology(ベトナム)
• [Int'l Joint Research] University of Information Technology(ベトナム)
• [Journal Article] Logic programming in tensor spaces (2021)
  • Author(s): Chiaki Sakama, Katsumi Inoue, Taisuke Sato
  • Journal Title: Annals of Mathematics and AI Volume: 89 Pages: 1133-1153
  • DOI: 10.1007/s10472-021-09767-x
  • Peer Reviewed
• [Journal Article] An efficient reasoning method on logic programming using partial evaluation in vector spaces (2021)
  • Author(s): Hien D Nguyen, Chiaki Sakama, Taisuke Sato, Katsumi Inoue
  • Journal Title: Journal of Logic and Compuation Volume: 31 Pages: 1298-1316
  • DOI: 10.1093/logcom/exab010
  • Peer Reviewed / Int'l Joint Research
• [Journal Article] Enhancing linear algebraic computation of logic programs using sparse representation (2021)
  • Author(s): Nguyen Tuan Quoc, Katsumi Inoue, Chiaki Sakama
  • Journal Title: New Generation Computing Volume: -
  • DOI: 10.1007/s00354-021-00142-2
  • Peer Reviewed / Open Access / Int'l Joint Research
• [Journal Article] Binarized Embeddings for Fast, Space-Efficient Knowledge Graph Completion (2021)
  • Author(s): Katsuhiko Hayashi、Koki Kishimoto、Masashi Shimbo
  • Journal Title: IEEE Transactions on Knowledge and Data Engineering (TKDE) Volume: -- Pages: 1-13
  • DOI: 10.1109/tkde.2021.3075070
  • Peer Reviewed / Open Access
• [Journal Article] From 3-Valued Semantics to Supported Model Computation for Logic Programs in Vector Spaces (2020)
  • Author(s): Taisuke Sato, Chiaki Sakama, Katsumi Inoue
  • Journal Title: Proceedings of the 12th International Conference on Agents and Artificial Intelligence (ICAART 2020) Volume: 2 Pages: 758-765
  • DOI: 10.5220/0009093407580765
  • Peer Reviewed / Open Access
• [Journal Article] Disjunctive Abduction (2019)
  • Author(s): Katsumi Inoue, Chiaki Sakama
  • Journal Title: New Generation Computing Volume: 37(2) Pages: 219-243
  • DOI: 10.1007/s00354-019-00059-x
  • Peer Reviewed
• [Journal Article] Binarized Knowledge Graph Embeddings (2019)
  • Author(s): Koki Kishimoto, Katsuhiko Hayashi, Genki Akai, Masashi Shimbo, Kazunori Komatani
  • Journal Title: Advances in Information Retrieval. ECIR 2019. Lecture Notes in Computer Science Volume: 11437 Pages: 181-196
  • DOI: 10.1007/978-3-030-15712-8_12
  • Peer Reviewed
• [Journal Article] Computing Logic Programming Semantics in Linear Algebra (2018)
  • Author(s): Hien D. Nguyen, Chiaki Sakama, Taisuke Sato, Katsumi Inoue
  • Journal Title: Lecture Notes in Artificial Intelligence Volume: 11248 Pages: 32-48
  • DOI: 10.1007/978-3-030-03014-8_3
  • Peer Reviewed / Int'l Joint Research
• [Journal Article] Abducing Relations in Continuous Spaces (2018)
  • Author(s): Taisuke Sato, Katsumi Inoue, Chiaki Sakama
  • Journal Title: Proceedings of the 27th International Joint Conference on Artificial Intelligence (IJCAI 2018) Volume: 0 Pages: 1956-1962
  • DOI: 10.24963/ijcai.2018/270
  • Peer Reviewed / Open Access
• [Journal Article] Partial Evaluation of Logic Programs in Vector Spaces (2018)
  • Author(s): Chiaki Sakama, Hien D. Nguyen, Taisuke Sato, Katsumi Inoue
  • Journal Title: Proceedings of the 11th International Workshop on Answer Set Programming and Other Computing Paradigms (ASPOCP 2018), CoRR abs Volume: 1811.11435 Pages: 1-14
  • Peer Reviewed / Open Access / Int'l Joint Research
• [Presentation] Linear Algebraic Computation of Propositional Horn Abduction (2021)
  • Author(s): Tuan Nguyen Quoc, Katsumi Inoue, Chiaki Sakama
  • Organizer: IEEE 33rd International Conference on Tools with Artificial Intelligence (ICTAI)
  • Int'l Joint Research
• [Presentation] Logical inference as cost minimization in vector spaces (2020)
  • Author(s): Taisuke Sato, Ryosuke Kojima
  • Organizer: 4th International Workshop on Declarative Learning Based Programming
  • Int'l Joint Research
• [Presentation] Enhancing Linear Algebraic Computation of Logic Programs Using Sparse Representation (2020)
  • Author(s): Tuan Nguyen Quoc, Katsumi Inoue, Chiaki Sakama
  • Organizer: 36th International Conference on Logic Programming (ICLP)
  • Int'l Joint Research
• [Presentation] Logical inference as cost minimization in vector spaces (2020)
  • Author(s): Taisuke Sato, Ryosuke Kojima
  • Organizer: Fourth International Workshop on Declarative Learning Based Programming(DeLBP 2019)
  • Int'l Joint Research
• [Presentation] T-PRISM: A tensorized logic programming language for data modeling (2020)
  • Author(s): Ryosuke Kojima, Taisuke Sato
  • Organizer: 14th International Workshop on Neural-Symbolic Learning and Reasoning (NeSy'19)
  • Int'l Joint Research
• [Presentation] From 3-valued semantics to supported model computation for logic programs in vector spaces (2020)
  • Author(s): Taisuke Sato, Chiaki Sakama, Katsumi Inoue
  • Organizer: 12th International Conference on Agents and Artificial Intelligence (ICAART 2020)
  • Int'l Joint Research
• [Presentation] バイナリCP分解モデルのビット反転学習法 (2020)
  • Author(s): 林克彦、岸本広輝、新保仁
  • Organizer: 言語処理学会第26回年次大会
• [Presentation] Binarized Knowledge Graph Embeddings (2019)
  • Author(s): Koki Kishimoto, Katsuhiko Hayashi, Genki Akai, Masashi Shimbo, Kazunori Komatani
  • Organizer: 41st European Conference on Information Retrieval
  • Int'l Joint Research
• [Presentation] 知識グラフ埋め込みのための二値化CP分解 (2019)
  • Author(s): 岸本広輝, 林克彦, 赤井元紀, 新保仁, 駒谷和範
  • Organizer: 言語処理学会第25年次大会
• [Remarks]
  • URL: http://web.wakayama-u.ac.jp/~sakama/pub.html
• [Remarks]
  • URL: http://web.wakayama-u.ac.jp/~sakama
• [Remarks] Computing Logic Programming Semantics
  • URL: http://web.wakayama-u.ac.jp/~sakama/abst/miwai2018.html
• [Remarks] Partial Evaluation of Logic Programs
  • URL: http://web.wakayama-u.ac.jp/~sakama/abst/aspocp2018.html
• [Remarks] Abducing Relations in Continuous Spaces
  • URL: http://web.wakayama-u.ac.jp/~sakama/abst/ijcai2018.html