| 研究課題/領域番号 |
19K12132
|
|---|
| 研究機関 | 大学共同利用機関法人情報・システム研究機構(機構本部施設等) |
|---|
研究代表者 |
金 進東 大学共同利用機関法人情報・システム研究機構(機構本部施設等), データサイエンス共同利用基盤施設, 特任准教授 (40536893)
|
|---|
| 研究期間 (年度) |
2019-04-01 – 2024-03-31
|
| キーワード | dialog / intelligent agent / natural language query / database search / task-oriented dialog / intent detection |
|---|
| 研究実績の概要 |
In R4, a thorough evaluation on the search-oriented dialog system was conducted, which revealed several problems in the intent detection system. We conducted research to solve the problems, and found that they could be effectively solved by utilizing few-shot learning with InstructGPT. During the research, we realized that the state-of-the-art of pre-trained language models were rapidly evolving, which we needed to be able to constantly leverage. We made a change to the architecture of the search-oriented dialog system, so that we can easily incorporate external language resources like pre-trained language models. With the new architecture, we could utilize recently released pre-trained language models, including chatGPT and GPT4, which led to much improved performance.
|
| 現在までの達成度 (区分) |
現在までの達成度 (区分)
2: おおむね順調に進展している
理由
Due to the pandemic situation the original schedule of the research has been changed substantially. Also, due to problems found during a thorough evaluation of the system, the architecture of the system had to be changed. However, thanks to the extension of the research period which was generously granted by JSPS, solutions to the problems could be found, and the research is approaching to finalization.
|
| 今後の研究の推進方策 |
In R5, which is the last year of the project, (1) another round of human evaluation will be conducted; (2) thorough analysis of the evaluation results will be performed, and (3) papers will be published on the results. We are also planning to make the search-oriented dialog system available as a plugin for chatGPT, as a way of inseminating the result of the research.
|
| 次年度使用額が生じた理由 |
For R5, we are planning to conduct a round of thorough human evaluation of the search oriented dialog system, and we need funding for purchasing necessary devices, and for compensating the human labor for the annotation and the evaluation jobs. Also, we need funding for preparing various hardware devices to be used for presentation, as well as for publication of the output of the research, e.g., conference registration and article processing fee. We are also planning to outsourcing part of the development of the software, for which we also need some funding.
|
