2021 Fiscal Year Research-status Report
Search-Oriented Dialog System for Data Science
| Project/Area Number |
19K12132
|
|---|
| Research Institution | 大学共同利用機関法人情報・システム研究機構(機構本部施設等) |
|---|
Principal Investigator |
金 進東 大学共同利用機関法人情報・システム研究機構(機構本部施設等), データサイエンス共同利用基盤施設, 特任准教授 (40536893)
|
|---|
| Project Period (FY) |
2019-04-01 – 2023-03-31
|
| Keywords | dialog / intelligent agent / natural language query / database search / task-oriented dialog / intent detection |
|---|
| Outline of Annual Research Achievements |
The research on search-oriented dialog systems for data science has been conducted so far for 3 years. While the total research period was originally planned to be 3 years, due to the pandemic situation, it was extended to 4 years. The research schedule was also changed. For example, the plan for organizing an annotation campaign for intent annotation was cancelled. Instead a pseudo annotation for intent detection was developed through a semi-automatic way. Following is overall achievements we have made so far:
(1) The user interface for developing dialog corpora was developed based on two open-source systems, PubAnnotation and TextAE; (2) The corpus of search-oriented dialogs was developed; (3) Annotation guidelines for intent annotation was developed; (4) Pseudo annotation for dialog intent detection was developed in a semi-automatic way; (5) intent detection system was developed by fine tuning the Transformer pre-trained language model; and (6) A prototype system of Search-Oriented dialog was developed.
In the last year of the project, (1) the pseudo annotation for dialog intent detection will get verified by human users, (2) A thorough evaluation on the search-oriented dialog system will be conducted, and (3) papers will be published based on the outcomes of the research.
|
| Current Status of Research Progress |
Current Status of Research Progress
2: Research has progressed on the whole more than it was originally planned.
Reason
Due to the pandemic situation the original schedule of the research has been changed substantially. However, thanks to the one-year extension which was generously granted by JSPS, the research is now in the stage of finalization.
|
| Strategy for Future Research Activity |
In the last year of the project, (1) the pseudo annotation for dialog intent detection will get verified by human users; (2) A thorough evaluation on the search-oriented dialog system will be conducted; and (3) papers will be published based on the outcomes of the research.
As the pandemic situation is still on-going, the user verification will be conducted using a crowd-sourcing platform. For paper publication, we are considering ACL and AAAI as prospective venues.
|
| Causes of Carryover |
Due to the pandemic situation, the two tasks, (1) the annotation of search intents to the dialog corpus, and (2) the user evaluation of the search-oriented dialog system, which were originally planned to be organized in the year R3, are delayed to happen in the year R4. Accordingly, we need funding for purchasing necessary devices, and for compensating the human labor for the annotation and the evaluation jobs. Also, need funding for preparing various hardware devices to be used for presentation, as well as for publication of the output of the research, e.g., conference registration and article processing fee.
|
Research Products
(1 results)
