• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

A scalable privacy-preserving information retrieval system based on federated optimization, on-device intelligence and semantic matching

Research Project

Project/Area Number 19H04215
Research Category

Grant-in-Aid for Scientific Research (B)

Allocation TypeSingle-year Grants
Section一般
Review Section Basic Section 62020:Web informatics and service informatics-related
Research InstitutionUniversity of Tsukuba

Principal Investigator

Yu Haitao  筑波大学, 図書館情報メディア系, 准教授 (30751052)

Co-Investigator(Kenkyū-buntansha) 吉川 正俊  大阪成蹊大学, データサイエンス学部, 教授 (30182736)
康 シン  徳島大学, 大学院社会産業理工学研究部(理工学域), 助教 (80777350)
Adam Jatowt  京都大学, 情報学研究科, 特定准教授 (00415861)
Project Period (FY) 2019-04-01 – 2024-03-31
Project Status Completed (Fiscal Year 2023)
Budget Amount *help
¥15,860,000 (Direct Cost: ¥12,200,000、Indirect Cost: ¥3,660,000)
Fiscal Year 2023: ¥2,990,000 (Direct Cost: ¥2,300,000、Indirect Cost: ¥690,000)
Fiscal Year 2022: ¥2,730,000 (Direct Cost: ¥2,100,000、Indirect Cost: ¥630,000)
Fiscal Year 2021: ¥2,340,000 (Direct Cost: ¥1,800,000、Indirect Cost: ¥540,000)
Fiscal Year 2020: ¥3,640,000 (Direct Cost: ¥2,800,000、Indirect Cost: ¥840,000)
Fiscal Year 2019: ¥4,160,000 (Direct Cost: ¥3,200,000、Indirect Cost: ¥960,000)
KeywordsFederated Learning / Large Language Model / Conversational IR / Generative IR / Personalization / On-device Learning / User Modeling / Neural Tree Ensemble / Neural Tree Ensembles / privacy-preserving / federated learning / semantic matching / online learning-to-rank / interactive search / on-device learning / Metric Optimization / Policy Gradient / Differential Privacy / Privacy-preserving IR / Federated Optimization / policy gradient / learning to rank / probabilistic regression / Semantic Matching / Learning-To-Rank / Metric Optimisation / Privacy-preserving / Semantic matching / Federated learning / On-device intelligence
Outline of Research at the Start

This project aims to initiate research into privacy-preserving information retrieval (IR) and develop a scalable privacy-preserving IR system. The proposed IR system builds upon a federated paradigm which fuses on-device machine learning, federated optimization and semantic matching.

Outline of Final Research Achievements

This project aims to initiate research into privacy-preserving information retrieval (IR). Throughout the lifetime of this project, we made remarkable achievements via the following main aspects: novel ways of combining federated learning and differential privacy for privacy-preserving information access, direct optimization of evaluation metrics, effective integration of LLMs for result re-ranking, incorporating personalized context for conversational information seeking. As a result, we published more than 20 conference papers and 10 journal papers. Moreover, we are also maintaining an open-source project for IR named as PTRanking, which includes many representative ranking methods based on neural networks. Overall, it is reasonable to say that the successful accomplishment of this project will bring new insights into the development of privacy-preserving IR techniques.

Academic Significance and Societal Importance of the Research Achievements

Our research achievements would deepen the understanding of privacy-preserving information seeking that goes beyond information retrieval (IR). By releasing the source codes and collections, we encourage the entire IR community to improve the research of privacy-preserving IR towards new stages.

Report

(6 results)
  • 2023 Annual Research Report   Final Research Report ( PDF )
  • 2022 Annual Research Report
  • 2021 Annual Research Report
  • 2020 Annual Research Report
  • 2019 Annual Research Report
  • Research Products

    (42 results)

All 2024 2023 2022 2021 2020 2019 Other

All Int'l Joint Research (3 results) Journal Article (8 results) (of which Int'l Joint Research: 5 results,  Peer Reviewed: 8 results,  Open Access: 2 results) Presentation (27 results) (of which Int'l Joint Research: 20 results) Remarks (4 results)

  • [Int'l Joint Research] University of Innsbruck(オーストリア)

    • Related Report
      2022 Annual Research Report
  • [Int'l Joint Research] Dalian University of Technology(中国)

    • Related Report
      2021 Annual Research Report
  • [Int'l Joint Research] University of Innsbruck(オーストリア)

    • Related Report
      2021 Annual Research Report
  • [Journal Article] TAM-SenticNet: A Neuro-Symbolic AI Approach for Early Depression Detection via Social Media Analysis2024

    • Author(s)
      Rongyu Dou, Xin Kang
    • Journal Title

      Computers and Electrical Engineering

      Volume: 114 Pages: 1-10

    • DOI

      10.1016/j.compeleceng.2023.109071

    • Related Report
      2023 Annual Research Report
    • Peer Reviewed
  • [Journal Article] Prompt Consistency for Multi-Label Textual Emotion Detection2024

    • Author(s)
      Yangyang Zhou, Xin Kang, Fuji Ren
    • Journal Title

      IEEE Transactions on Affective Computing

      Volume: 15 Issue: 1 Pages: 121-129

    • DOI

      10.1109/taffc.2023.3254883

    • Related Report
      2023 Annual Research Report
    • Peer Reviewed / Int'l Joint Research
  • [Journal Article] Combining Spiking Neural Networks with Artificial Neural Networks for Enhanced Image Classification2023

    • Author(s)
      MURAMATSU Naoya、YU Hai-Tao、SATOH Tetsuji
    • Journal Title

      IEICE Transactions on Information and Systems

      Volume: E106.D Issue: 2 Pages: 252-261

    • DOI

      10.1587/transinf.2021EDP7237

    • ISSN
      0916-8532, 1745-1361
    • Year and Date
      2023-02-01
    • Related Report
      2022 Annual Research Report
    • Peer Reviewed
  • [Journal Article] Neuro or Symbolic? Fine-tuned Transformer with Unsupervised LDA Topic Clustering for Text Sentiment Analysis2023

    • Author(s)
      Fei Ding, Xin Kang, Satoshi Nakagawa, Fuji Ren
    • Journal Title

      IEEE Transactions on Affective Computing

      Volume: 15 Issue: 2 Pages: 1-15

    • DOI

      10.1109/taffc.2023.3279318

    • Related Report
      2023 Annual Research Report
    • Peer Reviewed / Int'l Joint Research
  • [Journal Article] Secure Shapley Value for Cross-Silo Federated Learning2023

    • Author(s)
      Shuyuan Zheng, Yang Cao, and Masatoshi Yoshikawa
    • Journal Title

      Proceedings of the VLDB Endowment

      Volume: 16 Issue: 7 Pages: 1657-1670

    • DOI

      10.14778/3587136.3587141

    • Related Report
      2023 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] An in-depth study on adversarial learning-to-rank2023

    • Author(s)
      Yu Hai-Tao、Piryani Rajesh、Jatowt Adam、Inagaki Ryo、Joho Hideo、Kim Kyoung-Sook
    • Journal Title

      Information Retrieval Journal

      Volume: 26 Issue: 1-2

    • DOI

      10.1007/s10791-023-09419-0

    • Related Report
      2022 Annual Research Report
    • Peer Reviewed / Int'l Joint Research
  • [Journal Article] Diagnostic Evaluation of Policy-Gradient-Based Ranking2022

    • Author(s)
      Hai-Tao Yu; Degen Huang; Fuji Ren; Lishuang Li
    • Journal Title

      Electronics

      Volume: 11 Issue: 1 Pages: 37-37

    • DOI

      10.3390/electronics11010037

    • Related Report
      2021 Annual Research Report
    • Peer Reviewed / Open Access / Int'l Joint Research
  • [Journal Article] Active learning with complementary sampling for instructing class-biased multi-label text emotion classification2020

    • Author(s)
      Kang Xin、Shi Xuefeng、Wu Yunong、Ren Fuji
    • Journal Title

      IEEE Transactions on Affective Computing

      Volume: - Issue: 1 Pages: 1-1

    • DOI

      10.1109/taffc.2020.3038401

    • Related Report
      2022 Annual Research Report 2020 Annual Research Report
    • Peer Reviewed / Int'l Joint Research
  • [Presentation] An In-Depth Comparison of Neural and Probabilistic Tree Models for Learning-to-rank2024

    • Author(s)
      Haonan Tan, Kaiyu Yang, Haitao Yu
    • Organizer
      Advances in Information Retrieval, ECIR 2024
    • Related Report
      2023 Annual Research Report
    • Int'l Joint Research
  • [Presentation] University of Tsukuba Team at the TREC 2023 Interactive Knowledge Assistance Track2023

    • Author(s)
      Lingzhen Zheng; Kaiyu Yang; Hai-Tao Yu; Sumio Fujita; Hideo Joho
    • Organizer
      The Thirty-Second Text REtrieval Conference (TREC 2023)
    • Related Report
      2023 Annual Research Report
    • Int'l Joint Research
  • [Presentation] University of Tsukuba Team at the TREC 2023 Deep Learning Track2023

    • Author(s)
      Kaiyu Yang; Lingzhen Zheng; Hai-Tao Yu; Sumio Fujita; Hideo Joho
    • Organizer
      The Thirty-Second Text REtrieval Conference (TREC 2023)
    • Related Report
      2023 Annual Research Report
    • Int'l Joint Research
  • [Presentation] TUA1 at NTCIR-17 FinArg-1 Task2023

    • Author(s)
      Yamane Daichi, Xin Kang
    • Organizer
      The 17th NTCIR Conference on Evaluation of Information Access Technologies (NTCIR-17)
    • Related Report
      2023 Annual Research Report
    • Int'l Joint Research
  • [Presentation] DEU-Net: Dual Encoder U-Net for 3D Medical Image Segmentation2023

    • Author(s)
      Yuxiang Zhou, Xin Kang, Fuji Ren, Satoshi Nakagawa, Xiao Shan
    • Organizer
      The 22nd International Conference on Computer and Information Technology (CIT 2023)
    • Related Report
      2023 Annual Research Report
    • Int'l Joint Research
  • [Presentation] General or Specific? Investigating Effective Privacy Protection in Federated Learning for Speech Emotion Recognition2023

    • Author(s)
      Chao Tan, Yang Cao, Sheng Li, Masatoshi Yoshikawa
    • Organizer
      2023 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP)
    • Related Report
      2023 Annual Research Report
    • Int'l Joint Research
  • [Presentation] BiTimeBERT: Extending Pre-Trained Language Representations with Bi-Temporal Information2023

    • Author(s)
      Jiexin Wang, Adam Jatowt, Masatoshi Yoshikawa, Yi Cai
    • Organizer
      The 46th International ACM SIGIR Conference on Research and Development in Information Retrieval
    • Related Report
      2023 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Semantic Modelling of Document Focus-Time for Temporal Information Retrieval2022

    • Author(s)
      Lirong Zhang、Hideo Joho、Hai-Tao Yu
    • Organizer
      The 12th International Workshop on Temporal Web Analytics (TempWeb)
    • Related Report
      2022 Annual Research Report
    • Int'l Joint Research
  • [Presentation] TUA1 at eRisk 2022: Exploring Affective Memories for Early Detection of Depression2022

    • Author(s)
      Xin Kang、Rongyu Dou、Haitao Yu
    • Organizer
      The Thirteenth Conference and Labs of the Evaluation Forum (CLEF 2022)
    • Related Report
      2022 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Selectively Expanding Queries and Documents for News Background Linking2022

    • Author(s)
      Lirong Zhang、Hideo Joho、Hai-Tao Yu
    • Organizer
      The 31st ACM International Conference on Information and Knowledge Management (CIKM2022)
    • Related Report
      2022 Annual Research Report
    • Int'l Joint Research
  • [Presentation] FL-Market: Trading Private Models in Federated Learning2022

    • Author(s)
      Shuyuan Zheng, Yang Cao, Masatoshi Yoshikawa, Huizhong Li, Qiang Yan
    • Organizer
      2022 IEEE International Conference on Big Data (Big Data)
    • Related Report
      2022 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Optimize What You EvaluateWith: Search Result Diversification Based on Metric Optimization2022

    • Author(s)
      Hai-Tao Yu
    • Organizer
      The 36th AAAI Conference on Artificial Intelligence
    • Related Report
      2021 Annual Research Report
    • Int'l Joint Research
  • [Presentation] TUA1 at the NTCIR-16 DialEval-2 Task2022

    • Author(s)
      F Ding, Xin Kang, Yunong Wu, Fuji Ren
    • Organizer
      The 16th NTCIR Conference on Evaluation of Information Access Technologies
    • Related Report
      2021 Annual Research Report
  • [Presentation] Event Occurrence Date Estimation based on Multivariate Time Series Analysis over Temporal Document Collections2021

    • Author(s)
      Jiexin Wang, Adam Jatowt, Masatoshi Yoshikawa
    • Organizer
      The 44th International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR)
    • Related Report
      2021 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Preventing Manipulation Attack in Local Differential Privacy using Verifiable Randomization Mechanism2021

    • Author(s)
      Fumiyuki Kato, Yang Cao, Masatoshi Yoshikawa
    • Organizer
      The IFIP Annual Conference on Data and Applications Security and Privacy
    • Related Report
      2021 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Prediction and Generation of Multiple Complex Drawing Figures From Partial Drawing Sequences2021

    • Author(s)
      Yusuke Kubono, Xin Kang, Fuji Ren, Shun Nishide
    • Organizer
      The IEEE 13th International Conference on Humanoid, Nanotechnology, Information Technology, Communication and Control, Environment, and Management (HNICEM)
    • Related Report
      2021 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Combining Spiking Neural Network and Artificial Neural Network for Enhanced Image Classification2021

    • Author(s)
      Naoya Muramatsu, Hai-Tao Yu
    • Organizer
      第13回データ工学と情報マネジメントに関するフォーラム
    • Related Report
      2020 Annual Research Report
  • [Presentation] Neural Learning-to-Rank2021

    • Author(s)
      Hai-Tao Yu
    • Organizer
      言語処理学会第27回年次大会ワークショップ: クリエイティブAIが会話型AIと出会うとき
    • Related Report
      2020 Annual Research Report
  • [Presentation] FLAME: Differentially Private Federated Learning in the Shuffle Model2021

    • Author(s)
      Ruixuan, Liu and Yang Cao and Hong, Chen and Ruoyang, Guo and Masatoshi, Yoshikawa
    • Organizer
      The Thirty-Fifth AAAI Conference on Artificial Intelligence (AAAI-21)
    • Related Report
      2020 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Deep Metric Learning Based on Rank-sensitive Optimization of Top-k Precision2020

    • Author(s)
      Muramoto Naoki, Hai-Tao Yu
    • Organizer
      Proceedings of the 29th ACM International Conference on Information and Knowledge Management (CIKM)
    • Related Report
      2020 Annual Research Report
    • Int'l Joint Research
  • [Presentation] FedSel: Federated SGD Under Local Differential Privacy with Top-k Dimension Selection2020

    • Author(s)
      Ruixuan, Liu and Yang Cao and Masatoshi, Yoshikawa and Hong, Chen
    • Organizer
      Database Systems for Advanced Applications (DASFAA 2020)
    • Related Report
      2020 Annual Research Report
    • Int'l Joint Research
  • [Presentation] ロボット教師における特定分野のQAシステムの構築2020

    • Author(s)
      門田 尚之, 康 シン, 西出 俊, 任 福継
    • Organizer
      2020年電子情報通信学会総合大会
    • Related Report
      2019 Annual Research Report
  • [Presentation] ロボット教師における特定人物の音声の自動生成2020

    • Author(s)
      寺尾 渉吾, 康 シン, 西出 俊, 任 福継
    • Organizer
      2020年電子情報通信学会総合大会
    • Related Report
      2019 Annual Research Report
  • [Presentation] 単語の感情属性を活かしたロボット教師の表情生成2020

    • Author(s)
      房登 淳平, 康 シン, 西出 俊, 任 福継
    • Organizer
      2020年電子情報通信学会総合大会
    • Related Report
      2019 Annual Research Report
  • [Presentation] ロボット教師による特定分野の記述式問題の判定について2020

    • Author(s)
      山崎 直登, 康 シン, 西出 俊, 任 福継
    • Organizer
      2020年電子情報通信学会総合大会
    • Related Report
      2019 Annual Research Report
  • [Presentation] TUA1 at the TREC 2019: Deep Learning Track2019

    • Author(s)
      Yun Gao, Hai-Tao Yu, Xin Kang, Fuji Ren
    • Organizer
      Proceedings of the 28th Text Retrieval Conference
    • Related Report
      2019 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Large Scale Analysis of Semantic and Temporal Aspects in Cultural Heritage Collection's Search2019

    • Author(s)
      Yasunobu Sumikawa, Adam Jatowt, Antoine Doucet, Jean-Philippe Moreux
    • Organizer
      Proceedings of the 19th ACM/IEEE-CS Joint Conference on Digital Libraries (JCDL 2019)
    • Related Report
      2019 Annual Research Report
    • Int'l Joint Research
  • [Remarks] Learning-to-Rank in PyTorch

    • URL

      https://wildltr.github.io/ptranking/

    • Related Report
      2023 Annual Research Report 2022 Annual Research Report 2021 Annual Research Report
  • [Remarks] PPIR

    • URL

      https://github.com/ii-research/PPIR

    • Related Report
      2023 Annual Research Report 2020 Annual Research Report 2019 Annual Research Report
  • [Remarks] Learning to Rank in PyTorch

    • URL

      https://github.com/wildltr/ptranking

    • Related Report
      2020 Annual Research Report
  • [Remarks] Learning to Rank in PyTorch

    • URL

      https://ptl2r.github.io

    • Related Report
      2019 Annual Research Report

URL: 

Published: 2019-04-18   Modified: 2025-01-30  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi