• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

Hardware approach for high-speed search algorithms with memory layer optimization

Research Project

Project/Area Number 18300028
Research Category

Grant-in-Aid for Scientific Research (B)

Allocation TypeSingle-year Grants
Section一般
Research Field Media informatics/Database
Research InstitutionThe University of Tokyo

Principal Investigator

INABA Mary  The University of Tokyo, 大学院・情報理工学系研究科, 准教授 (60282711)

Co-Investigator(Kenkyū-buntansha) 今井 浩  東京大学, 大学院・情報理工学系研究科, 教授 (80183010)
定兼 邦彦  九州大学, システム情報科学研究科, 准教授 (20323090)
菅原 豊  東京大学, 大学院・情報理工学系研究科, 助教 (60401246)
Co-Investigator(Renkei-kenkyūsha) 今井 浩  東京大学, 大学院・情報理工学系研究科, 教授 (80183010)
定兼 邦彦  国立情報学研究所, 情報学プリンシプル研究系, 准教授 (20323090)
Project Period (FY) 2006 – 2009
Project Status Completed (Fiscal Year 2009)
Budget Amount *help
¥17,460,000 (Direct Cost: ¥14,400,000、Indirect Cost: ¥3,060,000)
Fiscal Year 2009: ¥4,030,000 (Direct Cost: ¥3,100,000、Indirect Cost: ¥930,000)
Fiscal Year 2008: ¥4,290,000 (Direct Cost: ¥3,300,000、Indirect Cost: ¥990,000)
Fiscal Year 2007: ¥4,940,000 (Direct Cost: ¥3,800,000、Indirect Cost: ¥1,140,000)
Fiscal Year 2006: ¥4,200,000 (Direct Cost: ¥4,200,000)
Keywords超高速情報処理 / ディレクトリ・情報検索 / アルゴリズム / インターネット高速化 / コンテンツアーカイブ / ディレクトリ / インターネット高度化
Research Abstract

With the progress of semiconductor process technology, memory access gap, and thus, the pipeline stall time due to cache misses are increasing. It is often observed in the real world computation that the memory band width plays the role of computation bottleneck. Thus, considering memory hierarchy, it is important to hide the memory access latency with efficient utilization of upper layer memory. In this work, we propose and evaluate a hardware solution to accelerate for full text search with compressed succinct data structure. In addition, as a by-product, we propose an efficient prefetch method using memory map data structure.

Report

(6 results)
  • 2009 Annual Research Report   Final Research Report ( PDF )
  • 2008 Annual Research Report   Self-evaluation Report ( PDF )
  • 2007 Annual Research Report
  • 2006 Annual Research Report
  • Research Products

    (54 results)

All 2010 2009 2008 2007 2006 2005 Other

All Journal Article (20 results) (of which Peer Reviewed: 7 results) Presentation (34 results)

  • [Journal Article] Efficient disk-to-disk copy throughlong-distance high-speed networks with background traffic2010

    • Author(s)
      N. Tanida, K. Hiraki, M. Inaba
    • Journal Title

      Fusion Engineering and Design. An International Journal for Fusion Energy and Technology devoted to Experiments, Theory, Methods and Design, To appear

    • Related Report
      2009 Final Research Report
  • [Journal Article] Efficient disk-to-disk copy through long-distance high-speed networks with background traffic.2010

    • Author(s)
      N.Tanida, Kei Hiraki, Mary Inaba
    • Journal Title

      Fusion Engineering and Design. An International Journal for Fusion Energy and Technology devoted to Experiments, Theory, Methods and Design(To appear) (印刷中)(掲載確定)

    • Related Report
      2009 Annual Research Report
    • Peer Reviewed
  • [Journal Article] USADAFOX : Ultra-High-Speed file-Acquisition-system over Distance with Apache and fireFOX.2010

    • Author(s)
      Y.Iguchi, N.Tanida, K.Koizumi, M.Inaba, K.Hiraki
    • Journal Title

      TERENA NETWORKING CONFERENCE 2010(TNC2010)(To appear) (印刷中)(掲載確定)

    • Related Report
      2009 Annual Research Report
    • Peer Reviewed
  • [Journal Article] Hardware Accelerator for Full-Text Search(HAFTS)with Succinct Data Structure2009

    • Author(s)
      N.Tanida, M.Inaba, K.Hiraki, T.Yoshino
    • Journal Title

      International Conference on ReConFigurable Computing and FPGAs(RECONFIG09) Vol.1

      Pages: 155-160

    • Related Report
      2009 Annual Research Report
    • Peer Reviewed
  • [Journal Article] Triple Line-based Playout for Go-An Accelerator of Monte Carlo Go2009

    • Author(s)
      K.Koizumi, M.Inaba, K.Hiraki, Y.Ishii, T.Miyoshi, K.Yoshizoe
    • Journal Title

      International Conference on ReConFigurable Computing and FPGAs(RECONFIG09) Vol.1

      Pages: 161-166

    • Related Report
      2009 Annual Research Report
    • Peer Reviewed
  • [Journal Article] The Effect of the Buffer of the Path-Bottleneck Switch of Long Fat-pipe Network2009

    • Author(s)
      M.Inaba, K.Koizumi, T.Yoshino, Y.Sugawara, J.Tamatsukuri, H.Tezuka, K.Hiraki
    • Journal Title

      International Workshop on Protocols for Future, Large-Scale & Diverse Network Transports(PFLDNeT09). Vol.1

      Pages: 7-12

    • Related Report
      2009 Annual Research Report
    • Peer Reviewed
  • [Journal Article] Internet2 Land Speed Record 長距離TCP通信高速化への挑戦2008

    • Author(s)
      平木敬, 稲葉真理, 菅原豊, 吉野剛史, 玉造潤史, 加藤朗
    • Journal Title

      情報処理学会論文誌招待解説論文 Vol. 49, no. 2

      Pages: 179-186

    • NAID

      110006596168

    • Related Report
      2009 Final Research Report
  • [Journal Article] Flow Balancing Hardware for Parallel TCP Streams on Long Fat pipe Network2008

    • Author(s)
      Yutaka Sugawara, Mary Inaba, Kei Hiraki
    • Journal Title

      International Journal of Software Engineering and Its Applications (FGCN, selected paper) Vol.2 ,No.2

      Pages: 1-12

    • Related Report
      2008 Annual Research Report
    • Peer Reviewed
  • [Journal Article] Internet2 Land Speed Record長距離TCP通信高速化への挑戦2008

    • Author(s)
      平木敬,稲葉真理,菅原豊,吉野剛史,玉造潤史,加藤朗
    • Journal Title

      情報処理学会論文誌招待解説論文 Vol.49, No.2

      Pages: 179-186

    • NAID

      110006596168

    • Related Report
      2008 Annual Research Report
  • [Journal Article] Flow Balancing Hardware for Parallel TCP Streams on Long Fat pipe Network2008

    • Author(s)
      Yutaka Sugawara, Mary Inaba, Kei Hiraki
    • Journal Title

      International Journal of Software Engineering and Its Applications (FGCN, selected paper) Vo1.2, No.2

      Pages: 1-12

    • Related Report
      2007 Annual Research Report
    • Peer Reviewed
  • [Journal Article] Internet2 Land Speed Record 長距離TCP通信高速化への挑戦2008

    • Author(s)
      平木敬, 稲葉真理, 菅原豊, 吉野剛史, 玉造潤史, 加藤朗
    • Journal Title

      情報処理学会論文誌 招待解説論文 Vol.49, No.2

      Pages: 1-1

    • NAID

      110006596168

    • Related Report
      2007 Annual Research Report
  • [Journal Article] バンド幅チャレンジとネットワーク背景技術2007

    • Author(s)
      稲葉真理
    • Journal Title

      電子情報通信学会論文誌A招待解説論文Vol. J90-A No. 6 pp. 495-505 Vol.J90, No.A

      Pages: 495-505

    • NAID

      110007384514

    • Related Report
      2007 Annual Research Report
  • [Journal Article] CometインテリジェントNICの応用2007

    • Author(s)
      稲葉真理, 陣崎明, 平木敬
    • Journal Title

      情報処理学会論文誌 産学連携論文特集号 Vol.48,No.2

      Pages: 711-720

    • Related Report
      2006 Annual Research Report
  • [Journal Article] Analysis of 10Gigabit Ethernet using Hardware Engine for Performance Tuning on Long Fat-pipe Network2007

    • Author(s)
      Takeshi Yoshino, Junji Tamatsukuri, Katsushi Inagami, Yutaka Sugawara, Mary Inaba, Kei Hiraki
    • Journal Title

      Fifth International Workshop on Protocols for FAST Long-Distance Networks

      Pages: 43-48

    • Related Report
      2006 Annual Research Report
  • [Journal Article] Squeezing succinct data structures into entropy bounds2006

    • Author(s)
      Kunihiko sadakane, Robert Grossi
    • Journal Title

      Proceedings of the seventeenth annual ACM-SIAM symposium on Oiscrete algorithm

      Pages: 1230-1239

    • Related Report
      2006 Annual Research Report
  • [Journal Article] 並列TCPストリームのための流量割り当て方式2006

    • Author(s)
      菅原豊, 稲葉真理, 平木敬
    • Journal Title

      高知2006,情報処理学会研究報告 IPSJ SIG Technical Reports Vol.2006,No.87

      Pages: 31-36

    • NAID

      110004821205

    • Related Report
      2006 Annual Research Report
  • [Journal Article] Network Processing Hardware2006

    • Author(s)
      Mary Inaba, Kei Hiraki
    • Journal Title

      Proc. Second Asian Internet Engineering Conference (AINTEC 2006)(SpringerLNCS) 4311

      Pages: 103-112

    • Related Report
      2006 Annual Research Report
  • [Journal Article] Avoidable packet losses on Long Fat Pipe Network; Effects of bottlenecks and intermediate switches2005

    • Author(s)
      Mary Inaba, Mami Tanaka, Junji Tamatsukuri, Kei Hiraki, Hiroshi Imai
    • Journal Title

      Proceedings of the IFIP International Conference on Network and Parallel Computing (NPC2006)

      Pages: 1-10

    • Related Report
      2006 Annual Research Report
  • [Journal Article] Flow Balancing Hardware for Parallel TCP Streams on Long Fat pipe Network

    • Author(s)
      Y. Sugawara, M. Inaba, K. Hiraki
    • Journal Title

      International Journal of Software Engineering and Its Applications (FGCN, selected paper) vol2 no 2

      Pages: 1-12

    • Related Report
      2009 Final Research Report
  • [Journal Article] Flow Balancing Hardware for Parallel TCP Streams on Long Fat pipe Network

    • Author(s)
      Yutaka Sugawara, Mary Inaba, Kei Hiraki
    • Journal Title

      International Journal of Software Engineering and Its Applications(FGCN, selected paper vol2 no 2

      Pages: 1-12

    • Related Report
      2008 Self-evaluation Report
  • [Presentation] Map-Based Adaptive Insertion Policy2010

    • Author(s)
      Y. Ishii, M. Inaba, K. Hiraki
    • Organizer
      CRC-1 Workshop of the ACM IEEE International Symposium on Computer Architecture, to appear
    • Related Report
      2009 Final Research Report
  • [Presentation] USADAFOX : Ultra-High-Speed file-Acquisition-system over Distance with Apache and fireFOX2010

    • Author(s)
      Y. Iguchi, N. TANIDA, K. Koizumi, M. Inaba, K. Hiraki
    • Organizer
      TERENA Networking Conference
    • Related Report
      2009 Final Research Report
  • [Presentation] SAT CNF Encoding with Multi-modeling2010

    • Author(s)
      T. Sonobe, M. Inaba
    • Organizer
      The 3rd Annual Meeting of the Asian Association for Algorithms and Computation (AAAC2010)
    • Related Report
      2009 Final Research Report
  • [Presentation] Experiment of High-performance Data Transfer between ITER and Japan.2009

    • Author(s)
      N.Tanida, K.Hiraki, M.Inaba.
    • Organizer
      Asia-Pacific Advanced network 28th APAN Meeting, 2009(招待講演)
    • Place of Presentation
      Kuala Lumpur, Malaysia
    • Year and Date
      2009-07-20
    • Related Report
      2009 Annual Research Report
  • [Presentation] Access Map Pattern Matching for Data Cache Prefetch2009

    • Author(s)
      Y.Ishii, M.Inaba, K.Hiraki
    • Organizer
      International Conference on Supercomputing(ICS'09)
    • Place of Presentation
      New York, USA
    • Year and Date
      2009-06-08
    • Related Report
      2009 Annual Research Report
  • [Presentation] Highly efficient data transmission facility through very long distance high-speed networks2009

    • Author(s)
      N. Tanida, K. Hiraki, M. Inaba
    • Organizer
      Seventh IAEA Technical Meeting on Control, Data Acquisition, and Remote Participation for Fusion Research
    • Related Report
      2009 Final Research Report
  • [Presentation] Hardware Accelerator for Full-Text Search (HAFTS) with Succinct Data Structure2009

    • Author(s)
      N. Tanida, M. Inaba, K. Hiraki, T. Yoshino
    • Organizer
      International Conference on ReConFigurable Computing and FPGAs (RECONFIG09)
    • Related Report
      2009 Final Research Report
  • [Presentation] Triple Line-based Playout for Go-An Accelerator of Monte Carlo Go2009

    • Author(s)
      K. Koizumi, M. Inaba, K. Hiraki, Y. Ishii, T. Miyoshi, K. Yoshizoe
    • Organizer
      International Conference on ReConFigurable Computing and FPGAs (RECONFIG09)
    • Related Report
      2009 Final Research Report
  • [Presentation] Access Map Pattern Matching for Data Cache Prefetch2009

    • Author(s)
      Y. Ishii, M. Inaba, K. Hiraki
    • Organizer
      ACM International Conference on Super-computing (ICS'09)
    • Related Report
      2009 Final Research Report
  • [Presentation] 2The Effect of the Buffer of the Path-Bottleneck Switch of Long Fat-pipe Network2009

    • Author(s)
      M. Inaba, K. Koizumi, T. Yoshino, Y. Sugawara, J. Tamatsukuri, H. Tezuka, K. Hiraki
    • Organizer
      International Workshop on Protocols for Future, Large-Scale & Diverse Network Transports (PFLDNeTO9)
    • Related Report
      2009 Final Research Report
  • [Presentation] A Reconfigurable Hardware Mechanism for Harmonizing Parallel TCP Streams of 10 Gigabit Ethernet2009

    • Author(s)
      K. Koizumi, T. Yoshino, Y. Sugawara, M. Inaba, K. Hiraki
    • Organizer
      International Workshop on Protocols for Future, Large-Scale & Diverse Network Transports (PFLDNeT09)
    • Related Report
      2009 Final Research Report
  • [Presentation] Access Map Pattern Matching Prefetch : Optimization Friendly Method2009

    • Author(s)
      Y. Ishii, M. Inaba, K. Hiraki
    • Organizer
      The Journal of Instruction-Level Parallelism Data Prefetching Championship The 1st JILP Data Prefetching Championship (DPC-1)
    • Related Report
      2009 Final Research Report
  • [Presentation] Performance Optimization of TCP/IP over 10 Gigabit Ethernet by Precise Instrumentation2008

    • Author(s)
      Takeshi Yoshino, Yutaka Sugawara, Katsushi Inagami, Junji Tamatsukuri, Mary Inaba, Kei Hiraki
    • Organizer
      Super Computing 2008 (SC08)
    • Place of Presentation
      Austin, Texas, U.S.A.
    • Year and Date
      2008-11-15
    • Related Report
      2008 Annual Research Report
  • [Presentation] "MCAMP: Communication Optimization on Massively Parallel Machines with Hierarchical Scratch-pad Memory2008

    • Author(s)
      Hiroshige Hayashizaki, Yutaka Sugawara, Mary Inaba, Kei Hiraki
    • Organizer
      Parallel Architectures and Compilation Techniques (PACT) 2008
    • Place of Presentation
      Toronto, Canada
    • Year and Date
      2008-10-25
    • Related Report
      2008 Annual Research Report
  • [Presentation] "CVC: THE C TO RTL COMPILER FOR CALLBACK BASED VERIFICATION MODEL2008

    • Author(s)
      Yasuhiro Ito, Yutaka Sugawara, Mary Inaba, Kei Hiraki
    • Organizer
      International Conference on Field Programmable Logic and Applications (FPL) 2008 (short paper)
    • Place of Presentation
      Heiderberg, Germany
    • Year and Date
      2008-09-08
    • Related Report
      2008 Annual Research Report
  • [Presentation] Effect of Parallel TCP Stream Equalizer on Real Long Fat-pipe Network2008

    • Author(s)
      Yutaka Sugawara, Takeshi Yoshino, Hiroshi Tezuka, Mary Inaba, Kei Hiraki
    • Organizer
      The 7th IEEE International Symposium on Network Computing and Applications NCA08 (short paper)
    • Place of Presentation
      Cambridge, MA USA
    • Year and Date
      2008-07-10
    • Related Report
      2008 Annual Research Report
  • [Presentation] Effect of Packet Shuffler on Parallel TCP Stream Network2008

    • Author(s)
      Yutaka Sugawara, Takeshi Yoshino, Hiroshi Tezuka, Mary Inaba, Kei Hiraki
    • Organizer
      The Seventh International Conference on Networking (ICN 2008)
    • Place of Presentation
      Cancun, Mexico
    • Year and Date
      2008-04-13
    • Related Report
      2008 Annual Research Report
  • [Presentation] Fine Tune for parallel TCP Streams on Long Fat-pipe Network using Hardware Engine2008

    • Author(s)
      Yutaka Sugawara, Takeshi Yoshino, Mary Inaba, Kei Hiraki
    • Organizer
      Sixth International Workshop on Protocols for FAST Long-Distance Networks(PFLD)2008
    • Place of Presentation
      Manchester, UK
    • Year and Date
      2008-03-05
    • Related Report
      2007 Annual Research Report
  • [Presentation] CVC : The C to RTL compiler for callback based verification model2008

    • Author(s)
      Y. Ito, Y. Sugawara, M. Inaba, K. Hiraki
    • Organizer
      International Conference on Field Programmable Logic and Applications (FPL2009)
    • Related Report
      2009 Final Research Report
  • [Presentation] Effect of Parallel TCP Stream Equalizer on Real Long Fat-pipe Network2008

    • Author(s)
      Y. Sugawara, T. Yoshino, H. Tezuka, M. Inaba, K. Hiraki
    • Organizer
      The 7th IEEE International Symposium on Network Computing and Applications (IEEE NCA08) (short paper)
    • Related Report
      2009 Final Research Report
  • [Presentation] Effect of Packet Shuffler on Parallel TCP Stream Network2008

    • Author(s)
      Y. Sugawara, T. Yoshino, H. Tezuka, M. Inaba, K. Hiraki
    • Organizer
      IEEE The Seventh International Conference on Networking (ICN 2008)
    • Related Report
      2009 Final Research Report
  • [Presentation] Fine Tune for parallel TCP Streams on Long Fat-pipe Network using Hardware Engine2008

    • Author(s)
      Y. Sugawara, T. Yoshino, M. Inaba, K. Hiraki
    • Organizer
      6th International Workshop on Protocols for FAST Long-Distance Networks (PFLDnet2008)
    • Related Report
      2009 Final Research Report
  • [Presentation] Flow Balancing Hardware for Parallel TCP Streams on Long Fat pipe Network2008

    • Author(s)
      Y. Sugawara, M. Inaba, K. Hiraki
    • Organizer
      International Journal of Software Engineering and Its Applications (FGCN, selected paper)
    • Related Report
      2009 Final Research Report
  • [Presentation] MCAMP : Communication Optimization on Massively Parallel Machines with Hierarchical Scratch-pad Memory2008

    • Author(s)
      H. Hayashizaki, Y. Sugawara, M. Inaba, K. Hiraki
    • Organizer
      Parallel Architectures and Compilation Techniques (PACT)
    • Place of Presentation
      Toronto, Canada
    • Related Report
      2009 Final Research Report 2008 Self-evaluation Report
  • [Presentation] Performance Optimization of TCP/IP over 10 Gigabit Ethernet by Precise Instrumentation2008

    • Author(s)
      Takeshi Yoshino, Yutaka Sugawara, Katsushi Inagami, Junji Tamatsukuri, Mary Inaba and Kei Hiraki
    • Organizer
      SuperComputing(SC08), USB-stick, Austin, Texas
    • Place of Presentation
      U.S.A.
    • Related Report
      2008 Self-evaluation Report
  • [Presentation] 高遅延広帯域ネットワークにおける並列TCPストリームの公平性解析2007

    • Author(s)
      菅原豊, 稲葉真理, 平木敬
    • Organizer
      第12回分散システム/インターネット運用技術シンポジウム(DSM)
    • Place of Presentation
      東京, 日本
    • Year and Date
      2007-11-26
    • Related Report
      2007 Annual Research Report
  • [Presentation] GRAPE-DR : 2-Pflops massively-parallel computer with 512-core, 512-Gflops processor chip for scientific computing2007

    • Author(s)
      Junichiro Makino, Kei Hiraki, Mary Inaba
    • Organizer
      SuperComputing2007(SC07)
    • Place of Presentation
      Reno, USA
    • Year and Date
      2007-11-10
    • Related Report
      2007 Annual Research Report
  • [Presentation] Sakura-C:超並列計算機向けC言語と最適化2007

    • Author(s)
      林崎弘成, 西川徹, 菅原豊, 稲葉真理, 平木敬
    • Organizer
      2007年並列/分散/協調処理に関する『旭川』サマー・ワークショップ(SWoPP旭川2007)
    • Place of Presentation
      旭川, 日本
    • Year and Date
      2007-08-01
    • Related Report
      2007 Annual Research Report
  • [Presentation] ゲートウェイによる並列TCPのウィンドウサイズ平均化2007

    • Author(s)
      菅原豊, 稲葉真理, 平木敬
    • Organizer
      2007年並列/分散/協調処理に関する『旭川』サマー・ワークショップ(SWoPP旭川2007)
    • Place of Presentation
      旭川, 日本
    • Year and Date
      2007-08-01
    • Related Report
      2007 Annual Research Report
  • [Presentation] GRAPE-DR : 2-Pflops massivelyparallel computer with 512-core, 512-Gflops processor chip for scientific computing2007

    • Author(s)
      Junichiro Makino, Kei Hiraki and Mary Inaba
    • Organizer
      SuperComputing(SC07),USB-stick
    • Place of Presentation
      Reno USA
    • Related Report
      2008 Self-evaluation Report
  • [Presentation] Network Processing Hardware2006

    • Author(s)
      M. Inaba, K. Hiraki
    • Organizer
      Springer LNCS4311, Proc. Second ASIAN INTERNET ENGINEERING CONFERENCE
    • Related Report
      2009 Final Research Report
  • [Presentation] Network Processing Hardware, Springer LNCS4311, Proc.2006

    • Author(s)
      Mary Inaba, Kei Hiraki
    • Organizer
      Second ASIAN INTERNET ENGINEERING CONFERENCE
    • Place of Presentation
      AINTEC
    • Related Report
      2008 Self-evaluation Report
  • [Presentation] Performance Optimization of TCP/IP over 10 Gigabit Ethernet by Precise Instrumentation

    • Author(s)
      T. Yoshino, Y. Sugawara, K. Inagami, J. Tamatsukuri, M. Inaba, K. Hiraki
    • Organizer
      SuperComputing2008(SCO8)
    • Place of Presentation
      USB-stick, Austin, Texas, U. S. A.
    • Related Report
      2009 Final Research Report
  • [Presentation] 512-Gflops processor chip for scientific computing

    • Author(s)
      J. Makino, K. Hiraki, M. Inaba, GRAPE-DR : 2-Pflops massively- parallel computer with 512-core
    • Organizer
      SuperComputing2007(SCO7)
    • Place of Presentation
      USB-stick, Reno USA
    • Related Report
      2009 Final Research Report

URL: 

Published: 2006-04-01   Modified: 2016-04-21  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi