• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

Mutual Conversion Method of Shared Computing Power in Deep Convolutional Neural Networks and Useful Image Processing

Research Project

Project/Area Number 18H03213
Research Category

Grant-in-Aid for Scientific Research (B)

Allocation TypeSingle-year Grants
Section一般
Review Section Basic Section 60040:Computer system-related
Research InstitutionHokkaido University

Principal Investigator

Ikebe Masayuki  北海道大学, 量子集積エレクトロニクス研究センター, 教授 (20374613)

Co-Investigator(Kenkyū-buntansha) 高前田 伸也  東京大学, 大学院情報理工学系研究科, 准教授 (60738897)
Project Period (FY) 2018-04-01 – 2021-03-31
Project Status Completed (Fiscal Year 2020)
Budget Amount *help
¥13,000,000 (Direct Cost: ¥10,000,000、Indirect Cost: ¥3,000,000)
Fiscal Year 2020: ¥4,290,000 (Direct Cost: ¥3,300,000、Indirect Cost: ¥990,000)
Fiscal Year 2019: ¥4,030,000 (Direct Cost: ¥3,100,000、Indirect Cost: ¥930,000)
Fiscal Year 2018: ¥4,680,000 (Direct Cost: ¥3,600,000、Indirect Cost: ¥1,080,000)
Keywords深層ニューラルネットワーク / 有用画像処理 / 局所適応型輝度補正技術 / FPGA実装 / 深層畳み込みニューラルネットワー / 深層畳み込みニューラルネットワーク / 局所・大局画像処理 / 相互変換 / システム最適化 / 深層学習 / 高速画像処理 / 演算最適化 / 局所適応型画像処理
Outline of Final Research Achievements

In the local tone mapping we have been working on, the parameters of this process can be defined as the control points for spatial deformation, and we have found that it is appropriate to use DCNN for low-resolution images to identify spatial objects and manipulate the spatial and global control parameters for local functions in the tone-control function of this method. In DCNN (using U-net), image segmentation by tiling was found to be effective, especially for noise reduction (Poisson noise). In the case of tiling, it was found that the PSNR value was maintained at 32 dB even for 11x11 image blocks and overlap 3 pixels.

Academic Significance and Societal Importance of the Research Achievements

本研究では「DCNNニューロン層の働き」と「有用な画像処理アルゴリズム」に共有する演算能力と物理的な意義を明確にできるのか?という問いに対する解を提示した。一つは、高効率高解像度画像処理の性能を落とさずに深層学習をどのように適用するか?また、有用画像処理において、どのような深層学習がHW構成に適用できるのか、そしてどのような応用ができるのかである。これらの解は,DCNNを含むシステムに対し,人が自ら性能と機能をハンドリングすることを意味する。DCNNと有用なアルゴリズム資産の相互乗りかえを許し,人が理解できる形でのシステム最適化を導くことに繋がる。

Report

(4 results)
  • 2020 Annual Research Report   Final Research Report ( PDF )
  • 2019 Annual Research Report
  • 2018 Annual Research Report
  • Research Products

    (36 results)

All 2021 2020 2019 2018

All Journal Article (15 results) (of which Int'l Joint Research: 2 results,  Peer Reviewed: 15 results,  Open Access: 12 results) Presentation (20 results) (of which Int'l Joint Research: 14 results,  Invited: 7 results) Patent(Industrial Property Rights) (1 results)

  • [Journal Article] Real-time tone mapping: a survey and cross-implementation hardware benchmark2021

    • Author(s)
      Yafei Ou, Prasoon Ambalathankandy, Shinya Takamaeda-Yamazaki, Masato Motomura, Tetsuya Asai, Masayuki Ikebe
    • Journal Title

      IEEE Transactions on Circuits and Systems for Video Technology

      Volume: Early Access Issue: 5 Pages: 1-21

    • DOI

      10.1109/tcsvt.2021.3060143

    • Related Report
      2020 Annual Research Report
    • Peer Reviewed / Open Access / Int'l Joint Research
  • [Journal Article] Quantification of Joint Space Width Difference on Radiography Via Phase-Only Correlation (POC) Analysis: a Phantom Study Comparing with Various Tomographical Modalities Using Conventional Margin-Contouring2021

    • Author(s)
      Aimi Taguchi, Shun Shishido, Yafei Ou, Masayuki Ikebe, Tianyu Zeng, Wanxuan Fang, Koichi Murakami, Toshikazu Ueda, Nobutoshi Yasojima, Keitaro Sato, Kenichi Tamura, Kenneth Sutherland, Nozomi Oki, Ko Chiba, Kazuyuki Minowa, Masataka Uetani & Tamotsu Kamishima
    • Journal Title

      Journal of Digital Imaging

      Volume: 34 Issue: 1 Pages: 96-104

    • DOI

      10.1007/s10278-020-00406-1

    • Related Report
      2020 Annual Research Report
    • Peer Reviewed
  • [Journal Article] Selective Fine-Tuning on a Classifier Ensemble: Realizing Adaptive Neural Networks With a Diversified Multi-Exit Architecture2021

    • Author(s)
      Kazutoshi Hirose, Shinya Takamaeda-Yamazaki, Jaehoon Yu, Masato Motomura
    • Journal Title

      IEEE Access

      Volume: 9 Pages: 6179-6187

    • DOI

      10.1109/access.2020.3047799

    • Related Report
      2020 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] STATICA: A 512-Spin 0.25M-Weight Annealing Processor with an All-Spin-Updates-at-Once Architecture for Combinatorial Optimization with Complete Spin-Spin Interactions,2021

    • Author(s)
      Kasho Yamamoto, Kazushi Kawamura, Kota Ando, Normann Mertig, Takashi Takemto, Masanao Yamaoka, Hiroshi Teramoto, Akira Sakai, Shinya Takamaeda-Yamazaki, and Masato Motomura
    • Journal Title

      IEEE Journal of Solid-State Circuits

      Volume: 56 Issue: 1 Pages: 165-178

    • DOI

      10.1109/jssc.2020.3027702

    • Related Report
      2020 Annual Research Report
    • Peer Reviewed
  • [Journal Article] An Adaptive Global and Local Tone Mapping Algorithm Implemented on FPGA2020

    • Author(s)
      Prasoon Ambalathankandy, Masayuki Ikebe, Takashi Yoshida, Takeshi Shimada, Shinya Takamaeda-Yamazaki, Masato Motomura, and Tetsuya Asai
    • Journal Title

      IEEE Transactions on Circuits and Systems for Video Technology

      Volume: 30 Issue: 9 Pages: 3015-3028

    • DOI

      10.1109/tcsvt.2019.2931510

    • Related Report
      2020 Annual Research Report
    • Peer Reviewed / Int'l Joint Research
  • [Journal Article] A Hardware-efficient Weight Sampling Circuit for Bayesian Neural Networks2020

    • Author(s)
      Yuki Hirayama, Tetsuya Asai, Masato Motomura, and Shinya Takamaeda-Yamazaki
    • Journal Title

      International Journal of Networking and Computing

      Volume: 10 Issue: 2 Pages: 84-93

    • DOI

      10.15803/ijnc.10.2_84

    • NAID

      130007878703

    • ISSN
      2185-2839, 2185-2847
    • Related Report
      2020 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] Dither NN: Hardware/Algorithm Co-Design for Accurate Quantized Neural Networks2019

    • Author(s)
      Ando K., Ueyoshi K., Oba Y., Hirose K., Uematsu R., Kudo T., Ikebe M., Asai T., Takamaeda-Yamazaki S., and Motomura M.,
    • Journal Title

      IEICE Transactions on Information and Systems

      Volume: E102.D Issue: 12 Pages: 2341-2353

    • DOI

      10.1587/transinf.2019PAP0009

    • NAID

      130007754476

    • ISSN
      0916-8532, 1745-1361
    • Year and Date
      2019-12-01
    • Related Report
      2019 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] FPGA-Based Annealing Processor with Time-Division Multiplexing2019

    • Author(s)
      Yamamoto K., Ikebe M., Asai T., Motomura M., and Takamaeda-Yamazaki S.
    • Journal Title

      IEICE Transactions on Information and Systems

      Volume: E102.D Issue: 12 Pages: 2295-2305

    • DOI

      10.1587/transinf.2019PAP0002

    • NAID

      130007754464

    • ISSN
      0916-8532, 1745-1361
    • Year and Date
      2019-12-01
    • Related Report
      2019 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] A study on a low power optimization algorithm for an edge-AI device2019

    • Author(s)
      Kaneko T., Orimo K., Hida I., Takamaeda-Yamazaki S., Ikebe M., Motomura M., and Asai T.
    • Journal Title

      Nonlinear Theory and Its Applications, IEICE

      Volume: 10 Issue: 4 Pages: 373-389

    • DOI

      10.1587/nolta.10.373

    • NAID

      130007722644

    • ISSN
      2185-4106
    • Related Report
      2019 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] Hardware-Oriented Algorithm and Architecture for Generative Adversarial Networks2019

    • Author(s)
      Kaneko T., Ikebe M., Takamaeda-Yamazaki S., Motomura M., and Asai T.,
    • Journal Title

      Journal of Signal Processing

      Volume: 23 Issue: 4 Pages: 151-154

    • DOI

      10.2299/jsp.23.151

    • NAID

      130007681727

    • Related Report
      2019 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] Radiography Contrast Enhancement: Smoothed LHE Filter a Practical Solution for Digital X-Rays with Mach Band2019

    • Author(s)
      Ambalathankandy, P., Ou, Y., Kochiyil, J., Takamaeda, S., Motomura, M., Asai, T., and Ikebe, M.
    • Journal Title

      2019 Digital Image Computing: Techniques and Applications (DICTA)

      Volume: 1 Pages: 1-8

    • DOI

      10.1109/dicta47822.2019.8946114

    • Related Report
      2019 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] Automatic Radiographic Quantification of Joint Space Narrowing Progression in Rheumatoid Arthritis Using POC2019

    • Author(s)
      Ou, Y., Ambalathankandy, P., Shimada, T., Kamishima, T., and Ikebe, M.
    • Journal Title

      2019 IEEE 16th International Symposium on Biomedical Imaging (ISBI 2019)

      Volume: 1 Pages: 1183-1187

    • DOI

      10.1109/isbi.2019.8759206

    • Related Report
      2019 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] Wideband terahertz imaging pixel with a small on-chip antenna in 180 nm CMOS2019

    • Author(s)
      Kanazawa, Y., Yokoyama, S., Hiramatsu, S., Sano, E., Ikegami, T., Takida, Y., Minamide, H & Ikebe, M.
    • Journal Title

      Japanese Journal of Applied Physics

      Volume: 58 Issue: SB Pages: SBBL06-SBBL06

    • DOI

      10.7567/1347-4065/ab03c9

    • NAID

      210000157689

    • Related Report
      2018 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] BRein memory: a single-chip binary/ternary reconfigurable in-memory deep neural network accelerator achieving 1.4TOPS at 0.6W2018

    • Author(s)
      Ando K., Ueyoshi K., Orimo K., Yonekawa H., Sato S., Nakahara H., Takamaeda-Yamazaki S., Ikebe M., Asai T., Kuroda T., and Motomura M.
    • Journal Title

      IEEE J. Solid-State Circuits

      Volume: 53 Issue: 4 Pages: 983-994

    • DOI

      10.1109/jssc.2017.2778702

    • Related Report
      2018 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] Real-time HDTV to 4K and 8K-UHD conversions using anti-aliasing based super resolution algorithm on FPGA2018

    • Author(s)
      Ambalathankandy P., Takamaeda-Yamazaki S., Motomura M., Asai T., Ikebe M., and Kusano H
    • Journal Title

      Microprocessors and Microsystems

      Volume: 60 Pages: 21-31

    • DOI

      10.1016/j.micpro.2018.05.008

    • Related Report
      2018 Annual Research Report
    • Peer Reviewed / Open Access
  • [Presentation] A 32x32-Pixel Global Shutter CMOS THz Imager with VCO-Based ADC2021

    • Author(s)
      Yuri Kanazawa
    • Organizer
      26th Asia and South Pacific Design Automation ConferenceASP-DAC 2021
    • Related Report
      2020 Annual Research Report
    • Int'l Joint Research / Invited
  • [Presentation] A CMOS THz Image Sensor with Process Variation Tolerance Technique2020

    • Author(s)
      Masayuki Ikebe
    • Organizer
      IEEE International Symposium on Radio-Frequency Integration Technology
    • Related Report
      2020 Annual Research Report
    • Int'l Joint Research / Invited
  • [Presentation] 画素並列ADCを持つグローバルシャッタ型テラヘルツ光CMOSイメージセンサとその補正機構2020

    • Author(s)
      池辺将之
    • Organizer
      テラヘルツシステム応用推進協議会
    • Related Report
      2020 Annual Research Report
    • Invited
  • [Presentation] イメージセンサと局所適応型画像処理の開発とその展望2020

    • Author(s)
      池辺将之
    • Organizer
      映像情報メディア学会2020年次大会
    • Related Report
      2020 Annual Research Report
    • Invited
  • [Presentation] センシング後の画像処理に向けた高速・適応型輝度チャネル表現2020

    • Author(s)
      池辺将之
    • Organizer
      情報センシング研究会(IST)新規イメージセンサ・光源・信号処理に基づくイメージセンシング
    • Related Report
      2020 Annual Research Report
  • [Presentation] 1画素単位で輝度を適切に制御する高速かつグローバル・ローカル適応型画像処理2019

    • Author(s)
      池辺将之
    • Organizer
      光と レーザーの科学技術フェア2019
    • Related Report
      2019 Annual Research Report
    • Invited
  • [Presentation] X線画像診断に向けた定量的サブピクセル関節破壊量計測2019

    • Author(s)
      池辺将之
    • Organizer
      映像情報メディア学会情報センシング11月研究会
    • Related Report
      2019 Annual Research Report
    • Invited
  • [Presentation] 32×32 画素並列ADC 構成によるグローバルシャッタ型CMOS テラヘルツイメージセンサ2019

    • Author(s)
      池辺将之
    • Organizer
      シンポジウム テラヘルツ科学の最先端Ⅵ
    • Related Report
      2019 Annual Research Report
    • Invited
  • [Presentation] Hardware-oriented algorithm and architecture for generative adversarial networks2019

    • Author(s)
      Kaneko T., Ikebe M., Takamaeda-Yamazaki S., Motomura M., and Asai T.
    • Organizer
      The 2019 RISP International Workshop on Nonlinear Circuits, Communications and Signal Processing
    • Related Report
      2018 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Experimental demonstration of physical reservoir computing with nonlinear electronic devices2019

    • Author(s)
      Suzuki S., Rim S., Takamaeda-Yamazaki S., Ikebe M., Motomura M., and Asai T.
    • Organizer
      The 2019 RISP International Workshop on Nonlinear Circuits, Communications and Signal Processing
    • Related Report
      2018 Annual Research Report
    • Int'l Joint Research
  • [Presentation] FPGA-based FORCE learning accelerator towards real-time online reservoir computing,2019

    • Author(s)
      Minamikawa K., Takamaeda-Yamazaki S., Ikebe M., Motomura M., and Asai T.
    • Organizer
      The 2019 RISP International Workshop on Nonlinear Circuits, Communications and Signal Processing
    • Related Report
      2018 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Ternarized backpropagation: a hardware-oriented optimization algorithm for edge-oriented AI devices2019

    • Author(s)
      Kaneko T., Ikebe M., Takamaeda-Yamazaki S., Motomura M., and Asai T.
    • Organizer
      The 7th RIEC International Symposium on Brain Functions and Brain Computer, Research Institute of Electrical Communication
    • Related Report
      2018 Annual Research Report
    • Int'l Joint Research
  • [Presentation] A 32× 32-Pixel 0.9 THz Imager with Pixel-Parallel 12b VCO-Based ADC in 0.18 μm CMOS2019

    • Author(s)
      Yokoyama, S., Ikebe, M., Kanazawa, Y., Ikegami, T., Ambalathankandy, P., Hiramatsu, Takida, Y. & Minamide, H.
    • Organizer
      In 2019 IEEE International Solid-State Circuits Conference (ISSCC2019)
    • Related Report
      2018 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Approach to reservoir computing with Schmitt trigger oscillator-based analog neural circuits,2019

    • Author(s)
      Rim S., Suzuki S., Takamaeda-Yamazaki S., Ikebe M., Motomura M., and Asai T.
    • Organizer
      The 7th Japan-Korea Joint Workshop on Complex Communication Sciences,
    • Related Report
      2018 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Dither NN: an accurate neural network with dithering for low bit-precision hardware2018

    • Author(s)
      Ando K., Ueyoshi K., Oba Y., Hirose K., Uematsu R., Kudo T., Ikebe M., Asai T., Takamaeda-Yamazaki S., and Motomura M
    • Organizer
      The 2018 International Conference on Field-Programmable Technology (FPT'18)
    • Related Report
      2018 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Analysis of smoothed LHE methods for processing images with optical illusions," IEEE International Conference on Visual Communications and Image Processing2018

    • Author(s)
      Ambalathankandy P., Shimada T., Takamaeda-Yamazaki S., Motomura M., Asai T., and Ikebe M.
    • Organizer
      IEEE International Conference on Visual Communications and Image Processing(VCIP2018)
    • Related Report
      2018 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Area and energy optimization for bit-serial log-quantized DNN Accelerator with shared accumulators2018

    • Author(s)
      Kudo T., Ueyoshi K., Ando K., Hirose K., Uematsu R., Oba Y., Ikebe M., Asai T., Motomura M., and Takamaeda-Yamazaki S.
    • Organizer
      IEEE 12th International Symposium on Embedded Multicore/Many-core Systems-on-Chip
    • Related Report
      2018 Annual Research Report
    • Int'l Joint Research
  • [Presentation] CMOS terahertz imaging pixel with a VCO-based ADC2018

    • Author(s)
      Yokoyama S., Kanazawa Y., Ikegami T., Hiramatsu S., Sano E., Takida Y., Ambalathankandy P., Minamide H. and Ikebe M.
    • Organizer
      SSDM 2018
    • Related Report
      2018 Annual Research Report
    • Int'l Joint Research
  • [Presentation] CMOS Terahertz Imaging Pixel with a Wideband on-Chip Antenna2018

    • Author(s)
      Kanazawa, Y., Sano, E., Yokoyama, S., Ambalathankandy, P., Ikebe, M., Hirmatsu, S., Takida, Y. & Minamide, H.
    • Organizer
      In 2018 43rd International Conference on Infrared, Millimeter, and Terahertz Waves (IRMMW2018)
    • Related Report
      2018 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Sparse Disparity Estimation Using Global Phase Only Correlation for Stereo Matching Acceleration2018

    • Author(s)
      13. Shimada, T., Ikebe, M., Ambalathankandy, P., Motomura, M., & Asai, T.
    • Organizer
      In 2018 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP2018)
    • Related Report
      2018 Annual Research Report
    • Int'l Joint Research
  • [Patent(Industrial Property Rights)] 情報処理装置及び情報処理方法並びに情報処理用プログラム2018

    • Inventor(s)
      島田武、池辺将之、吉田 敏明
    • Industrial Property Rights Holder
      島田武、池辺将之、吉田 敏明
    • Industrial Property Rights Type
      特許
    • Filing Date
      2018
    • Related Report
      2018 Annual Research Report

URL: 

Published: 2018-04-23   Modified: 2022-01-27  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi