• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

Object-based parallel video coding system

Research Project

Project/Area Number 17K00157
Research Category

Grant-in-Aid for Scientific Research (C)

Allocation TypeMulti-year Fund
Section一般
Research Field Multimedia database
Research InstitutionThe University of Tokushima

Principal Investigator

SONG Tian  徳島大学, 大学院社会産業理工学研究部(理工学域), 准教授 (10380130)

Co-Investigator(Kenkyū-buntansha) 島本 隆  徳島大学, 大学院社会産業理工学研究部(理工学域), 教授 (20170962)
Project Period (FY) 2017-04-01 – 2020-03-31
Project Status Completed (Fiscal Year 2019)
Budget Amount *help
¥4,680,000 (Direct Cost: ¥3,600,000、Indirect Cost: ¥1,080,000)
Fiscal Year 2019: ¥1,690,000 (Direct Cost: ¥1,300,000、Indirect Cost: ¥390,000)
Fiscal Year 2018: ¥650,000 (Direct Cost: ¥500,000、Indirect Cost: ¥150,000)
Fiscal Year 2017: ¥2,340,000 (Direct Cost: ¥1,800,000、Indirect Cost: ¥540,000)
Keywords動画像符号化 / HEVC / Object extraction / Salient object / Parallel processing / object based coding / smart coding / 並列処理 / オブジェクトベース符号化 / オブジェクト
Outline of Final Research Achievements

In this work, we introduced the object extraction for the video coding and proposed a new structure for next generation video coding. In the proposed structure, a saliency object is extracted as an object and encoded individually to improve the coding performance of the motion estimation and the intra coding. Our simulation results show that the proposed structure shows good performance on the coding efficiency. On the basis of the results we will work towards next generation coding standard with the proposed structure.

Academic Significance and Societal Importance of the Research Achievements

従来の符号化構造を持つ符号化国際標準には、様々な固有問題を抱えているため、最新の規格がハードウェアに実装する際に大変苦労している。本研究は、昨今大きく進展を遂げた人工知能分野の知恵を借り、符号化手法に新たな符号化構造を提案している。提案の構造は、過去蓄積した知恵を利用しながら、最新の物体検出手法も利用し、高い符号化効率と小面積ハードウェア実装を両立可能としている。現在、このような研究が増え、注目されつつある。次の国際標準に向け、更に研究を深める必要がある。

Report

(4 results)
  • 2019 Annual Research Report   Final Research Report ( PDF )
  • 2018 Research-status Report
  • 2017 Research-status Report
  • Research Products

    (39 results)

All 2020 2019 2018 2017 Other

All Int'l Joint Research (3 results) Journal Article (11 results) (of which Int'l Joint Research: 6 results,  Peer Reviewed: 11 results,  Open Access: 8 results,  Acknowledgement Compliant: 1 results) Presentation (25 results) (of which Int'l Joint Research: 16 results)

  • [Int'l Joint Research] Shanghai Maritime University/Xidian University(中国)

    • Related Report
      2019 Annual Research Report
  • [Int'l Joint Research] 上海海事大学(中国)

    • Related Report
      2018 Research-status Report
  • [Int'l Joint Research] 台湾科技大学(Taiwan)

    • Related Report
      2017 Research-status Report
  • [Journal Article] Maximum-Entropy-Model-Enabled Complexity Reduction Algorithm in Modern Video Coding Standards2020

    • Author(s)
      Jiang Xiantao、Song Tian、Katayama Takafumi
    • Journal Title

      Symmetry

      Volume: 12 Issue: 1 Pages: 113-113

    • DOI

      10.3390/sym12010113

    • NAID

      120007037465

    • Related Report
      2019 Annual Research Report
    • Peer Reviewed / Open Access / Int'l Joint Research
  • [Journal Article] A High-Throughput Subspace Pursuit Processor for ECG Recovery in Compressed Sensing Using Square-Root-Free MGS QR Decomposition2020

    • Author(s)
      Liu Yizhong、Song Tian、Zhuang Yiqi
    • Journal Title

      IEEE Transactions on Very Large Scale Integration (VLSI) Systems

      Volume: 28 Issue: 1 Pages: 174-187

    • DOI

      10.1109/tvlsi.2019.2936867

    • Related Report
      2019 Annual Research Report
    • Peer Reviewed / Int'l Joint Research
  • [Journal Article] Low-Complexity and Hardware-Friendly H.265/HEVC Encoder for Vehicular Ad-Hoc Networks2019

    • Author(s)
      Jiang Xiantao、Feng Jie、Song Tian、Katayama Takafumi
    • Journal Title

      Sensors

      Volume: 19 Issue: 8 Pages: 1927-1927

    • DOI

      10.3390/s19081927

    • NAID

      120007141565

    • Related Report
      2019 Annual Research Report
    • Peer Reviewed / Open Access / Int'l Joint Research
  • [Journal Article] Quality-Oriented Perceptual HEVC Based on the Spatiotemporal Saliency Detection Model2019

    • Author(s)
      Jiang Xiantao、Song Tian、Zhu Daqi、Katayama Takafumi、Wang Lu
    • Journal Title

      Entropy

      Volume: 21 Issue: 2 Pages: 165-165

    • DOI

      10.3390/e21020165

    • Related Report
      2018 Research-status Report
    • Peer Reviewed / Open Access / Int'l Joint Research
  • [Journal Article] Spatial Correlation-Based Motion-Vector Prediction for Video-Coding Efficiency Improvement2019

    • Author(s)
      Jiang Xiantao、Song Tian、Katayama Takafumi、Leu Jenq-Shiou
    • Journal Title

      Symmetry

      Volume: 11 Issue: 2 Pages: 129-129

    • DOI

      10.3390/sym11020129

    • Related Report
      2018 Research-status Report
    • Peer Reviewed / Open Access / Int'l Joint Research
  • [Journal Article] Saliency-Detection-Based Quantization Parameter Setting Method for HEVC2018

    • Author(s)
      Katayama Takafumi、Tanaka Hiroki、Song Tian、Shimamoto Takashi
    • Journal Title

      IEEJ Transactions on Electronics, Information and Systems

      Volume: 138 Issue: 10 Pages: 1185-1186

    • DOI

      10.1541/ieejeiss.138.1185

    • NAID

      130007491401

    • ISSN
      0385-4221, 1348-8155
    • Year and Date
      2018-10-01
    • Related Report
      2018 Research-status Report
    • Peer Reviewed
  • [Journal Article] Boundary correlation-based intracoding for SHVC algorithm and its efficient VLSI architecture2018

    • Author(s)
      Katayama Takafumi、Song Tian、Shi Wen、Jiang Xiantao、Shimamoto Takashi
    • Journal Title

      Journal of Real-Time Image Processing

      Volume: 15 Issue: 1 Pages: 107-122

    • DOI

      10.1007/s11554-018-0786-8

    • Related Report
      2018 Research-status Report
    • Peer Reviewed / Open Access
  • [Journal Article] Fast CU Determination Algorithm Based on Convolutional Neural Network for HEVC2018

    • Author(s)
      Takafumi Katayama, Tian Song, Wen Shi, Xiantao Jiang and Takashi Shimamoto
    • Journal Title

      International Journal of Machine Learning and Computing

      Volume: 8 Issue: 5 Pages: 442-446

    • DOI

      10.18178/ijmlc.2018.8.5.726

    • Related Report
      2018 Research-status Report
    • Peer Reviewed / Open Access
  • [Journal Article] Hardware Oriented Low-Complexity Intra Coding Algorithm for SHVC2017

    • Author(s)
      KATAYAMA Takafumi、SONG Tian、SHI Wen、FUJITA Gen、JIANG Xiantao、SHIMAMOTO Takashi
    • Journal Title

      IEICE Transactions on Fundamentals of Electronics, Communications and Computer Sciences

      Volume: E100.A Issue: 12 Pages: 2936-2947

    • DOI

      10.1587/transfun.E100.A.2936

    • NAID

      130006236501

    • ISSN
      0916-8508, 1745-1337
    • Related Report
      2017 Research-status Report
    • Peer Reviewed
  • [Journal Article] Fast Edge Detection and Early Depth Decision for Intra Coding of 3D-HEVC2017

    • Author(s)
      Takafumi Katayama, Tian Song, Wen Shi, Xiantao Jiang and Takashi Shimamoto
    • Journal Title

      International Journal of Advances in Computer and Electronics Engineering

      Volume: 2 Pages: 11-20

    • Related Report
      2017 Research-status Report
    • Peer Reviewed / Open Access
  • [Journal Article] Hardware Implementation-Oriented Fast Intra-Coding Based on Downsampling Information for HEVC2017

    • Author(s)
      Wen Shi, Tian Song, Takafumi Katayama, Xiantao Jiang and Takashi Shimamoto
    • Journal Title

      Journal of Real-Time Image Processing

      Volume: 3 Issue: 1 Pages: 1-15

    • DOI

      10.1007/s11554-017-0677-4

    • Related Report
      2017 Research-status Report
    • Peer Reviewed / Open Access / Int'l Joint Research / Acknowledgement Compliant
  • [Presentation] An Adaptive Selection Method of Screen Content Coding Tools for Educational Video System2020

    • Author(s)
      Zhang Hongyi, Tian Song, Takafumi Katayama, Takashi Shimamoto and Zhao Liping
    • Organizer
      The 6th International Forum on Advanced Technologies 2020 (IFAT2020)
    • Related Report
      2019 Annual Research Report
  • [Presentation] Low Bitrate VVC-based Drone Video Coding System2020

    • Author(s)
      Soichiro Iino, Tian Song, Takafumi Katayama and Takashi Shimamoto
    • Organizer
      The 6th International Forum on Advanced Technologies 2020 (IFAT2020)
    • Related Report
      2019 Annual Research Report
  • [Presentation] Input Bit Reduction for a Low Cost Neural ODE2020

    • Author(s)
      Takafumi Katayama, Tian Song, Leu Shiou Jenq and Takashi Shimamoto
    • Organizer
      The 6th International Forum on Advanced Technologies 2020 (IFAT2020)
    • Related Report
      2019 Annual Research Report
  • [Presentation] Machine Learning based Underwater Depth Estimation2020

    • Author(s)
      Satoshi Minamoto, Tian Song, Takafumi Katayama and Takashi Shimamoto
    • Organizer
      The 6th International Forum on Advanced Technologies 2020 (IFAT2020)
    • Related Report
      2019 Annual Research Report
  • [Presentation] Bitrate Fluctuation Control Method for VVC-based Drone Video Coding System2020

    • Author(s)
      Soichiro Iino, Tian Song, Takafumi Katayama and Takashi Shimamoto
    • Organizer
      Proceedings of RISP International Workshop on Nonlinear Circuits, Communications and Signal Processing(NCSP'20)
    • Related Report
      2019 Annual Research Report
    • Int'l Joint Research
  • [Presentation] CenterNet based Object Detection System for 360-degree Panorama Video System2020

    • Author(s)
      Yuki Kakiuchi, Tian Song, Takafumi Katayama and Takashi Shimamoto
    • Organizer
      Proceedings of RISP International Workshop on Nonlinear Circuits, Communications and Signal Processing(NCSP'20)
    • Related Report
      2019 Annual Research Report
    • Int'l Joint Research
  • [Presentation] GAN-based Color Correction for Underwater Object Detection2019

    • Author(s)
      Takafumi Katayama, Tian Song, Takashi Shimamoto and Xiantao Jiang
    • Organizer
      OCEANS19 MTS/IEEE Seattle, 1-4, Seattle, Oct. 2019
    • Related Report
      2019 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Proposal-Aware Visual Saliency Detection with Semantic Attention2019

    • Author(s)
      Lu Wang, Tian Song, Takafumi Katayama and Takashi Shimamoto
    • Organizer
      International Conference on Intelligence Science and Big Data Engineering (IScIDE 2019)
    • Related Report
      2019 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Improvement of Cross Component Prediction by Multiple Liner Prediction for HEVC2019

    • Author(s)
      Fumiya Kitawaki, Tian Song, Takafumi Katayama, Xiantao Jiang and Takashi Shimamoto
    • Organizer
      Proceedings of International Technical Conference on Circuits/Systems, Computers and Communications(ITC-CSCC2019)
    • Related Report
      2019 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Fast Object Detection Algorithm using Encoded Video Information2018

    • Author(s)
      Takafumi Katayama, Koki Tamura, Tian Song and Takashi Shimamoto
    • Organizer
      IEEE CASS Shanghai and Shikoku Chapters Joint Workshop on Circuits and Systems
    • Related Report
      2018 Research-status Report
    • Int'l Joint Research
  • [Presentation] QP Adaptation Algorithm for Low Complexity HEVC based on a CNN-Generated Header Bits Map2018

    • Author(s)
      Takafumi Katayama, Tian Song and Takashi Shimamoto
    • Organizer
      Proceedings of IEEE 8th International Conference of Consumer Electronics in Berlin
    • Related Report
      2018 Research-status Report
    • Int'l Joint Research
  • [Presentation] Multi-line Intra Prediction for Inter-Layer Reference in SHVC2018

    • Author(s)
      Koki Tamura, Takafumi Katayama, Tian Song and Takashi Shimamoto
    • Organizer
      Proceedings of Taiwan and Japan Conference on Circuits and Systems
    • Related Report
      2018 Research-status Report
  • [Presentation] Fast PU Size Decision Algorithm Using RD-Cost and Depth Dispersion for Depth Intra Coding of 3D-HEVC2018

    • Author(s)
      Shota Yusa, Takafumi Katayama, Tian Song and Takashi Shimamoto
    • Organizer
      Proceedings of Taiwan and Japan Conference on Circuits and Systems
    • Related Report
      2018 Research-status Report
  • [Presentation] Efficient Object Detection Algorithm using Encoded Video Information2018

    • Author(s)
      Takafumi Katayama, Koki Tamura, Tian Song and Takashi Shimamoto
    • Organizer
      Proceedings of Taiwan and Japan Conference on Circuits and Systems
    • Related Report
      2018 Research-status Report
  • [Presentation] Learning Library Extension for Sea Cucumber Recognition using GANs2018

    • Author(s)
      Kunihito Hatai, Ryota Fujiki, Akinori Sanda, Wen Shi, Takafumi Katayama, Tian Song and Takashi Shimamoto
    • Organizer
      Proceedings of International Technical Conference on Circuits/Systems, Computers and Communications
    • Related Report
      2018 Research-status Report
  • [Presentation] Fast Object Detection System Based on the Embedded Information in the Bitstream2018

    • Author(s)
      Akinori Sanda, Kunihito Hatai, Ryota Fujiki, Takafumi Katayama, Tian Song and Takashi Shimamoto
    • Organizer
      Proceedings of International Technical Conference on Circuits/Systems, Computers and Communications
    • Related Report
      2018 Research-status Report
  • [Presentation] Low-Complexity Intra Coding Algorithm Based on Convolutional Neural Network for HEVC2018

    • Author(s)
      Takafumi Katayama, Kazuki Kuroda, Wen Shi, Tian Song and Takashi Shimamoto
    • Organizer
      Proceedings of 2018 International Conference on Information and Computer Technologies (ICICT2018)
    • Related Report
      2017 Research-status Report
    • Int'l Joint Research
  • [Presentation] Efficient Intra Prediction Based on Adaptive Downsampling Signal for Parallel HEVC Encoding2018

    • Author(s)
      Wen Shi, Takafumi Katayama, Tian Song and Takashi Shimamoto
    • Organizer
      Proceedings of IEEE International Conference on Consumer Electronics(ICCE2018)
    • Related Report
      2017 Research-status Report
    • Int'l Joint Research
  • [Presentation] Hardware-oriented Low Complexity Motion Estimation for HEVC2018

    • Author(s)
      Yoshiki Ito, Tian Song, Wen Shi, Takafumi Katayama and Takashi Shimamoto
    • Organizer
      Proceedings of IEEE International Conference on Consumer Electronics(ICCE2018)
    • Related Report
      2017 Research-status Report
    • Int'l Joint Research
  • [Presentation] Early Mode Selection of High Resolution for HEVC Base on Bits-Mapping,2018

    • Author(s)
      Kazuki Kuroda, Takafumi Katayama, Tian Song and Takashi Shimamoto
    • Organizer
      Proceedings of IEEE International Conference on Consumer Electronics(ICCE2018)
    • Related Report
      2017 Research-status Report
    • Int'l Joint Research
  • [Presentation] Pixel-based Fast CU Depth Decision Algorithm with Edge Strength for HEVC2018

    • Author(s)
      Takafumi Katayama, Wen Shi, Tian Song and Takashi Shimamoto
    • Organizer
      Proceedings of IEEE International Conference on Consumer Electronics(ICCE2018)
    • Related Report
      2017 Research-status Report
    • Int'l Joint Research
  • [Presentation] Coding Efficiency Improvement Algorithm for Inter-Layer Reference Prediction in SHVC2017

    • Author(s)
      Koki Tamura, Takafumi Katayama, Wen Shi, Tian Song and Takashi Shimamoto
    • Organizer
      Proceedings of International Technical Conference on Circuits/Systems, Computers and Communications(ITC-CSCC2017)
    • Related Report
      2017 Research-status Report
    • Int'l Joint Research
  • [Presentation] Fast CU Depth Decision Algorithm Using Depth-Map for 3D-HEVC2017

    • Author(s)
      Shota YusaShota Yusa, Takafumi Katayama, Wen Shi, Tian Song and Takashi Shimamoto
    • Organizer
      Proceedings of International Technical Conference on Circuits/Systems, Computers and Communications(ITC-CSCC2017)
    • Related Report
      2017 Research-status Report
    • Int'l Joint Research
  • [Presentation] Training Library Generation for Automatic Sea Cucumber Recognition2017

    • Author(s)
      Ryota Fujiki, Yuhki Yano, Tian Song, Takashi Shimamoto and Nobutatsu Nakamura
    • Organizer
      Proceedings of International Technical Conference on Circuits/Systems, Computers and Communications(ITC-CSCC2017)
    • Related Report
      2017 Research-status Report
    • Int'l Joint Research
  • [Presentation] A Coding Efficiency Improvement Algorithm for Future Video Coding2017

    • Author(s)
      Jiang Xiantao, Wang XiaoFeng, Yang Yadong, Tian Song, Shi Wen and Katayama Takafumi
    • Organizer
      IFIP International Federation for Information Processing 2017
    • Related Report
      2017 Research-status Report
    • Int'l Joint Research

URL: 

Published: 2017-04-28   Modified: 2022-02-22  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi