• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

Error resilient virtual reality (VR) video streaming

Research Project

Project/Area Number 18K18036
Research Category

Grant-in-Aid for Early-Career Scientists

Allocation TypeMulti-year Fund
Review Section Basic Section 60060:Information network-related
Research InstitutionShizuoka University

Principal Investigator

Liu Zhi  静岡大学, 工学部, 助教 (90750240)

Project Period (FY) 2018-04-01 – 2021-03-31
Project Status Discontinued (Fiscal Year 2020)
Budget Amount *help
¥4,160,000 (Direct Cost: ¥3,200,000、Indirect Cost: ¥960,000)
Fiscal Year 2020: ¥1,300,000 (Direct Cost: ¥1,000,000、Indirect Cost: ¥300,000)
Fiscal Year 2019: ¥1,430,000 (Direct Cost: ¥1,100,000、Indirect Cost: ¥330,000)
Fiscal Year 2018: ¥1,430,000 (Direct Cost: ¥1,100,000、Indirect Cost: ¥330,000)
KeywordsVR映像 / ビデオストリーミング / ソースとチャネルコーディング / 誤り耐性 / マルチキャスト / 資源配分 / 最適化 / VR / video streaming / source/channel coding / error resilient / multicast / optimization / network / Video streaming / video / communication
Outline of Final Research Achievements

Virtual reality (VR) video provides an immersive 360-degree (views from every direction can be rendered and seen) viewing experience for users wearing a head-mounted display, i.e., as the user rotates his/her head, different fields-of-views (FoV) of the VR video are presented for observation accordingly. To further enhance its applications, networked VR is in critical demand. However, packet losses, which cannot be solved by the existing error resilient non-VR video streaming methods, are unavoidable because of channel fading and shadowing in wireless networks and network congestion and jitter in wired networks. To prevent the video quality deterioration caused by packet losses, this project aims to provide error resilient VR video streaming to maximize users’ received video quality. We have proposed optimal error resilient VR video streaming using source and channel coding, and optimized the multi-user VR video transmission in different scenarios.

Academic Significance and Societal Importance of the Research Achievements

仮想現実(VR)映像は人間に臨場感がある視聴体験を提供するので、教育、医療などの分野での応用が多数登場している。VR映像ストリーミングとは、多数のVR応用を実現するために不可欠である。
提案された最適な誤り耐性を有するVR映像ストリーミングは,チャネルのパケットロスを対応することができ,また,最適化されたマルチユーザVR映像伝送は,より高い受信映像品質をユーザに提供することができる。最適化の手法などは、他の同様の問題にも適用可能であると考えられる。

Report

(3 results)
  • 2020 Final Research Report ( PDF )
  • 2019 Annual Research Report
  • 2018 Research-status Report
  • Research Products

    (23 results)

All 2020 2019 2018 Other

All Int'l Joint Research (3 results) Journal Article (12 results) (of which Int'l Joint Research: 11 results,  Peer Reviewed: 12 results) Presentation (8 results) (of which Int'l Joint Research: 8 results)

  • [Int'l Joint Research] Shanghai Jiao Tong University/Hefei University of Technology/Peking University(中国)

    • Related Report
      2019 Annual Research Report
  • [Int'l Joint Research] VTT Technical Research Centre of Finland(フィンランド)

    • Related Report
      2019 Annual Research Report
  • [Int'l Joint Research] Shanghai Jiaotong University/Hefei University of Technology(中国)

    • Related Report
      2018 Research-status Report
  • [Journal Article] QoE-Driven Coupled Uplink and Downlink Rate Adaptation for 360-Degree Video Live Streaming2020

    • Author(s)
      Li Jie、Feng Ransheng、Sun Wei、Liu Zhi、Li Qiyue
    • Journal Title

      IEEE Communications Letters

      Volume: 24 Issue: 4 Pages: 863-867

    • DOI

      10.1109/lcomm.2020.2966193

    • Related Report
      2019 Annual Research Report
    • Peer Reviewed / Int'l Joint Research
  • [Journal Article] Age of Information Aware Radio Resource Management in Vehicular Networks: A Proactive Deep Reinforcement Learning Perspective2020

    • Author(s)
      Chen Xianfu、Wu Celimuge、Chen Tao、Zhang Honggang、Liu Zhi、Zhang Yan、Bennis Mehdi
    • Journal Title

      IEEE Transactions on Wireless Communications

      Volume: 19 Issue: 4 Pages: 2268-2281

    • DOI

      10.1109/twc.2019.2963667

    • Related Report
      2019 Annual Research Report
    • Peer Reviewed / Int'l Joint Research
  • [Journal Article] Optimal Multi-View Video Transmission in OFDMA Systems2020

    • Author(s)
      Xu Wei、Cui Ying、Liu Zhi、Li Haoran
    • Journal Title

      IEEE Communications Letters

      Volume: 24 Issue: 3 Pages: 667-671

    • DOI

      10.1109/lcomm.2019.2961355

    • Related Report
      2019 Annual Research Report
    • Peer Reviewed / Int'l Joint Research
  • [Journal Article] Optimal Multi-View Video Transmission in Multiuser Wireless Networks by Exploiting Natural and View Synthesis-Enabled Multicast Opportunities2020

    • Author(s)
      Xu Wei、Cui Ying、Liu Zhi
    • Journal Title

      IEEE Transactions on Communications

      Volume: 68 Issue: 3 Pages: 1494-1507

    • DOI

      10.1109/tcomm.2019.2954523

    • Related Report
      2019 Annual Research Report
    • Peer Reviewed / Int'l Joint Research
  • [Journal Article] Optimal Resource Allocation for Scalable Mobile Edge Computing2019

    • Author(s)
      Gao Yunlong、Cui Ying、Wang Xinyun、Liu Zhi
    • Journal Title

      IEEE Communications Letters

      Volume: 23 Issue: 7 Pages: 1211-1214

    • DOI

      10.1109/lcomm.2019.2916075

    • Related Report
      2019 Annual Research Report
    • Peer Reviewed / Int'l Joint Research
  • [Journal Article] Optimal Multicast of Tiled 360 VR Video2019

    • Author(s)
      Chengjun Guo, Ying Cui, Zhi Liu
    • Journal Title

      IEEE Wireless Communication Letter

      Volume: 8 Issue: 1 Pages: 145-148

    • DOI

      10.1109/lwc.2018.2864151

    • Related Report
      2018 Research-status Report
    • Peer Reviewed / Int'l Joint Research
  • [Journal Article] Mobile Edge Computing for the Internet of Vehicles: Offloading Framework and Job Scheduling2019

    • Author(s)
      Jingyun Feng, Zhi Liu, Celimuge Wu, Yusheng Ji
    • Journal Title

      IEEE Vehicular Technology Magazine

      Volume: 14 Issue: 1 Pages: 28-36

    • DOI

      10.1109/mvt.2018.2879647

    • Related Report
      2018 Research-status Report
    • Peer Reviewed
  • [Journal Article] JET: Joint Source and Channel coding for Error Resilient Virtual Reality Video Wireless Transmission Signal Processing2018

    • Author(s)
      Zhi Liu, Susumu Ishihara, Ying Cui, Yusheng Ji, Yoshiaki Tanaka
    • Journal Title

      Signal Processing (accepted)

      Volume: - Pages: 154-162

    • DOI

      10.1016/j.sigpro.2018.01.009

    • Related Report
      2018 Research-status Report
    • Peer Reviewed / Int'l Joint Research
  • [Journal Article] Multi-Quality Multicast Beamforming based on Scalable Video Coding2018

    • Author(s)
      Chengjun Guo, Ying Cui, Derrick Wing Kwan Ng, Zhi Liu
    • Journal Title

      IEEE Transactions on Communications

      Volume: 66 Pages: 5662-57677

    • Related Report
      2018 Research-status Report
    • Peer Reviewed / Int'l Joint Research
  • [Journal Article] Resource allocation for SVC streaming over cooperative vehicular networks2018

    • Author(s)
      Hao Zhou, Xiaoyan Wang, Zhi Liu, Shigeki Yamada, Yusheng Ji
    • Journal Title

      IEEE Transactions on Vehicular Technology

      Volume: 67 Issue: 9 Pages: 7942-7936

    • DOI

      10.1109/tvt.2018.2847325

    • Related Report
      2018 Research-status Report
    • Peer Reviewed / Int'l Joint Research
  • [Journal Article] Spatial Intelligence towards Smart Vehicles2018

    • Author(s)
      Celimuge Wu, Zhi Liu, Di Zhang, Tsutomu Yoshinaga, Yusheng Ji,
    • Journal Title

      IEEE Communication Magazine

      Volume: 56 Issue: 10 Pages: 22-27

    • DOI

      10.1109/mcom.2018.1800089

    • Related Report
      2018 Research-status Report
    • Peer Reviewed / Int'l Joint Research
  • [Journal Article] Optimal Multicast of Tiled 360 VR Video in OFDMA Systems2018

    • Author(s)
      Chengjun Guo, Ying Cui, Zhi Liu
    • Journal Title

      IEEE Communication Letter

      Volume: 22 Issue: 12 Pages: 2563-3566

    • DOI

      10.1109/lcomm.2018.2873005

    • Related Report
      2018 Research-status Report
    • Peer Reviewed / Int'l Joint Research
  • [Presentation] Demo abstract: NarWhal: a DASH-based Point Cloud Video Streaming over Wireless Networks2020

    • Author(s)
      Jie Li, Cong Zhang, Zhi Liu, Wei Sun, Wei Hu, Qiyue Li
    • Organizer
      IEEE International Conference on Computer Communications (INFOCOM)
    • Related Report
      2019 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Joint Communication and Computational Resource Allocation for QoE-driven Point Cloud Video Streaming2020

    • Author(s)
      Jie Li, Cong Zhang, Zhi Liu, Wei Sun, Qiyue Li
    • Organizer
      54th IEEE International Conference on Communications
    • Related Report
      2019 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Resource Assignment for Real-time Streaming in Edge Node- assisted Transmitting2019

    • Author(s)
      Wei Zhao, Lianwei Zhu, Xuangou Wu, Zhi Liu, Xiujun Wang, Ruilin Pan, Takahiro Hara
    • Organizer
      EEE Global Communications Conference (GLOBECOM) 2019 workshop
    • Related Report
      2019 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Optimal Transmission of Multi-Quality Tiled 360 VR Video by Exploiting Multicast Opportunities2019

    • Author(s)
      Kaixuan Long, Ying Cui, Chengcheng Ye, Zhi Liu
    • Organizer
      IEEE Global Communications Conference (GLOBECOM),
    • Related Report
      2019 Annual Research Report
    • Int'l Joint Research
  • [Presentation] oint Computing Resource and Data Allocation Optimization for MEC: An Online Approach2019

    • Author(s)
      Xun Shao, Go Hasegawa, Noriaki Kamiyama, Zhi Liu, Hiroshi Masui and Yusheng Ji
    • Organizer
      The 28th International Conference on Computer Communi- cations and Networks (ICCCN)
    • Related Report
      2019 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Optimal Multi-Quality Multicast for 360 Virtual Reality Video2018

    • Author(s)
      Kaixuan Long, Chencheng Ye, Ying Cui, Zhi Liu
    • Organizer
      IEEE Global Communications Conference (GLOBECOM)
    • Related Report
      2018 Research-status Report
    • Int'l Joint Research
  • [Presentation] Modeling QoE of Virtual Reality Video Transmission Over Wireless Networks2018

    • Author(s)
      Jie Li, Ransheng Feng, Zhi Liu, Wei Sun, Qiyue Li
    • Organizer
      IEEE Global Communications Conference (GLOBECOM)
    • Related Report
      2018 Research-status Report
    • Int'l Joint Research
  • [Presentation] Efficient Multi-View Video Trans- mission by Exploiting View Synthesis-Enabled Multicast Opportunities2018

    • Author(s)
      Wei Xu, Yuzhuo Wei, Ying Cui, Zhi Liu
    • Organizer
      IEEE Global Communications Conference (GLOBECOM)
    • Related Report
      2018 Research-status Report
    • Int'l Joint Research

URL: 

Published: 2018-04-23   Modified: 2022-01-27  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi