• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

Tactile texture feature extraction based on visual texture analysis

Research Project

Project/Area Number 20K20399
Project/Area Number (Other) 18H05394 (2018-2019)
Research Category

Grant-in-Aid for Challenging Research (Pioneering)

Allocation TypeMulti-year Fund (2020)
Single-year Grants (2018-2019)
Review Section Medium-sized Section 61:Human informatics and related fields
Research InstitutionRitsumeikan University

Principal Investigator

TANAKA HIROMI  立命館大学, 情報理工学部, 教授 (10268154)

Co-Investigator(Kenkyū-buntansha) 加藤 ジェーン  立命館大学, 情報理工学部, 教授 (70251882)
Project Period (FY) 2018-06-29 – 2022-03-31
Project Status Completed (Fiscal Year 2021)
Budget Amount *help
¥20,670,000 (Direct Cost: ¥15,900,000、Indirect Cost: ¥4,770,000)
Fiscal Year 2020: ¥6,760,000 (Direct Cost: ¥5,200,000、Indirect Cost: ¥1,560,000)
Fiscal Year 2019: ¥7,280,000 (Direct Cost: ¥5,600,000、Indirect Cost: ¥1,680,000)
Fiscal Year 2018: ¥6,630,000 (Direct Cost: ¥5,100,000、Indirect Cost: ¥1,530,000)
Keywords質感認知 / 質感再現 / 視触覚的質感 / 触覚的質感 / 高解像度画像解析 / 摩擦特徴抽出 / VR触察体験 / 質感表現 / 視覚的質感 / 視覚的触覚
Outline of Research at the Start

CVやCG,心理物理学,脳科学の分野において,視覚的かつ触覚的な質感認知の研究が国際的に注目されている. 本研究は, 視覚的質感情報の解析から触覚的質感情報を推定することを目的とし, 表面微小構造における光沢等の変化を観測した超高解像度画像解析に基づき,視覚的質感特徴である光沢から触覚的質感特徴である触察時における摩擦を推定することを研究する.本研究課題が達成されれば,質感表現や質感再現技術を進展させ,触覚通信に応用されれば,遠隔医療や娯楽,通信販売など様々な分野で応用が大きく進展する.

Outline of Final Research Achievements

We 1)constructed an omnidirectional ultra-high resolution multi-viewpoint multiple-exposure image measurement system with a pixel of 3.45 μm, 2) proposed a method of classifying the materials from BTF of the target material, and a method of estimating the friction force of metal and rigid body material harder than human fingertips, 3) developed a device to measure the aspect of contact traced with a fingertip and proposed a method to estimate the friction force of deformable material from the acquired true contact area, 4) proposed a method for estimating the bending rigidity based on the correlation between the bending of the yarn of the fabric and the bending rigidity and showed the possibility of estimating the friction force from the visual texture information.
We 5) constructed a human fingertip simulator (deformation model) and a tactile simulation that presents the stick-slip phenomenon during tactile sensation.

Academic Significance and Societal Importance of the Research Achievements

触感の提示は視覚的質感認知を向上させることが報告されているが,織物のように複雑な表面微小構造と複雑な光学特性と変形特性をもつ物体の,視覚的質感情報のみから数マイクロメートルスケールの触覚的質感情報を抽出する研究は未だ報告されておらず,極めて挑戦的な研究である.
本研究課題が達成されれば,質感表現や質感再現技術を進展させ,有形無形文化財などのデジタル視触覚展示や体験学習を実現する.また,触覚通信に応用されれば,3)触知感と質感を提供する触覚通信が実現され情報通信技術の概念が一変し,遠隔医療や娯楽,通信販売など様々な分野で応用が大きく進展する.

Report

(5 results)
  • 2021 Annual Research Report   Final Research Report ( PDF )
  • 2020 Research-status Report
  • 2019 Annual Research Report
  • 2018 Annual Research Report
  • Research Products

    (28 results)

All 2021 2020 2019 2018

All Journal Article (6 results) (of which Peer Reviewed: 5 results,  Open Access: 4 results) Presentation (22 results) (of which Int'l Joint Research: 5 results,  Invited: 1 results)

  • [Journal Article] Rethinking the Rotation Invariance of Local Convolutional Features for Content-Based Image Retrieval2021

    • Author(s)
      Longjiao Zhao, Yu Wang and Jien Kato
    • Journal Title

      IEICE Transactions on Information and Systems

      Volume: E104.D Issue: 1 Pages: 174-182

    • DOI

      10.1587/transinf.2020EDP7017

    • NAID

      130007965068

    • ISSN
      0916-8532, 1745-1361
    • Year and Date
      2021-01-01
    • Related Report
      2020 Research-status Report
    • Peer Reviewed / Open Access
  • [Journal Article] 行動認識のためのTwo-stream 3D BagNet2021

    • Author(s)
      王彧,加藤ジェーン
    • Journal Title

      画像ラボ

      Volume: Vol.32, No.2 Pages: 34-39

    • Related Report
      2020 Research-status Report
  • [Journal Article] Predicting Violence Rating Based on Pairwise Comparison2020

    • Author(s)
      Ying Ji, Yu Wang, Jien Kato and Kensaku Mori
    • Journal Title

      IEICE Transactions on Information and Systems

      Volume: E103.D Issue: 12 Pages: 2578-2589

    • DOI

      10.1587/transinf.2020EDP7056

    • NAID

      130007948511

    • ISSN
      0916-8532, 1745-1361
    • Year and Date
      2020-12-01
    • Related Report
      2020 Research-status Report
    • Peer Reviewed / Open Access
  • [Journal Article] Attention-Guided Spatial Transformer Networks for Fine-Grained Visual Recognition2019

    • Author(s)
      LIU Dichao、WANG Yu、KATO Jien
    • Journal Title

      IEICE Transactions on Information and Systems

      Volume: E102.D Issue: 12 Pages: 2577-2586

    • DOI

      10.1587/transinf.2019EDP7045

    • NAID

      130007754406

    • ISSN
      0916-8532, 1745-1361
    • Year and Date
      2019-12-01
    • Related Report
      2019 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] Real-World Oriented Smartphone AR Supported Learning System Based on Planetarium Contents for Seasonal Constellation Observation2019

    • Author(s)
      Tian Ke、Urata Mayu、Endo Mamoru、Mouri Katsuhiro、Yasuda Takami、Kato Jien
    • Journal Title

      Applied Sciences

      Volume: 9 Issue: 17 Pages: 3508-3508

    • DOI

      10.3390/app9173508

    • Related Report
      2019 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] Visual Violence Rating with Pairwise Comparison2019

    • Author(s)
      Ji Ying、Wang Yu、Katoy Jien
    • Journal Title

      IEEE International Conference on Image Processing (ICIP 2019)

      Volume: ICIP 2019 Pages: 3332-3336

    • DOI

      10.1109/icip.2019.8803573

    • Related Report
      2019 Annual Research Report
    • Peer Reviewed
  • [Presentation] Reproduction of Takigi Noh Based on Anisotropic Reflection Rendering of Noh Costume with Dynamic Illumination2021

    • Author(s)
      Shiro Tanaka and Hiromi Tanaka
    • Organizer
      IEVC2021 The 7th IIEEJ International Conference on Image Electronics and Visual Computing
    • Related Report
      2021 Annual Research Report
    • Int'l Joint Research
  • [Presentation] 指先の固着・滑り制御型触覚ディスプレイの検討2021

    • Author(s)
      小川水規, 田川和義,
    • Organizer
      令和2年度電子情報通信学会 東海支部 卒業研究発表会
    • Related Report
      2021 Annual Research Report
  • [Presentation] 実指先のStick-Slip現象の計測環境の構築 -凹凸面への対応化-2021

    • Author(s)
      長澤海斗, 田川和義,
    • Organizer
      令和2年度電子情報通信学会 東海支部 卒業研究発表会
    • Related Report
      2021 Annual Research Report
  • [Presentation] テレセントリック光学系レンズおよび凹凸透明体を用いた指先滑りの 歪み無し計測法の提案2021

    • Author(s)
      和田佳久, 田川和義,
    • Organizer
      電気学会 電子・情報・システム部門 知覚情報研究会「複合現実型実 応用および一般」
    • Related Report
      2021 Annual Research Report
  • [Presentation] Contrastively-reinforced Attention Convolutional Neural Network for Fine-grained Image Recognition2020

    • Author(s)
      Dichao Liu, Yu Wang and Jien Kato,
    • Organizer
      The 31st British Machine Vision Conference (BMVC2020)
    • Related Report
      2020 Research-status Report
    • Int'l Joint Research
  • [Presentation] Multi-Task Attention Learning for Fine-grained Recognition2020

    • Author(s)
      Dichao Liu, Yu Wang Kenji Mase and Jien Kato
    • Organizer
      電子情報通信学会技術報告(PRMU), IEICE-PRMU2020-63
    • Related Report
      2020 Research-status Report
  • [Presentation] Rethinking the local similarity in content-based image retrieval2020

    • Author(s)
      Longjiao Zhao, Yu Wang, Yoshiharu Ishikawa and Jien Kato
    • Organizer
      電子情報通信学会技術報告(PRMU),PRMU2020-68
    • Related Report
      2020 Research-status Report
  • [Presentation] Two-stream 3D BagNetによる人物行動認識2020

    • Author(s)
      内田準也,王彧,加藤ジェーン
    • Organizer
      電子情報通信学会技術報告(PRMU)
    • Related Report
      2020 Research-status Report
  • [Presentation] 社会関係を活用した映像会話シーンにおける雰囲気の推定2020

    • Author(s)
      王彧,加藤ジェーン
    • Organizer
      電子情報通信学会技術報告(PRMU)
    • Related Report
      2020 Research-status Report
  • [Presentation] Estimating Absorption Coefficient of Primary Color Woven Fabric based on Geometrical Optics2020

    • Author(s)
      Shiro Tanaka and Hiromi Tanaka
    • Organizer
      The 26th Internatioal Workshop on Frontiers of Computer Vision (IW-FCV 2020)
    • Related Report
      2019 Annual Research Report
    • Int'l Joint Research
  • [Presentation] 動的照明による織物の異方性反射レンダリングに基づく薪能の再現2020

    • Author(s)
      田中士郎, 田中弘美
    • Organizer
      マルチメディア情報ハイディング・エンリッチメント(EMM)2019年度第6回研究会,
    • Related Report
      2019 Annual Research Report
  • [Presentation] 広域・狭域ネットワークを用いた歩行者検出2020

    • Author(s)
      小平美紗季,ワンユ,加藤ジェーン
    • Organizer
      電子情報通信学会技術報告(PRMU)
    • Related Report
      2019 Annual Research Report
  • [Presentation] Continuous Variables Estimation through Classification Networks Ensembles2020

    • Author(s)
      Qianyuan Liu, Yu Wang and Jien Kato
    • Organizer
      電子情報通信学会技術報告(PRMU)
    • Related Report
      2019 Annual Research Report
  • [Presentation] 織物の摩擦感推定のための視触覚情報の相関解析2020

    • Author(s)
      宮島正樹,趙隆コウ,田中士郎,田中弘美,王彧,加藤ジェーン
    • Organizer
      質感のつどい 第5回公開フォーラム
    • Related Report
      2019 Annual Research Report
  • [Presentation] Reproduction of Takigi Noh Based on Anisotropic Reflection Rendering of Noh Costume with Dynamic Illumination2019

    • Author(s)
      Shiro Tanaka and Hiromi T. Tanaka
    • Organizer
      IEEE International Conference on Computational Photography 2019 (ICCP2019)
    • Related Report
      2019 Annual Research Report
    • Int'l Joint Research
  • [Presentation] 原色の織物における三次元幾何光学計算に基づく吸収係数の推定2019

    • Author(s)
      田中士郎, 田中弘美
    • Organizer
      質感のつどい 第5回公開フォーラム
    • Related Report
      2019 Annual Research Report
  • [Presentation] 原色の織物における三次元幾何光学計算に基づく吸収係数推定2019

    • Author(s)
      田中士郎, 田中弘美
    • Organizer
      視覚情報基礎研究会 第38回研究発表会
    • Related Report
      2019 Annual Research Report
  • [Presentation] 柔軟物の視触覚情報処理と五感通信への応用2019

    • Author(s)
      田中 弘美
    • Organizer
      電子情報通信学会 技術研究報告
    • Related Report
      2018 Annual Research Report
    • Invited
  • [Presentation] Estimating Absorption Coefficient of Primary Color Woven Fabric2019

    • Author(s)
      Shiro Tanaka, Hiromi T. Tanaka
    • Organizer
      International Workshop on Frontiers of Computer Vision (IW-FCV2019)
    • Related Report
      2018 Annual Research Report
    • Int'l Joint Research
  • [Presentation] 原色の織物における繊維内部の光の伝搬に基づく吸収係数の推定2019

    • Author(s)
      田中 士郎, 田中 弘美
    • Organizer
      情報処理学会 研究報告
    • Related Report
      2018 Annual Research Report
  • [Presentation] 柔軟物における視覚的質感から触覚的質感の再現に向けて-硬さが摩擦係数に与える影響の解析-2018

    • Author(s)
      田中 士郎, 田中 弘美
    • Organizer
      第21回 画像の認識・理解シンポジウム(MIRU2018)
    • Related Report
      2018 Annual Research Report
  • [Presentation] 柔軟物を対象とした指先の触察により生じる摩擦のモデル化2018

    • Author(s)
      田中 士郎, 田中 弘美
    • Organizer
      質感のつどい 第4回公開フォーラム
    • Related Report
      2018 Annual Research Report

URL: 

Published: 2018-07-20   Modified: 2024-03-26  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi