• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

Spatio-Temporal Analysis and its Mixed-Reality-Based Visualization of Video Images of Environmental Cameras towards Safe and Efficient Viewing

Research Project

Project/Area Number 23300064
Research Category

Grant-in-Aid for Scientific Research (B)

Allocation TypeSingle-year Grants
Section一般
Research Field Perception information processing/Intelligent robotics
Research InstitutionUniversity of Tsukuba

Principal Investigator

KAMEDA Yoshinari  筑波大学, システム情報系, 准教授 (70283637)

Co-Investigator(Kenkyū-buntansha) OHTA Yuichi  筑波大学, 学内共同利用施設等, 副学長 (50115804)
KITAHARA Itaru  筑波大学, システム情報系, 准教授 (70323277)
Project Period (FY) 2011-04-01 – 2015-03-31
Project Status Completed (Fiscal Year 2014)
Budget Amount *help
¥13,520,000 (Direct Cost: ¥10,400,000、Indirect Cost: ¥3,120,000)
Fiscal Year 2014: ¥2,340,000 (Direct Cost: ¥1,800,000、Indirect Cost: ¥540,000)
Fiscal Year 2013: ¥2,210,000 (Direct Cost: ¥1,700,000、Indirect Cost: ¥510,000)
Fiscal Year 2012: ¥2,470,000 (Direct Cost: ¥1,900,000、Indirect Cost: ¥570,000)
Fiscal Year 2011: ¥6,500,000 (Direct Cost: ¥5,000,000、Indirect Cost: ¥1,500,000)
Keywords複合現実感技術 / 映像解析 / 時空間解析 / 多カメラ観測 / RGB-Dカメラ / 可視化 / 知能情報 / 一人称映像 / 拡張現実 / RGB-D映像 / 画像処理 / 4D映像 / AR / アクセス権 / プライバシー
Outline of Final Research Achievements

It is mandatory to provide a new social frame in which the relationship between video sensors / files and their users is clearly defined so as to integrate environmental cameras into our good and sound community infrastructure.
In our research project, we define the camera and its viewing range spatiotemporally so that we can examine which cameras and which part of the videos are closely related with its potential users. Then, based on the described relationship and space-time analysis over the video, we succeeded in proposing a new method of identifying the cameras and segmenting viewing ranges that should be assigned to a user. We also investigate a new method of visualizing the subspace which are covered by the identified cameras. In the latter part of the project, we also succeeded in proposing a new interaction method between a user and the recorded RGB-D video that can clearly shows the advantage of utilizing environmental cameras in our society.

Report

(5 results)
  • 2014 Annual Research Report   Final Research Report ( PDF )
  • 2013 Annual Research Report
  • 2012 Annual Research Report
  • 2011 Annual Research Report
  • Research Products

    (52 results)

All 2015 2014 2013 2012 2011 Other

All Journal Article (15 results) (of which Peer Reviewed: 14 results) Presentation (34 results) Remarks (3 results)

  • [Journal Article] A Virtual Camera Controlling Method Using Multi-Touch Gestures for Capturing Free-Viewpoint Video2013

    • Author(s)
      Junya Kashiwakuma, Itaru Kitahara, Yoshinari Kameda, and Yuichi Ohta
    • Journal Title

      11th Europian Interactive TV Conference

      Volume: - Pages: 67-74

    • Related Report
      2013 Annual Research Report
    • Peer Reviewed
  • [Journal Article] Body Motion Design for Maneuvering a Virtual Camera in 3D Soccer Game2013

    • Author(s)
      Yasushi Yamagiri, Itau Kitahara, Yoshinari Kameda, and Yuichi Ohta
    • Journal Title

      Proceedings of 23th International Conference on Artificial Reality and Telexistence (ICAT2013), A Poster

      Volume: - Pages: 1-2

    • Related Report
      2013 Annual Research Report
    • Peer Reviewed
  • [Journal Article] AR Replay in a Small Workspace2013

    • Author(s)
      Yun Li, Yoshinari Kameda, and Yuichi Ohta
    • Journal Title

      Proceedings of 23th International Conference on Artificial Reality and Telexistence (ICAT2013)

      Volume: - Pages: 97-101

    • Related Report
      2013 Annual Research Report
    • Peer Reviewed
  • [Journal Article] USBブータブルなAR/MRプログラム開発・検証環境(Casper Cartridge Project)2013

    • Author(s)
      亀田 能成
    • Journal Title

      電子情報通信学会会誌, vol.96, no.7

      Volume: 96 Pages: 512-515

    • NAID

      110009625137

    • Related Report
      2013 Annual Research Report
  • [Journal Article] Facial Micro-Expression Detection in Hi-Speed Video Based on Facial Action Coding System (FACS)2013

    • Author(s)
      Senya Polikovsky, Yoshinari Kameda, Yuichi Ohta
    • Journal Title

      The Transactions of the IEICE D

      Volume: vol.E96-D, no.1 Pages: 81-92

    • NAID

      10031167382

    • Related Report
      2012 Annual Research Report
    • Peer Reviewed
  • [Journal Article] Benchmark Driven Framework for Development of Emotion Sensing Support Systems2012

    • Author(s)
      Senya Polikovsky, Maria Alejandra Quiros-Ramirez, Yoshinari Kameda, Judee Burgoon, Yuichi Ohta
    • Journal Title

      Workshop on Innovation in Border Control 2012

      Volume: -

    • Related Report
      2012 Annual Research Report
    • Peer Reviewed
  • [Journal Article] A Non-Invasive Multi-Sensor Capturing System for Human Physiological and Behavioral Responses Analysis2012

    • Author(s)
      Senya Polikovsky, Maria Alejandra Quiros-Ramirez, Takehisa Onisawa, Yoshinari Kameda, Yuichi Ohta
    • Journal Title

      First IAPR TC3 Workshop on Multimodal Pattern Recognition of Social Signals in Human-Computer-Interaction (MPRSS)

      Volume: LNAI-7742 Pages: 63-70

    • DOI

      10.1007/978-3-642-37081-6_8

    • ISBN
      9783642370809, 9783642370816
    • Related Report
      2012 Annual Research Report
    • Peer Reviewed
  • [Journal Article] Towards Developing Robust Multimodal Databases for Emotion Analysis2012

    • Author(s)
      Maria Alejandra Quiros-Ramirez, Senya Polikovsky, Yoshinari Kameda, Takehisa Onisawa
    • Journal Title

      The 6th International Conference on Soft Computing and Intelligent Systems

      Volume: -

    • Related Report
      2012 Annual Research Report
    • Peer Reviewed
  • [Journal Article] 録画された移動物体行動の複合現実型提示における一覧性の向上2012

    • Author(s)
      長島 正典, 林 将之, 北原 格, 亀田 能成, 大田 友一
    • Journal Title

      日本バーチャルリアリティ学会論文誌

      Volume: vol.17, no.4 Pages: 447-456

    • Related Report
      2012 Annual Research Report
    • Peer Reviewed
  • [Journal Article] CHLAC特徴量の錐制約部分空間表現による動作分類2012

    • Author(s)
      佐藤竜太, 亀田能成, 大田友一
    • Journal Title

      電子情報通信学会論文誌D

      Volume: J95D,No.3 Pages: 645-655

    • NAID

      110009418773

    • Related Report
      2011 Annual Research Report
    • Peer Reviewed
  • [Journal Article] 広域屋外環境における複合現実型バーチャルジオラマインタフェースの評価2011

    • Author(s)
      林将之, 北原格, 亀田能成, 大田友一
    • Journal Title

      日本バーチャルリアリティ学会論文誌

      Volume: Vol.16, No.2 Pages: 215-225

    • Related Report
      2011 Annual Research Report
    • Peer Reviewed
  • [Journal Article] 正確で直感的なカメラ操作を可能とする両手を用いた自由視点映像撮影インタフェース2011

    • Author(s)
      渡邊哲哉, 北原格, 亀田能成, 大田友一
    • Journal Title

      電子情報通信学会論文誌D

      Volume: J95D,No.3 Pages: 687-696

    • NAID

      110009418777

    • Related Report
      2011 Annual Research Report
    • Peer Reviewed
  • [Journal Article] Indoor-Outdoor Navigation System for Visually-Impaired Pedestrians : Preliminary Evaluation of Position Measurement and Obstacle Display2011

    • Author(s)
      Takeshi Kurata, Masakatsu Kourogi, Tomoya Ishikawa, Yoshinari Kameda, Kyota Aoki, Jun Ishikawa
    • Journal Title

      The Fifteenth International Symposium on Wearable Computing

      Pages: 123-124

    • Related Report
      2011 Annual Research Report
    • Peer Reviewed
  • [Journal Article] Evaluation of Syhchronization Accuracy Between High Speed Cameras in Infrared and Visible Spectrums2011

    • Author(s)
      Senya Polikovsky, Yoshinari Kameda, Yuichi Ohta
    • Journal Title

      Proceedings of IAPR Conference on Machine Vision Applications

      Pages: 51-54

    • Related Report
      2011 Annual Research Report
    • Peer Reviewed
  • [Journal Article] A User Study on Viewpoint Manipulation Methods for Diorama-Based Interface Utilizing Mobile Device Pose in Outdoor Environment2011

    • Author(s)
      Masayuki Hayashi, Itaru Kitahara, Yoshinari Kameda, Yuichi Ohta
    • Journal Title

      Proceedings of 21st International Conference on Artificial Reality and Telexistence

      Pages: 41-46

    • Related Report
      2011 Annual Research Report
    • Peer Reviewed
  • [Presentation] タブレット端末を用いたシースルービジョン時の運動視差が奥行き知覚に与える影響2015

    • Author(s)
      河内 駿, 北原 格, 亀田 能成, 大田 友一
    • Organizer
      電子情報通信学会 技術研究報告MVE, vol.114, no.487, pp.33-80, 2015.
    • Place of Presentation
      東京都 成蹊大学
    • Year and Date
      2015-03-03 – 2015-03-04
    • Related Report
      2014 Annual Research Report
  • [Presentation] 歩行者ナビゲーションを目的とした経路映像の画像解析2015

    • Author(s)
      樽見 佑亮, 亀田 能成, 大田 友一
    • Organizer
      電子情報通信学会 技術研究報告MVE, vol.114, no.487, pp.187-192, 2015.
    • Place of Presentation
      東京都 成蹊大学
    • Year and Date
      2015-03-03 – 2015-03-04
    • Related Report
      2014 Annual Research Report
  • [Presentation] Trajectory Estimation of a Fast and Anomalously Moving Badminton Shuttle2015

    • Author(s)
      Hidehiko Shishido, Itaru Kitahara, Yoshinari Kameda, and Yuichi Ohta
    • Organizer
      Joint Conference of IWAIT and IFMIA, 2015.
    • Place of Presentation
      台湾 National Cheng Kung University
    • Year and Date
      2015-01-11 – 2015-01-13
    • Related Report
      2014 Annual Research Report
  • [Presentation] 自動走行ストレス:拡張現実提示によるストレス軽減の試み2014

    • Author(s)
      笹井 翔太, 北原 格, 亀田 能成, 大田 友一, 神原 誠之, 浮田 宗伯, 池田 徹志, Morales Yoichi, 萩田 紀博, 篠沢 一彦
    • Organizer
      電子情報通信学会 技術研究報告ITS, vol.114, no.369, pp.93-98, 2014.
    • Place of Presentation
      熊本県 熊本大学
    • Year and Date
      2014-12-18 – 2014-12-19
    • Related Report
      2014 Annual Research Report
  • [Presentation] AR Replayを通じた作業理解の評価2014

    • Author(s)
      李 云, 亀田 能成, 大田 友一
    • Organizer
      電子情報通信学会 技術研究報告MVE, vol.114, no.239, pp.7-12, 2014.
    • Place of Presentation
      北海道 洞爺湖文化センター
    • Year and Date
      2014-10-09 – 2014-10-10
    • Related Report
      2014 Annual Research Report
  • [Presentation] Introduction of the Trakmark Activity2014

    • Author(s)
      Fumihisa Shibata, Koji Makita, Yoshinari Kameda, and Takeshi Kurata
    • Organizer
      IEEE ISMAR 2014, 2014.
    • Place of Presentation
      ドイツ ミュンヘン工科大学
    • Year and Date
      2014-09-11 – 2014-09-13
    • Related Report
      2014 Annual Research Report
  • [Presentation] TrakMark: AR/MRトラッキングのベンチマーク2014

    • Author(s)
      牧田 孝嗣, 林 将之, 蔵田 武志, 亀田 能成, 佐藤 智和
    • Organizer
      電子情報通信学会 技術研究報告MVE
    • Place of Presentation
      大阪大学
    • Related Report
      2013 Annual Research Report
  • [Presentation] 経路上での事前の移動撮影映像を用いたスナップショット撮影位置の推定2014

    • Author(s)
      樽見 佑亮, 亀田 能成, 大田 友一
    • Organizer
      電子情報通信学会 技術研究報告MVE
    • Place of Presentation
      別府国際コンベンションセンタ
    • Related Report
      2013 Annual Research Report
  • [Presentation] RGB-Dカメラを用いた教示者の作業のAR再表示2014

    • Author(s)
      李 云, 亀田 能成, 大田 友一
    • Organizer
      電子情報通信学会 技術研究報告MVE
    • Place of Presentation
      別府国際コンベンションセンタ
    • Related Report
      2013 Annual Research Report
  • [Presentation] Acquisition of Enhanced 3D Video Stream by Analyzing Static Property of the Scene Taken by Rgb-D Camera2013

    • Author(s)
      Yun Li, Yoshinari Kameda, and Yuichi Ohta
    • Organizer
      The Sixth Korea-Japan Workshop on Mixed Reality (KJMR13)
    • Place of Presentation
      OIST Seaside House, Okinawa
    • Related Report
      2013 Annual Research Report
  • [Presentation] 歩行経路記録映像における画像検索性能評価2013

    • Author(s)
      樽見 佑亮, 亀田 能成, 大田 友一
    • Organizer
      SSII2013 第19回画像センシングシンポジウム
    • Place of Presentation
      パシフィコ横浜
    • Related Report
      2013 Annual Research Report
  • [Presentation] 自由視点映像閲覧に適した全身身体動作の検討2013

    • Author(s)
      山桐 靖史, 北原 格, 亀田 能成, 大田 友一
    • Organizer
      第12回情報科学技術フォーラム(FIT2013)
    • Place of Presentation
      鳥取大学
    • Related Report
      2013 Annual Research Report
  • [Presentation] 投影型複合現実感と建物模型を用いたインタラクティブな内外観提示方式2013

    • Author(s)
      張 明, 北原 格, 亀田 能成, 大田 友一
    • Organizer
      日本バーチャルリアリティ学会第18回大会論文集
    • Place of Presentation
      うめきた・グランフロント大阪
    • Related Report
      2013 Annual Research Report
  • [Presentation] Projective Indices for AR/MR Benchmarking in Trakmark2013

    • Author(s)
      Masayuki Hayashi, Koji Makita, Takeshi Kurata, Itaru Kitahara, Yoshinari Kameda, and Yuichi Ohta
    • Organizer
      IEEE ISMAR 2013 Joint Workshop onTracking Methods & Applications and TrakMark
    • Place of Presentation
      Adelaide, Australia
    • Related Report
      2013 Annual Research Report
  • [Presentation] Introduction of Trakmark and its Standardization Activity at Iso/iec Jtc 1/sc 24/wg 92013

    • Author(s)
      Yoshinari Kameda and Takeshi Kurata
    • Organizer
      IEEE ISMAR 2013 Joint Workshop onTracking Methods & Applications and TrakMark
    • Place of Presentation
      Adelaide, Australia
    • Related Report
      2013 Annual Research Report
  • [Presentation] 物体が存在し得る錐体空間の多重スリットによる可視化2013

    • Author(s)
      中野 一成, 亀田 能成, 大田 友一
    • Organizer
      電子情報通信学会 技術研究報告MVE.
    • Place of Presentation
      福岡工業大学
    • Related Report
      2012 Annual Research Report
  • [Presentation] 仮想車両の複合現実型提示による交差点死角の車両認識支援2013

    • Author(s)
      森田 航平, 北原 格, 亀田 能成, 大田 友一
    • Organizer
      電子情報通信学会 2012年総合大会.
    • Place of Presentation
      岐阜大学
    • Related Report
      2012 Annual Research Report
  • [Presentation] 広域空間で撮影した人物の簡素な形状モデルによる可視化手法の提案2013

    • Author(s)
      君島 直城, 北原 格, 亀田 能成, 大田 友一
    • Organizer
      電子情報通信学会 2012年総合大会.
    • Place of Presentation
      岐阜大学
    • Related Report
      2012 Annual Research Report
  • [Presentation] 歩行経路上の位置推定のための画像検索性能評価2013

    • Author(s)
      樽見 佑亮, 亀田 能成, 大田 友一
    • Organizer
      電子情報通信学会 2012年総合大会.
    • Place of Presentation
      岐阜大学
    • Related Report
      2012 Annual Research Report
  • [Presentation] 歩行経路記録映像における画像検索性能評価2013

    • Author(s)
      樽見 佑亮, 亀田 能成, 大田 友一
    • Organizer
      第19回画像センシングシンポジウム (SSII2013)
    • Place of Presentation
      岐阜大学
    • Related Report
      2012 Annual Research Report
  • [Presentation] 遠方の景観を昼間の映像で表現した複合現実型夜間映像提示2012

    • Author(s)
      清水諒, 北原格, 亀田能成, 大田友一
    • Organizer
      電子情報通信学会2012年総合大会講演論文集(情報・システム講演論文集2),pp.179
    • Place of Presentation
      岡山大学
    • Year and Date
      2012-03-22
    • Related Report
      2011 Annual Research Report
  • [Presentation] 屋外におけるジオラマ型インタフェースを用いたパン・チルトカメラの可視化2012

    • Author(s)
      林将之, 北原格, 亀田能成, 大田友一
    • Organizer
      電子情報通信学会2012年総合大会講演論文集(情報・システム講演論文集2),pp.180
    • Place of Presentation
      岡山大学
    • Year and Date
      2012-03-22
    • Related Report
      2011 Annual Research Report
  • [Presentation] 入口での多方向撮影を利用した駐車場における車両追跡2012

    • Author(s)
      田邊健, 北原格, 亀田能成, 大田友一
    • Organizer
      電子情報通信学会2012年総合大会講演論支集(情報・システム講演論文集2),pp.190
    • Place of Presentation
      岡山大学
    • Year and Date
      2012-03-22
    • Related Report
      2011 Annual Research Report
  • [Presentation] ユーザの身体動作を用いた自由視点映像閲覧インタフェースの検討2012

    • Author(s)
      山桐靖史, 北原格, 亀田能成, 大田友一
    • Organizer
      電子情報通信学会2012年総合大会講演論文集(情報・システム講演論文集2),pp.134
    • Place of Presentation
      岡山大学
    • Year and Date
      2012-03-20
    • Related Report
      2011 Annual Research Report
  • [Presentation] Multisensory Video Database of Physiological and Behavioral Responses2012

    • Author(s)
      Senya Polikovsky, Alejandra Quiros, Yoshinari Kameda, Judee Burgoon, Yuichi Ohta
    • Organizer
      Israel Machine Vision Conference and Exhibition 2012
    • Place of Presentation
      Avenuew Conference Centsr, Airport City, Israel
    • Year and Date
      2012-02-09
    • Related Report
      2011 Annual Research Report
  • [Presentation] A New Noninvasive Multi-Sensor Capturing System for Human Physiological and Behavioral Responses Analysis During the Interview2012

    • Author(s)
      Senya Polikovsky, Yoshinari Kameda, Yuichi Ohta
    • Organizer
      The 30th International Congress of Psychology, Panel, 2012.
    • Place of Presentation
      South Africa
    • Related Report
      2012 Annual Research Report
  • [Presentation] シーン中の3次元点群の投影誤差によるAR/MR向けカメラキャリブレーションの精度評価2012

    • Author(s)
      林 将之, 北原 格, 亀田 能成, 大田 友一
    • Organizer
      電子情報通信学会 技術研究報告MVE.
    • Place of Presentation
      北海道根室市
    • Related Report
      2012 Annual Research Report
  • [Presentation] Uniform Software Environment for AR Performance Evaluation based on USB Boot Linux2012

    • Author(s)
      Yoshinari Kameda, Itaru Kitahara, Yuichi Ohta
    • Organizer
      International Workshop on Benchmark Test Schemes for AR/MR Geometric Registration and Tracking Method (TrakMark) (in conjunction with ICPR2012)
    • Place of Presentation
      茨城県つくば市
    • Related Report
      2012 Annual Research Report
  • [Presentation] 人物が存在し得る部分空間の多重スリット表現による可視化2012

    • Author(s)
      中野 一成, 亀田 能成, 大田 友一
    • Organizer
      HCGシンポジウム2012, pp.105-110, 2012.
    • Place of Presentation
      熊本県熊本市
    • Related Report
      2012 Annual Research Report
  • [Presentation] A Study of Camera Tracking Evaluation on Trakmark Data-Set2011

    • Author(s)
      Masayuki Hayashi, Itaru Kitahara, Yoshinari Kameda, Yuichi Ohta
    • Organizer
      The 2nd International Workshop on AR/MR Registration, Tracking and Benchmarking Workshop in conjunction with ISMAR11
    • Place of Presentation
      Basel, Switzerland
    • Year and Date
      2011-10-27
    • Related Report
      2011 Annual Research Report
  • [Presentation] AR/MRデモンストレーショの再現性を保証するソフトウェア環境の構築-Casper Cartridgeプロジェクト-2011

    • Author(s)
      林将之, 北原格, 亀田能成, 大田友一
    • Organizer
      電子情報通信学会技術研究報告MVE,vol.111,no.235,pp.103-108
    • Place of Presentation
      北海道稚内市
    • Year and Date
      2011-10-14
    • Related Report
      2011 Annual Research Report
  • [Presentation] マルチタッチ操作を用いた自由視点映像閲覧法の検討2011

    • Author(s)
      柏熊淳也, 北原格, 亀田能成, 大田友一
    • Organizer
      日本バーチャルリアリティ学会第16回大会論文集
    • Place of Presentation
      はこだて未来大学
    • Year and Date
      2011-09-22
    • Related Report
      2011 Annual Research Report
  • [Presentation] 画像・GPS等のセンサ統合による屋内外視覚障害者歩行支援システムの評価2011

    • Author(s)
      湯瀬裕昭, 石川准, 青山知靖, 亀田能成, 青木恭太, 村山慎二郎, 蔵田武志, 興椙正克, 石川智也
    • Organizer
      マルチメディア,分散,協調とモバイル(DICOMO2011)シンポジウム
    • Place of Presentation
      京都府宮津市
    • Year and Date
      2011-07-07
    • Related Report
      2011 Annual Research Report
  • [Presentation] Semi-Realistic View Generation of a Player in Soccer Match2011

    • Author(s)
      Nozomu Kasuya, Itaru Kitahara, Yoshinari Kameda, Yuichi Ohta
    • Organizer
      The Fourth Korea-Japan Workshop on Mixed Reality
    • Place of Presentation
      Osaka, Japan
    • Year and Date
      2011-04-16
    • Related Report
      2011 Annual Research Report
  • [Remarks] 研究プロジェクト紹介

    • URL

      http://www.image.esys.tsukuba.ac.jp

    • Related Report
      2014 Annual Research Report
  • [Remarks] 学会発表一覧

    • URL

      http://www.kameda-lab.org/research/publication/

    • Related Report
      2013 Annual Research Report
  • [Remarks]

    • URL

      http://www.kameda-lab.org/research/

    • Related Report
      2011 Annual Research Report

URL: 

Published: 2011-04-06   Modified: 2019-07-29  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi