• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

Study on Multimedia Teaching Material by Hyper-Media and Content Analysis of Lecture Videos

Research Project

Project/Area Number 11480081
Research Category

Grant-in-Aid for Scientific Research (B)

Allocation TypeSingle-year Grants
Section一般
Research Field Intelligent informatics
Research InstitutionRyukoku University

Principal Investigator

YASUO Ariki  Ryukoku University, Electronics and Informatics PROFESSOR, 理工学部・電子情報学科, 教授 (10135519)

Co-Investigator(Kenkyū-buntansha) KUMANO Masahito  Ryukoku University, Electronics and Informatics Assistant, 理工学部・電子情報学科, 実験助手 (50319498)
KAWAKAMI Hajimu  Ryukoku University, Electronics and Informatics Lecturere, 理工学部・電子情報学科, 講師 (60298734)
KOBUCHI Yoichi  Ryukoku University, Electronics and Informatics PROFESSOR, 理工学部・電子情報学科, 教授 (60025450)
Project Period (FY) 1999 – 2001
Project Status Completed (Fiscal Year 2001)
Budget Amount *help
¥13,000,000 (Direct Cost: ¥13,000,000)
Fiscal Year 2001: ¥3,200,000 (Direct Cost: ¥3,200,000)
Fiscal Year 2000: ¥3,100,000 (Direct Cost: ¥3,100,000)
Fiscal Year 1999: ¥6,700,000 (Direct Cost: ¥6,700,000)
KeywordsDigital archive / Hyperlink / Speech dictation / Video summarization / Confidence / Content description / Similar Video / Telop / ディジタル・アーカイビング / シーンカット検出 / 相互情報量を考慮したTF-IDF / 隠れマルコフモデル / テロップ・フリップ
Research Abstract

Main results of this study from 1999 to 2001 are summarized into seven points as follows;
1. Indexing to spoken documents based on high speed and high accurate speech recognition: Speech decoding based on phonemes or words error minimization was proposed as well as iterative adaptation of acoustic models in unsupervised mode.
2. Indexing to noisy speech based on noise and BGM robust speech recognition: Speech recognition based on non-stationary as well as stationary noise reduction was proposed by using Kalman filter and MLLR.
3. Speaker indexing based on speaker recognition: Speaker recognition based on phoneme and speaker separation was proposed and individual person was indexed based on the proposed method.
4. Indexing to video image based on character and image recognition: Video caption or flip recognition was proposed by carrying out the video caption frame selection, effective binarization and OCR.
5. Topic segmentation based on speech and character recognition: News videos were segmented into individual topic based on word space method proposed in this study. In commercial video, the topic segmentation was proposed by integrating video caption recognition and speech recognition.
6. Structuring and content description to video image: Table of contents of video images was produced after indexing and topic segmentation.
7. Topic retrieval and summarization for hyperlink construction: Cross media retrieval was proposed as well as the video clip extraction where the specific person was speaking about the specific topics.

Report

(4 results)
  • 2001 Annual Research Report   Final Research Report Summary
  • 2000 Annual Research Report
  • 1999 Annual Research Report
  • Research Products

    (65 results)

All Other

All Publications (65 results)

  • [Publications] 西田昌史, 緒方淳, 有木康雄: "アナウンサー発話の自動抽出とニュースディクテーションによる記事分類"情報処理学会論文誌. 第40巻,第4号. 1482-1490 (1999)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2001 Final Research Report Summary
  • [Publications] S.Sakamoto, Y.Kobuchi: "Convergence Property of Topographic Mapping Formation from Cell Layer to Cell Layer through Correlation Learning Rule"Neural Networks. Vol.13,No7-8. 11-20 (2000)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2001 Final Research Report Summary
  • [Publications] 西田昌史, 有木康雄: "話者固有空間における動的・静的特徴統合による話者照合"電子情報通信学会論文誌. Vol.83-D-II, No.12. 2536-2544 (2000)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2001 Final Research Report Summary
  • [Publications] 鷹尾誠一, 有木康雄, 緒方淳: "クロスメディア・パッセージ検索・テロップやCGフリップ文字列を検索質問とした発話文書に対する検索方式"電子情報通信学会論文誌. Vol.84-D-II, No.8. 1809-1816 (2001)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2001 Final Research Report Summary
  • [Publications] 緒方淳, 有木康雄: "大語彙連続音声認識における最ゆう単語back-off接続を用いた効率的なN-best探索法"電子情報通信学会論文誌. Vol.84-D-II, No.12. 2489-2500 (2001)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2001 Final Research Report Summary
  • [Publications] 藤本雅清, 有木康雄: "カルマンフィルタに基づく音声信号推定法を用いた雑音環境下での音声認識"電子情報通信学会論文誌. Vol.85-D-II, No.1. 1-11 (2002)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2001 Final Research Report Summary
  • [Publications] 西田昌史, 有木康雄: "音韻性を抑えた話者空間への射影による話者認識"電子情報通信学会論文誌. Vol.85-D-II, No.4. 554-562 (2002)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2001 Final Research Report Summary
  • [Publications] M.Nishida, Y.Ariki: "Speaker Indexing for News Articles, Debates and Drama in Broadcasted TV programs"Proc.of International Conference on Multimedia Computing and Sysems(ICMCS99). Vol.2. 466-471 (1999)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2001 Final Research Report Summary
  • [Publications] Y.Ariki, K.Matsuura: "Automatic Classifications of TV news Articles Based on Telop Character Recognition"Proc.of International Conference on Multimedia Computing and Sysems(ICMCS99). 148-152 (1999)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2001 Final Research Report Summary
  • [Publications] S.Takao, Y.Ariki, J.Ogata: "Segmentation and Classification of TV News Articles Based on Speech Dictation"Proc.of Ten Region Conference(TENCON99). 92-95 (1999)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2001 Final Research Report Summary
  • [Publications] Y.Ariki, S.Takao: "Extraction and Recognition of Open Captions Superimposed on TV News Articles"Proc.of Asian Conference on Computer Vision 2000(ACCV00). 675-680 (2000)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2001 Final Research Report Summary
  • [Publications] Y.Ariki, S.Takao: "Study on New Term Weighting Method and New Vector Space Model Based on Word Space in Spoken Document Retrieval"Proc.of the Int'l Conf.on Recherche d'Informations Assistee par Ordinateur(RIAO'00). 116-131 (2000)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2001 Final Research Report Summary
  • [Publications] M.Fujimoto, J.Ogata, Y.Ariki: "Large Vocabulary Continuous Speech Recognition under Real Environments Using Adaptive Sub-Band Spectral Subtraction"Proc.of the Sixth Int'l Conf.on Spoken Language Processing(ICSLP'00). Vol.I. 305-308 (2000)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2001 Final Research Report Summary
  • [Publications] S.Takao, J.Ogata, Y.Ariki: "Topic Segmentation of News Speech Using Word Similarity"Proc.of the eighth ACM Multimedia Conference(ACM MM2000). 442-444 (2000)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2001 Final Research Report Summary
  • [Publications] M.Fujimoto, Y.Ariki: "Continuous Speech Recognition under Non-stationary Musical Environments Based on Speech State Transition Model"Proc.of IEEE Int'l Conf.on Acoustics, Speech and Signal Processing(ICASSP'01). SPEECH-P15.3,Vol.I. 297-300 (2000)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2001 Final Research Report Summary
  • [Publications] S.TAKAO, T.HARU, Y.ARIKI: "Summarization of News Speech with Unknown Topic Boundary"CD-ROM Proceedings of International Conference on Multimedia and Expo(ICME2001). 23-25 (2001)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2001 Final Research Report Summary
  • [Publications] J.Ogata, Y.Ariki: "Improved Speech Recognition Using Iterative Decoding Based on Confidence Measures"Proc.of 7'th European Conference on Speech Communication and Technology(EUROSPEECH2001). Vol.IV. 2577-2580 (2001)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2001 Final Research Report Summary
  • [Publications] M.Fujimoto, Y.Ariki: "Speech Recognition under Musical Environments Using Kalman Filter and Iterative MLLR Adaptation"Proc.of 7'th European Conference on Speech Communication and Technology(EUROSPEECH2001). Vol.III. 1879-1882 (2001)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2001 Final Research Report Summary
  • [Publications] S.Takao, Y.Ariki, H.Matsumoto: "Segmentation of Goods Catalog Video Based on Video Caption"Proc.of the Int'l Workshop on Multimedia Information Retrieval 2001(MIR2001). 56-59 (2001)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2001 Final Research Report Summary
  • [Publications] 西田正吾, 美濃導彦編著: "情報メディア工学(第12章 映像を理解する仕組み執筆分担)"オーム社. 170 (1999)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2001 Final Research Report Summary
  • [Publications] 長尾 真, 安西祐一郎, 岸野文郎, 西尾章治郎編集: "岩波講座 マルチメディア情報学(第8巻情報の構造化と検索 第3章メディア解析からのアプローチ執筆分担)"岩波書店. 303 (2000)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2001 Final Research Report Summary
  • [Publications] Masafumi Nasshida, Jun Ogata, and Yasuo Ariki: "News Article Classification by Speech Dictation for Automatically Extracted Announcer Utterance"IPSJ Journal. Vol. 40 No. 4. 1482-1490 (1999)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2001 Final Research Report Summary
  • [Publications] S. Sakamoto, Y. Kobuchi: "Convergence Property of Topographic Mapping Formation from Cell Layer to Cell Layer through Correlation Learning Rule"Neural Networks. Vol. 13, No. 7-8. 11-20 (2000)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2001 Final Research Report Summary
  • [Publications] Masaftimi Nishida, Yasuo Ariki: "Speaker Verification by Integrating Dynamic and Static Features in Speaker Eigenspace"Trans. JEICE. D-IIJ83-D-IINo. 12. 2536-2544 (2000)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2001 Final Research Report Summary
  • [Publications] Sinichi Takao, Jun Ogata, and Yasuo Ariki: "Cross Media Passage level Retrieval Access Method to Spoken Documents by Telop and CG Flip Character Strings as Queries"Trans. JEICE. D-IIJ84-D-IINo. 8. 1809-1816 (2001)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2001 Final Research Report Summary
  • [Publications] Jun Ogata, Yasuo Ariki: "An Efficient N-Best Search Method Using Best-Word Back-off Connection in Large Vocabulary Continuous Speech Recognition"Trans. IEICE. DII J84-D-II, No. 12. 2489-2500 (2001)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2001 Final Research Report Summary
  • [Publications] M. Fujimoto, Y. Ariki: "Speech Recognition under Noisy Environments Using Speech Signal Estimation Method Based on Kalman Filter"Trans. IEICE. D II J85-D-II, No. 1. 1-11 (2002)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2001 Final Research Report Summary
  • [Publications] Masafmi Nishida, Yasuo Ariki: "Speaker Recognition by Projecting Speaker Space with Less Phonetic Information"Trans. IEICE. D-IIJ84-D-IINo. 4. 554-562 (2001)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2001 Final Research Report Summary
  • [Publications] M. Nishida, Y. Ariki: "Speaker Indexing for N」WS Articles, Debates and Drama in Broadcasted TV programs"Proc. of International Conference on Mutinedua Computing and Systems (ICMCS99). Vol. 2. 466-471 (1999)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2001 Final Research Report Summary
  • [Publications] Y. Ariki, K. Matsuura: "Automatic Classifications fo TV and nees Articles Based on Telop Character Recognition"Proc. of International Conference on Mutinedua Computing and Systems (ICMCS99). 148-152 (1999)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2001 Final Research Report Summary
  • [Publications] S. Takao, Y. Ariki and J. Ogata: "Segmentation and Classification of TV News Articles Based on Speech Dictation"Proc. of the Region Conference (TENCON99). 92-95 (1999)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2001 Final Research Report Summary
  • [Publications] Y. Ariki, S. Takao: "Extraction and Recognition of Open Captions Superimposed on TV News Articles"Proc. of Asian Conference on Computer Vision 2000 (ACCV00). 675-680 (2000)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2001 Final Research Report Summary
  • [Publications] Y. Ariki, S. Takao: "Study on New Term Weighting Method and New Vector Space Model Based on Word Space in Spken Document Retrieval"Proc. of the Int'l Conf. on Recherche d'Information Assistee par Ordinateur (RLAO'00). 116-131 (2000)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2001 Final Research Report Summary
  • [Publications] M. Fujimoto, J. Ogata, Y. Ariki: "Large Vocabulary Continuous Speech Recognition under Real Environments using Adaptive Sub-Band Spectral Subtraction"Proc. of the Sixty Intl .Conf. on Spoken Language Processing (ICSLP). Vol. 1. 305-308 (2000)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2001 Final Research Report Summary
  • [Publications] S. Takao, J. Ogata and Y. Ariki: "Topic Segmentation of New Speech Using World Similarity"Proc. of the eighth ACM multimedia Conference (aaaaaaascm MM2000). 442-444 (2000)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2001 Final Research Report Summary
  • [Publications] M. Fujimoto, Y. Ariki: "Continuous Speech Recognition under Non-stationary Musical ENvironments Based on Speech State Transition Model"Proc. of IEEE Intl. Conf. on Acoustics, Speech and Signal Processing (ICASSP'01), SPEECH-P15,3. Vol. 1. 297-300 (2000)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2001 Final Research Report Summary
  • [Publications] S. TAKAO, T. HARU and Y. ARIKI: "Summarization of News Speech with Unknown Topic Boundary"Proceedings of International Conference on Multimedia and Expo (ICME2001). (CD-ROM). 23-25 (2001)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2001 Final Research Report Summary
  • [Publications] J. Ogata, Y. Ariki: "Improved Speech Recognition Using Iterative Decoding Based on Confidence Measures"Proc. of 7th European Conference on Speech Communication and Technology (EUROSPEECH2001). Vol. IV. 2577-2580 (2001)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2001 Final Research Report Summary
  • [Publications] M. Fujiimoto, Y. Ariki: "Speech Recognition under Musical Environments Using Kalman Filter and Interative MLLR Adaptation"Proc. of 7th European Conference on Speech Communication and Technology (EUROSPEECH2001). Vol. III. 1879-1882 (2001)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2001 Final Research Report Summary
  • [Publications] S. Takao, Y. Ariki, and H. Matsumoto: "Segmentation of Goods Catalog Video Based on Video Caption"Proc. of the Int'l workshop on Multimedia Information Retrieval 2001 (MIR2001). 56-59 (2001)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2001 Final Research Report Summary
  • [Publications] 藤本雅清, 有木康雄: "カルマンフィルタに基づく音声信号推定法を用いた雑音環境下での音声認識"電子情報通信学会論文誌. Vol.85-D-II, No.1. 1-11 (2002)

    • Related Report
      2001 Annual Research Report
  • [Publications] 緒方淳, 有木康雄: "大語彙連続音声認識における最ゆう単語back-off接続を用いた効率的なN-best探索法"電子情報通信学会論文誌. Vol.84-D-II, No.12. 2489-2500 (2001)

    • Related Report
      2001 Annual Research Report
  • [Publications] 鷹尾誠一, 有木康雄, 緒方淳: "クロスメディア・パッセージ検索-テロップやCGフリップ文字列を検索質問とした発話文書に対する検索方式-"電子情報通信学会論文誌. Vol.84-D-II, No.8. 1809-1816 (2001)

    • Related Report
      2001 Annual Research Report
  • [Publications] S.Takao, Y.Ariki, H.Matsumoto: "Segmentation of Goods Catalog Video Based on Video Caption"Proc. of ACM Multimedia 2001 Workshops, Multimedia Information Retrieval. 56-59 (2001)

    • Related Report
      2001 Annual Research Report
  • [Publications] J.Ogata, Y.Ariki: "Improved Speech Recognition Using Iterative Decoding Based on Confidence Measures"EuroSpeech'2001. Vol.IV. 2577-2580 (2001)

    • Related Report
      2001 Annual Research Report
  • [Publications] M.Fujimoto, Y.Ariki: "Speech Recognition under Musical Environments Using Kalman Filter and Iterative MLLR Adaptation"EuroSpeech'2001. Vol.III. 1879-1882 (2001)

    • Related Report
      2001 Annual Research Report
  • [Publications] Sejichi TAKAO, Takaaki HARU, Yasno ARIKI: "Summarization of News Speech with Unknown Topic Boundary"CD-ROM Proceedings of ICME2001 (International Conference on Multimedia and Expo). 23-25 (2001)

    • Related Report
      2001 Annual Research Report
  • [Publications] M.Fujimoto, Y.Ariki: "Continuous Speech Recognition under Non-stationary Musical Environments Based on Speech State Transition Model"Proc. of IEEE Int'l Conf. on Acoustics, Speech and Signal Processing (ICASSP'01). SPEECH-P15.3,Vol.I. 297-300 (2001)

    • Related Report
      2001 Annual Research Report
  • [Publications] 西田昌史, 有木康雄: "音韻性を抑えた話者空間への射影による話者認識"電子情報通信学会論文誌. Vol.D-II. (2002)

    • Related Report
      2001 Annual Research Report
  • [Publications] M.Nishida, Y.Ariki: "Speaker Recognition by Separating Phonetic Space and Speaker Space"EuroSpeech'2001. Vol.II. 1381-1384 (2001)

    • Related Report
      2001 Annual Research Report
  • [Publications] S.Sakamoto, S.Seki, Y.Kobuchi: "Normalization Processes and Topographic Mapping Model Between Cell Layers Represented by Undirected Graphs"Journal of Japan Society for Fuzzy Theory and Systems. Vol.14,No1. 43-54 (2002)

    • Related Report
      2001 Annual Research Report
  • [Publications] 黒江 康明, 吉崎 好彦, 川上 肇, 森 武宏: "画像生成モデルを内包した学習による陰影画像からの形状復元問題の汎用性のある解法"計測自動制御学会論文集. Vol.37,No.7. 665-674 (2001)

    • Related Report
      2001 Annual Research Report
  • [Publications] 西田昌史,有木康雄: "話者固有空間における動的・静的特徴統合による話者照合"電子情報通信学会論文誌. DII. 2536-2544 (2000)

    • Related Report
      2000 Annual Research Report
  • [Publications] Yasuo Ariki: "Multimedia Technologies for Structuring and Retrieval of TV News"New Generation Computing. Vol18. 341-358 (2000)

    • Related Report
      2000 Annual Research Report
  • [Publications] Y.Ariki and S.Tako: "Study on New Term Weighting Method and New Vector Space Model Based on Word Space in Spoken Document Retrieval"RIAO00. 116-131 (2000)

    • Related Report
      2000 Annual Research Report
  • [Publications] Yasuo Ariki: "Organization and Retrieval of Continuous Media"ACM MIR2000. 221-226 (2000)

    • Related Report
      2000 Annual Research Report
  • [Publications] S.Sakamoto and Y.Kobuchi: "Convergence Property of Topographic Mapping Formation from Cell Layer to Cell Layer through Correlation Learning Rule"Neural Networks. Vol.13 No.7-8. 11-20 (2000)

    • Related Report
      2000 Annual Research Report
  • [Publications] Y.Kobuchi,T.Saito,and H.Nunome: "Semantics analysis through elementary meanings-Theoretical foundation for generalized thesaurus construction-"Acta Informatica. Vol.37. 1-19 (2000)

    • Related Report
      2000 Annual Research Report
  • [Publications] 有木康雄,西田昌史,緒方 淳: "アナウンサー発話の自動抽出とニュースディクテーションによる記事分類"情報処理学会論文誌. 第40巻・第4号. 1482-1490 (1999)

    • Related Report
      1999 Annual Research Report
  • [Publications] Y.Ariki and K.Matsuura: "Automatic Classifications of TV news Articles Based on Telop Character Recognition"ICMCS99. 148-152 (1999)

    • Related Report
      1999 Annual Research Report
  • [Publications] Y.Ariki,S.Takao and J.Ogata: "Segmentation and Classification of TV News Articles Based on Speech Dictation"TENCON99. 92-95 (1999)

    • Related Report
      1999 Annual Research Report
  • [Publications] 川上肇,寺裏浩一,黒江康明,森武宏: "ニューラルネットワークを用いた画像の動き場の推定法〜マッチング法と勾配法の融合〜"第9回インテリジェント・システム・シンポジウム講演論文集. 581-582 (1999)

    • Related Report
      1999 Annual Research Report
  • [Publications] 川上肇,小山亮彦,小淵洋一: "色相情報に備わる周期性を考慮したカラー画像照合"電子情報通信学会,パターン認識・メディア理解研究会. (2000)

    • Related Report
      1999 Annual Research Report
  • [Publications] 川上肇,村井聖,黒江康明,森武宏: "ニューラルネットワークを用いた陰影画像からの形状復元法〜物体表面の反射特性の同時推定"第27回知能システムシンポジウム講演論文集. (2000)

    • Related Report
      1999 Annual Research Report
  • [Publications] 西田正吾・美濃導彦(第12章執筆分担有木康雄): "オーム社"情報メディア工学. (1999)

    • Related Report
      1999 Annual Research Report

URL: 

Published: 1999-04-01   Modified: 2016-04-21  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi