• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

Efficient learning algorithms based on infomation compression

Research Project

Project/Area Number 05452349
Research Category

Grant-in-Aid for General Scientific Research (B)

Allocation TypeSingle-year Grants
Research Field 計算機科学
Research InstitutionTohoku University

Principal Investigator

JIMBO Shuji  Tohoku Univ., Faculty of Engineering, Assistant, 工学部, 助手 (00226391)

Co-Investigator(Kenkyū-buntansha) ASO Hirotomo  Tohoku Univ., Faculty of Engineering, Professor, 工学部, 教授 (10005522)
TAKIMOTO Eiji  Tohoku Univ., Graduate School of Information Sciences, Assistant, 大学院・情報科学研究科, 助手 (50236395)
MARUOKA Akira  Tohoku Univ., Graduate School of Information Sciences, Professor, 大学院・情報科学研究科, 教授 (50005427)
Project Period (FY) 1993 – 1994
Project Status Completed (Fiscal Year 1994)
Budget Amount *help
¥7,500,000 (Direct Cost: ¥7,500,000)
Fiscal Year 1994: ¥700,000 (Direct Cost: ¥700,000)
Fiscal Year 1993: ¥6,800,000 (Direct Cost: ¥6,800,000)
KeywordsPAC learning model / Learning algorithm / Information compression / VC dimension / Monotonicity / Conservativeness / Monotone DNF / Character feature for pattern matching / PAC学習アルゴリズム / サンプル数
Research Abstract

1. Information compressing and gaining mechanism in learning process
In PAC learning model a learning algorithm is expected to produce a hypothesis that approximates a target function by using a sequence of examples of the target. On the other hand the notion of an information compressing algorithm, called an Occan algorithm, has been introduced and its relation to a PAC learning algorithm has been investigated. It has been shown that an Occam algorithm is immediately a PAC learning algorithm, while a PAC learning algorithm can be modified to obtain a randomized Occam algorithm.
We investigate relationship between these types of algorithms. We show that a PAC learning algorithm is not necessarily an Occam algorithm by giving a counter example. Reasonal conditions, called preservability and monotonicity, which natural PAC learning algorithms are expected to satisfy are introduced. And it is conjectured that a PAC learning algorithm becomes immediately an Occam algorithm under any of these … More two conditions. Although the conjecture has not been proved so far, it is verified that the statement holds under some technical conditions. Furthermore, a motion of an information gaining algorithm is introduced and its relation to a PAC learning algorithm and an information compressing algorithm is explored.
2. Learning of disjunctive normal form formulae
In the field of computational learning it is one of the most important open problems to decide whether or not disjunctive normal form (DNF) formulae are learnable form examples. The main results obtained are stated as follows : Monotone DNF formulae with log n terms are learnable from positive examples ; New Boolean functions, called kappa term functions, are learnable from examples.
3. Computational complexity and appoximate computation
Computational resources needed for learning depend on the complexity of its target. Various issues, such as Boolean complexity, approximate computation, pseudo-randomness, concerning computational complexity of target functions are investigated.
4. Extracting character feature on pattern matching
When character recognition is implemented by using the method of pattern matching, it is crucial how to make a feature vector for each character pattern. In view of information compression, the problem of defining the feature vectors for precies recognition is investigated. Less

Report

(3 results)
  • 1994 Annual Research Report   Final Research Report Summary
  • 1993 Annual Research Report
  • Research Products

    (20 results)

All Other

All Publications (20 results)

  • [Publications] Eiji Takimoto: "Conservativeness and monotonicity for learning algorithms" Sixth ACM Conference on Computational Learning Theory. 377-383 (1993)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      1994 Final Research Report Summary
  • [Publications] Eiji Takimoto: "On the sample complexity of consistent learning with one-sided error" Proc.of the Workshop on Algorithmic Learning Theory. 265-278 (1993)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      1994 Final Research Report Summary
  • [Publications] 阿曽弘具: "文字特徴量空間の性質と特徴抽出法の性能評価法" 電子情報通信学会論文誌 D‐II,J76‐D‐II. 2285-2294 (1993)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      1994 Final Research Report Summary
  • [Publications] Yoshifumi Sakai: "Learning monotone log-term DNF formulas" Seventh ACM Conference on Computational Learning Theory. 165-172 (1994)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      1994 Final Research Report Summary
  • [Publications] Eiji Takimoto: "Mutual Information gaining algorithm and its relation to PAC-learning algorithm" Proc.of the Workshop on Algorithmic Learning Theory. 547-559 (1994)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      1994 Final Research Report Summary
  • [Publications] Shuji Jimbo: "A method of constructing selection networks with O(log n)depth" SIAM Journal on Computing. (発表予定).

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      1994 Final Research Report Summary
  • [Publications] Eiji Takimoto: "Conservativeness and monotonicity for learning algorithms" Sixth ACM Conference on Computational Learning Theory. 377-383 (1993)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      1994 Final Research Report Summary
  • [Publications] Eiji Takimoto: "On the sample complexity of consistent learning with one-sided error" Proc. of the Workshop on Algorithmic Learning Theory. 265-278 (1993)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      1994 Final Research Report Summary
  • [Publications] Hirotomo Aso: "Structural properties of character feature space and evaluation of effectiveness of features" Trans. IEICE. J76-D-II. 2285-2294 (1993)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      1994 Final Research Report Summary
  • [Publications] Yoshifumi, Sakai: "Learning monotone log-term DNF formulas" Seventh ACM Conference on Computational Learning Theory. 165-172 (1994)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      1994 Final Research Report Summary
  • [Publications] Eiji Takimoto: "Mutual Information gaining algorithm and its relation to PAC-learning algorithm" Proc. of the Workshop on Algorithmic Learning Theory. 547-559 (1994)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      1994 Final Research Report Summary
  • [Publications] Shuji Jimbo: "A method of constructing selection networks with O (log n) depth" SIAM Journal on Computing. (To be appeared).

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      1994 Final Research Report Summary
  • [Publications] Eiji Takimoto: "Conservativeness and monotonicity for learning algorithms" Computational Learning Theory. 377-383 (1993)

    • Related Report
      1994 Annual Research Report
  • [Publications] Eiji Takimoto: "On the sample complexity of consistent learning with one-sided error" Algorithmic Learning Theory. 278-265 (1993)

    • Related Report
      1994 Annual Research Report
  • [Publications] 阿曽弘具: "文字特徴量空間の性質と特徴抽出法の性能評価法" 電子情報通信学会論文誌D-II,J76-D-II. 2285-2294 (1993)

    • Related Report
      1994 Annual Research Report
  • [Publications] Yoshifumi Sakai: "Learning monotone log-term DNF formulas" Seventh ACM Conference on Computational Learning Theory. 165-172 (1994)

    • Related Report
      1994 Annual Research Report
  • [Publications] Eiji Takimoto: "Mutual Information gaining algorithm and its relation to PAC-learning algorithm" Proc.of the Workshop on Algorithmic Learning Theory. 547-559 (1994)

    • Related Report
      1994 Annual Research Report
  • [Publications] Shuji Jimbo: "A method of constructing selection networks with O(log n)depth" SIAM Journal on Computing. (発表予定).

    • Related Report
      1994 Annual Research Report
  • [Publications] Eiji Takimoto: "Conservativeness and monotonicity for learning algorithms" Computational Learning Theory. 377-383 (1993)

    • Related Report
      1993 Annual Research Report
  • [Publications] Eiji Takimoto: "On the sample complexity of consistent learning with one-sided error" Algorithmic Learning Theory. 265-278 (1993)

    • Related Report
      1993 Annual Research Report

URL: 

Published: 1993-04-01   Modified: 2025-11-19  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi