• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

Development of Classification Systems for Large-Scale Pattern Recognition Problems and Its Application

Research Project

Project/Area Number 14380151
Research Category

Grant-in-Aid for Scientific Research (B)

Allocation TypeSingle-year Grants
Section一般
Research Field Intelligent informatics
Research InstitutionHOKKAIDO UNIVERSITY

Principal Investigator

KUDO Mineichi  Hokkaido Univ., Grad.School of Info.Sci.and Tech., Prof., 大学院・情報科学研究科, 教授 (60205101)

Co-Investigator(Kenkyū-buntansha) MURAI Tetsyua  Hokkaido Univ., Grad.School of Info.Sci.and Tech., Assi.Prof., 大学院・情報科学研究科, 助教授 (90201805)
IMAI Hideyuki  Hokkaido Univ., Grad.School of Info.Sci.and Tech., Assi.Prof., 大学院・情報科学研究科, 助教授 (10213216)
TOYAMA Jun  Hokkaido Univ., Grad.School of Info.Sci.and Tech., Instructer, 大学院・情報科学研究科, 助手 (60197960)
TENMOTO Hiroshi  Kushiro National College of Tech., Dep.of Info.Eng., Assi.Prof., 情報工学科, 助教授 (80321371)
HAYASHI Hiroki  Kushiro National College of Tech., Dep.of Info.Eng., Assi.Prof., 情報工学科, 助教授 (60342440)
中村 篤祥  北海道大学, 大学院・情報科学研究科, 助教授 (50344487)
田中 章  北海道大学, 大学院・情報科学研究科, 助手 (20332471)
Project Period (FY) 2002 – 2005
Project Status Completed (Fiscal Year 2005)
Budget Amount *help
¥11,400,000 (Direct Cost: ¥11,400,000)
Fiscal Year 2005: ¥2,200,000 (Direct Cost: ¥2,200,000)
Fiscal Year 2004: ¥1,900,000 (Direct Cost: ¥1,900,000)
Fiscal Year 2003: ¥1,800,000 (Direct Cost: ¥1,800,000)
Fiscal Year 2002: ¥5,500,000 (Direct Cost: ¥5,500,000)
Keywordspattern recognition / large-scale problem / feature selection / generalization / class number / subclass / super-class / visualization / 個人認証 / 漢字認識 / センサー / データマイニング / 画像処理 / 識別
Research Abstract

In this study, we classified the scaling problems of pattern recognition tasks into three of the following. The results are shown below, respectively.
1.Scaling problem as for data number : We have changed the problem setting from the problem to achieve as high (predictive) performance as possible to the problem to attain as least computational time as possible keeping no large damage in performance. Especially, 1)a fast k-nearest neighbor was invented, and 2)a one-pass algorithm for prototype acquisition was discussed, though they are still under progress.
2.Scaling problem as for dimensionality : We concentrated on "feature selection" which removes low-informative features but keeps the classification performance. Solving this problem usually require a combinatorial examination, so many sub-optimal approaches have been proposed so far. However, they are not satisfactory in time for large-scale problems in the number of original features. In this study, we focused on "classifier-indepen … More dent feature selection" in which only garbage (completely no informative for classification) features are removed. Usual algorithms do "classifier-dependent feature selection." We showed that the former can be made faster than the latter, and a two-stage selection scheme (CIFS+CSFS) is efficient for feature selection.
3.Scaling problem as for cass number : As seen in Kanji-Character recognition, we sometimes have to deal with many categories. The difficulty of classification task increases as the class number increases. We proposed a way to analyze the relationship among classes and grouped some hard-to-classify classes into one "super class." In addition, we investigated a visualization method using a graph representation and a tree representation for making clear the relationship. In the decision tree, we confirmed that the total performance can be increased with feature selection. Last, we suggested that such super-classes and subclasses analysis is useful to capture the individual classification problems. Less

Report

(5 results)
  • 2005 Annual Research Report   Final Research Report Summary
  • 2004 Annual Research Report
  • 2003 Annual Research Report
  • 2002 Annual Research Report
  • Research Products

    (60 results)

All 2005 2004 2003 2002 Other

All Journal Article (47 results) Publications (13 results)

  • [Journal Article] An Extension of Rough Approximation Quality to Fuzzy Classification.2005

    • Author(s)
      V.N.Huynh et al.
    • Journal Title

      Rough Sets, Fuzzy Sets, Data Mining, and Granular Computing, Lecture Notes in Computer Science Vol.3641

      Pages: 373-382

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2005 Final Research Report Summary
  • [Journal Article] Optimal Division for Feature Selection and Classification.2005

    • Author(s)
      M.Kudo et al.
    • Journal Title

      Proceedings of the Workshop on Feature Selection for Data Mining : Interfacing Machine Learning and Statistics

      Pages: 106-107

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2005 Final Research Report Summary
  • [Journal Article] Extraction of Generalized Rules with Automated Attribute Abstraction.2005

    • Author(s)
      Y.Shidara et al.
    • Journal Title

      Foundations of Data Mining and knowledge Discovery, Studies in Computational Intelligence Vol.6

      Pages: 161-170

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2005 Final Research Report Summary
  • [Journal Article] Density-and Complexity-Regularization in Gaussian Mixture Bayesian Classifier.2005

    • Author(s)
      H.Tenmoto et al.
    • Journal Title

      Advances in Soft Computing, Soft Computing as Transdisciplinary Science and Technology

      Pages: 391-399

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2005 Final Research Report Summary
  • [Journal Article] An Extension of Rough Approximation Quality to Fuzzy Classification.2005

    • Author(s)
      VN.Huynh et al.
    • Journal Title

      Rough Sets, Fuzzy Sets, Data Mining, and Granular Computing, Lecture Notes in.Computer Science Vol.3641

      Pages: 373-382

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2005 Final Research Report Summary
  • [Journal Article] Density- and Complexity-Regularization in Gaussian Mixture Bayesian Classifier.2005

    • Author(s)
      H.Tenmoto et al.
    • Journal Title

      Advances in Soft Computing, Soft Computing as Transdisciplinary Science and Technology

      Pages: 391-399

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2005 Annual Research Report 2005 Final Research Report Summary
  • [Journal Article] Optimal Division for Feature Selection and Classification.2005

    • Author(s)
      M.Kudo et al.
    • Journal Title

      Proceedings of the Workshop on Feature Selection for Data Mining : Interfacing Machine Learning and Statistics, Newport Beach

      Pages: 106-107

    • Related Report
      2005 Annual Research Report
  • [Journal Article] Extraction of Generalized Rules with Automated Attribute Abstraction.2005

    • Author(s)
      V.Shidara et al.
    • Journal Title

      Foundations of Data Mining and knowledge Discovery, Studies in Computational Intelligence Vol.6

      Pages: 161-170

    • Related Report
      2005 Annual Research Report
  • [Journal Article] A New Treatment and Viewpoint of Information Tables.2005

    • Author(s)
      M.Kudo et al.
    • Journal Title

      Rough Sets, Fuzzy Sets, Data Mining, and Granular Computing (RSFDGrC 2005), Lecture Notes in Artificial Intelligence Vol.3641

      Pages: 234-243

    • Related Report
      2005 Annual Research Report
  • [Journal Article] Discernibility-Based Variable Granularity and Kansei Representations.2005

    • Author(s)
      Y.Muto et al.
    • Journal Title

      Rough Sets, Fuzzy Sets, Data Mining, and Granular Computing (RSFDGrC 2005), Lecture Notes in Artificial Intelligence Vol.3641

      Pages: 692-700

    • Related Report
      2005 Annual Research Report
  • [Journal Article] New Logical Classes of Plausibility Functions in Dempster-Shafer Theory of Evidence.2005

    • Author(s)
      T.Murai et al.
    • Journal Title

      Knowledge-Based Intelligent Information and Engineering Systems, Lecture Notes in Computer Science Vol.3684

      Pages: 678-681

    • Related Report
      2005 Annual Research Report
  • [Journal Article] Paraconsistency and Paracompleteness in Chellas's Conditional Logics2005

    • Author(s)
      T.Murai et al.
    • Journal Title

      Advances in Logic Based Intelligent Systems, IOS Press

      Pages: 248-255

    • Related Report
      2005 Annual Research Report
  • [Journal Article] Visibility and Focus : An Extended Framework for Granular Computing.2005

    • Author(s)
      Y.Kudo et al.
    • Journal Title

      Advances in Logic Based Intelligent Systems, IOS Press

      Pages: 280-287

    • Related Report
      2005 Annual Research Report
  • [Journal Article] D.O.A. Estimation With Singular Noise Correlation Matrix.2005

    • Author(s)
      A.Tanaka et al.
    • Journal Title

      2005 IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP2005), Philadelphia, PA, USA Proceesings:AE-P5-1

    • Related Report
      2005 Annual Research Report
  • [Journal Article] Image Restoration With an Affine Constraint2005

    • Author(s)
      A.Tanaka et al.
    • Journal Title

      The fifth IASTED International Conference on Visualization, Imaging & Image Processing (VIIP2005)

    • Related Report
      2005 Annual Research Report
  • [Journal Article] 両方向N-gram確率を用いた誤り文字検出法2005

    • Author(s)
      河田 岳大 他
    • Journal Title

      電子情報通信学会論文誌 J88-D-II-3

      Pages: 629-635

    • Related Report
      2005 Annual Research Report
  • [Journal Article] Person Tracking with Infrared Sensors.2005

    • Author(s)
      T.Hosokawa et al.
    • Journal Title

      Knowledge-Based Intelligent Information and Engineering Systems, Lecture Notes in Computer Science Vol.3684

      Pages: 682-688

    • Related Report
      2005 Annual Research Report
  • [Journal Article] Webデータベース汎用システムの開発と音声データ管理システムとしての利用2005

    • Author(s)
      今野英明 他
    • Journal Title

      電子情報通信学会技術報告 PRMU2005-37

      Pages: 19-24

    • Related Report
      2005 Annual Research Report
  • [Journal Article] Inner Product Spaces for Bayesian Networks.2005

    • Author(s)
      A.Nakamura et al.
    • Journal Title

      Journal of Machine Learning Research 6

      Pages: 1383-1403

    • Related Report
      2005 Annual Research Report
  • [Journal Article] An efficient query learning algorithm for ordered binary decision diagrams.2005

    • Author(s)
      A.Nakamura
    • Journal Title

      nformation and Computation 201(2)

      Pages: 178-198

    • Related Report
      2005 Annual Research Report
  • [Journal Article] Improvements to the Linear Programming Based Scheduling of Web Advertisements.2005

    • Author(s)
      A.Nakamura et al.
    • Journal Title

      Electronic Commerce Research 5(1)

      Pages: 75-98

    • Related Report
      2005 Annual Research Report
  • [Journal Article] Finding and Auto-Labeling of Task Groups on E-mails and Documents.2005

    • Author(s)
      H.Tenmoto et al.
    • Journal Title

      Lecture Notes in Artificial intelligence, Knowledge-Based Intelligent Information and Engineering System 3684

      Pages: 696-702

    • Related Report
      2005 Annual Research Report
  • [Journal Article] Classifier-Independent Visualization of Supervised Data Structures using a Graph.2004

    • Author(s)
      H.Tenmoto et al.
    • Journal Title

      Lecture Notes in Computer Science, Advances in Pattern Recognition 3138

      Pages: 1043-1051

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2005 Final Research Report Summary
  • [Journal Article] A Nearest Neighbor Method Using Bisectors. Structural.2004

    • Author(s)
      M.Kudo et al.
    • Journal Title

      Syntactic and Statistical Pattern Recognition, Lecture Notes in Computer Science Vol.3138

      Pages: 885-893

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2005 Final Research Report Summary
  • [Journal Article] Upper limits for criteria for tests of dimensionality under elliptical populations.2004

    • Author(s)
      Yoshida, K. et al.
    • Journal Title

      Communications in Statistics - Theory and Methods 33(11)

      Pages: 2799-2816

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2005 Final Research Report Summary
  • [Journal Article] The Boosted/Bagged Subclass Method.2004

    • Author(s)
      I.Takigawa et al.
    • Journal Title

      International Journal of Computing Anticipatory Systems 14

      Pages: 311-320

    • Related Report
      2004 Annual Research Report
  • [Journal Article] Performance Analysis of Minimum L1-Norm Solutions for Underdetermined Source Separation.2004

    • Author(s)
      I.Takigawa et al.
    • Journal Title

      IEEE Transactions on Signal Processing 52-3

      Pages: 582-591

    • Related Report
      2004 Annual Research Report
  • [Journal Article] A Note on Ziarko's Variable Precision Rough Set Model and Non-monotonic Reasoning2004

    • Author(s)
      T.Murai et al.
    • Journal Title

      Rough Sets and Current Trends in Computing, Lecture Notes in Computer Science(S.Tsumoto et al.(eds.))(Springer) Vol.3066

      Pages: 103-108

    • Related Report
      2004 Annual Research Report
  • [Journal Article] Person Identification with Environment Information2004

    • Author(s)
      M.Kudo et al.
    • Journal Title

      Proc.SCI 2004, Invited Session "Theories and Applications for Soft Computing"

      Pages: 65-68

    • Related Report
      2004 Annual Research Report
  • [Journal Article] Combination of Weak Evidences by D-S Theory for Person Recognition2004

    • Author(s)
      M.Yamada et al.
    • Journal Title

      Proc.KES 2004, Invited Session "Several Aspects in Ubiquitous Pattern Recognition Techniques"

      Pages: 1065-1071

    • Related Report
      2004 Annual Research Report
  • [Journal Article] データの表現粒度と識別および縮約に関する検討2004

    • Author(s)
      武都祐司 他
    • Journal Title

      第3回ラフ集合と感性工学ワークショップ講演論文集

      Pages: 7-8

    • Related Report
      2004 Annual Research Report
  • [Journal Article] ルールの予測精度と興味深さに関する検討2003

    • Author(s)
      設樂洋爾 他
    • Journal Title

      電子情報通信学会技術報告 PRMU2003-76

      Pages: 7-11

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2005 Final Research Report Summary
  • [Journal Article] Simple termination conditions for k-nearest neighbor method.2003

    • Author(s)
      M.Kudo et al.
    • Journal Title

      Pattern Recognition Letters 24

      Pages: 1213-1223

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2005 Final Research Report Summary
  • [Journal Article] 包含と排除によるK最近隣法の高速化2003

    • Author(s)
      工藤峰一
    • Journal Title

      電子情報通信学会技術報告 2003-90

      Pages: 91-95

    • NAID

      110003273800

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2005 Final Research Report Summary
  • [Journal Article] クラスに依存した特徴集合を用いた決定木の設計2003

    • Author(s)
      青木 和昭 他
    • Journal Title

      電子情報通信学会論文誌 J86-D-II-8

      Pages: 1156-1165

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2005 Final Research Report Summary
  • [Journal Article] Comparison of Low-Dimensional Mapping Techniques Based on Discriminatory Information.2003

    • Author(s)
      Y.Mori et al.
    • Journal Title

      International Journal of Knowledge-Based Intelligent Engineering Systems 7-2

      Pages: 70-77

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2005 Final Research Report Summary
  • [Journal Article] Relationship between Rule Accuracy and a Degree of Interest2003

    • Author(s)
      Y.Shidara et al.
    • Journal Title

      Technical Report of IEICE (The Institute of Electronics, Information and Communication Engineers) PRMU2003-76

      Pages: 7-11

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2005 Final Research Report Summary
  • [Journal Article] Acceleration of the k-nearest neighbor method using inclusion and exclusion2003

    • Author(s)
      M.Kudo
    • Journal Title

      Technical Report of IEICE (The Institute of Electronics, Information and Communication Engineers) PRMU2003-90

      Pages: 91-95

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2005 Final Research Report Summary
  • [Journal Article] Design of Decision Trees Using Class-Dependent Feature Subsets.2003

    • Author(s)
      K.Aoki, et al.
    • Journal Title

      The Transactions of the Institute of Electronics, Information and Communication Engineers J86-D-II-8

      Pages: 1156-1165

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2005 Final Research Report Summary
  • [Journal Article] Visualization of Class Structures using Piecewise Linear Classifiers.2002

    • Author(s)
      H.Tenmoto et al.
    • Journal Title

      Advances in Logic, Artificial Intelligence and Robotics 85

      Pages: 104-111

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2005 Final Research Report Summary
  • [Journal Article] New criteria for tests of dimensionality under elliptical populations.2002

    • Author(s)
      K.Yoshida et al.
    • Journal Title

      Journal of the Japan Statistical Society 32(2)

      Pages: 183-192

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2005 Final Research Report Summary
  • [Journal Article] Automatic Determination of Size for Feature Selection.2002

    • Author(s)
      M.Kudo
    • Journal Title

      Proceedings of the Sixth World Multiconference on Systemics, Cybernetics and Informatics Vol. XVI

      Pages: 305-311

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2005 Final Research Report Summary
  • [Journal Article] A Region-Based Algorithm for Classifier-Independent Feature Selection.2002

    • Author(s)
      M.Kudo
    • Journal Title

      Pattern Recognition and String Matching

      Pages: 315-340

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2005 Final Research Report Summary
  • [Journal Article] Classifier-Independent Feature Selection Based Non-parametric Discriminant Analysis.2002

    • Author(s)
      N.Abe et al.
    • Journal Title

      Advances in Pattern Recognition, Lecture Notes in Computer Science Vol.2396

      Pages: 470-479

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2005 Final Research Report Summary
  • [Journal Article] Choosing the Parameter of Image Restoration Filters by Modified Subspace Information Criterion.2002

    • Author(s)
      A.Tanaka et al.
    • Journal Title

      IEICE Transactions on Fundamentals Vol.E85-A,No.5

      Pages: 1104-1110

    • NAID

      110003209132

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2005 Final Research Report Summary
  • [Journal Article] Automatic Determination of Size for Feature Selection.2002

    • Author(s)
      M.Kudo
    • Journal Title

      Proceedings of the Sixth World Multiconference on Systemics, Cybernetics and Informatics Vol.XVI

      Pages: 305-311

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2005 Final Research Report Summary
  • [Journal Article] Choosing the Parameter of Image Restoration Filters by Modified Subspace Information Criterion.2002

    • Author(s)
      A.Tanaka et al.
    • Journal Title

      IEICE Transactions on Fundamentals Vol.E85-A, No.5

      Pages: 1104-1110

    • NAID

      110003209132

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2005 Final Research Report Summary
  • [Publications] 青木 和昭, 渡辺 俊晴, 工藤 峰: "クラスに依存した特徴集合を用いた決定木の設計"電子情報通信学会論文誌D-II. J86-D-II-8. 1156-1165 (2003)

    • Related Report
      2003 Annual Research Report
  • [Publications] 森 康久仁, 工藤 峰一: "グラフによるインタラクティブなデータ分析と決定木の構成"電子情報通信学会論文誌D-II. J86-D-II-8. 1166-1176 (2003)

    • Related Report
      2003 Annual Research Report
  • [Publications] Y.Mori, M.Kudo: "Comparison of Low-Dimensional Mapping Techniques Based on Discriminatory Information"International Journal of Knowledge-Based Intelligent Engineering Systems. 7-2. 70-77 (2003)

    • Related Report
      2003 Annual Research Report
  • [Publications] 田中章, 今井英幸, 宮腰政明: "補空間成分推定に基づく特異観測過程に対する画像復元"電子情報通信学会論文誌D-II. J86-D-II. 1745-1755 (2003)

    • Related Report
      2003 Annual Research Report
  • [Publications] T.Murai, Y.Sato, G.Resconi, M.Nakata: "Granular Reasoning Using Zooming In & Out : Part 2"Aristotle's Categorical Syllogism. Electrical Notes on Theoretical Computer Science. 82-4. (2003)

    • Related Report
      2003 Annual Research Report
  • [Publications] T.Murai, M.Nakata, Y.Sato: "A Remark on Granular Reasoning and Filtration"Rough Set Theory and Granular Computing, Studies in Fuzziness and Soft Computing, Springer. 125. 89-96 (2003)

    • Related Report
      2003 Annual Research Report
  • [Publications] A.Nakamura, M.Kudo, A.Tanaka: "Collaborative Filtering using Restoration Operators"Proceedings of 7th European Conference on Principles and Practice of Knowledge Discovery in Databases. 2838. 339-349 (2003)

    • Related Report
      2003 Annual Research Report
  • [Publications] M.Kudo, et al.: "Simple termination conditions for k-nearest neighbor method"Pattern Recognition Letters. 24. 1213-1223 (2003)

    • Related Report
      2002 Annual Research Report
  • [Publications] M.Kudo: "Automatic Determination of Size for Feature Selection"Proceedings of the Sixth World Multiconference on Systemics, Cybernetics and Informatics. I・XVI. 305-311 (2002)

    • Related Report
      2002 Annual Research Report
  • [Publications] Y.Mori, M.Kudo: "Interactive Data Exploration Using Graph Representation"Proceedings of the Sixth World Multiconference on Systemics, Cybernetics and Informatics. I・XVI. 312-317 (2002)

    • Related Report
      2002 Annual Research Report
  • [Publications] N.Abe, M.Kudo: "Classifier-Independent Feature Selection Based on Non-parametric Discriminant Analysis"Advances in Pattern Recognition, Lecture Notes in Computer Science. 2396. 470-479 (2002)

    • Related Report
      2002 Annual Research Report
  • [Publications] K.Aoki, M.Kudo: "Decision Tree Using Class-Dependent Feature Subsets"Advances in Pattern Recognition, Lecture Notes in Computer Science. 2396. 761-769 (2002)

    • Related Report
      2002 Annual Research Report
  • [Publications] Y.Mori, M.Kudo: "Design of Tree Classifiers Using Interactive Data Exploration"Advances in Logic, Artificial Intelligence and Robotics. 112-119 (2002)

    • Related Report
      2002 Annual Research Report

URL: 

Published: 2002-04-01   Modified: 2016-04-21  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi