Study of semi-supervised clustering and challenge to constrained mixture distributions

• Project/Area Number: 23500269
• Research Category: Grant-in-Aid for Scientific Research (C)
• Allocation Type: Multi-year Fund
• Section: 一般
• Research Field: Sensitivity informatics/Soft computing
• Research Institution: University of Tsukuba
• Principal Investigator: MIYAMOTO Sadaaki 筑波大学, システム情報系, 教授 (60143179)
• Co-Investigator(Renkei-kenkyūsha): ENDO Yasunori 筑波大学, システム情報系, 教授 (10267396)
• Project Period (FY): 2011 – 2013
• Project Status: Completed (Fiscal Year 2013)
• Budget Amount: ¥5,200,000 (Direct Cost: ¥4,000,000、Indirect Cost: ¥1,200,000); Fiscal Year 2013: ¥1,430,000 (Direct Cost: ¥1,100,000、Indirect Cost: ¥330,000); Fiscal Year 2012: ¥1,430,000 (Direct Cost: ¥1,100,000、Indirect Cost: ¥330,000); Fiscal Year 2011: ¥2,340,000 (Direct Cost: ¥1,800,000、Indirect Cost: ¥540,000)
• Keywords: 半教師付き分類 / 制約クラスタリング / 階層的技法 / 混合分布モデル / COP K-means / ファジィクラスタリング / インダクティブクラスタリング / クラスタリング / 拡張K-means / クラスター評価 / 2段階クラスタリング / 非対称データ / 階層的クラスタリング / 制約K-means / 制約混合分布 / 非対称類似度 / ファジィ近傍モデル / Twitter / 正定値カーネル

Research Abstract

Existing methods of semi-supervised clustering and proposed methods by the authors are compared using artificial and repository data. Main results are as follows. 1. Agglomerative clustering performs as well as mixture distribution models in constrained clustering. 2.Methods of fuzzy clustering generalize basic mixture distribution models for semi-supervised classification. 3. Extensions of COP K-means have been proposed but they did not perform as well as constrained mixture distribution method. 4. The concept of inductive clustering has been proposed and its methodological usefulness has been shown. 5. Real data using Twitter have been analyzed using semi-supervised clustering and its effects have been investigated.

Research Products

• [Journal Article] Algorithms of Crisp, Fuzzy and Probabilistic Clustering with Semi-supervision or Pairwise Constraints (2013)
  • Author(s): S. Miyamoto, N. Obara
  • Journal Title: Proc. of 2013 IEEE International Conference on Granular Computing Pages: 225-230
  • Peer Reviewed
• [Journal Article] Variables for Controlling Cluster Sizes on Fuzzy c-Means (2013)
  • Author(s): Y. Komazaki, S. Miyamoto
  • Journal Title: Lecture Note in Artificial Intelligence Volume: 8234 Pages: 192-203
  • Peer Reviewed
• [Journal Article] Semi-supervised Sequential Kernel Regression Models with Pairwise Constraints (2013)
  • Author(s): Hengjin Tang, Sadaaki Miyamoto
  • Journal Title: Lecture Note in Artificial Intelligence Volume: 8234 Pages: 166-178
  • Peer Reviewed
• [Journal Article] A Method of Two-Stage Clustering with Constraints Using Agglomerative Hierarchical Algorithm and One-Pass k-Means++ (2013)
  • Author(s): Y. Tamura, N. Obara, S. Miyamoto
  • Journal Title: Advances in Intelligent Systems and Computing Volume: 245 Pages: 9-19
  • NAID: 130005456161
  • Peer Reviewed
• [Journal Article] (2013)
  • Author(s): S. Miyamoto, S. Takumi
  • Journal Title: Journal of Advanced Computational Intelligence and Intelligent Informatics Volume: 17 Pages: 504-510
  • Peer Reviewed
• [Journal Article] Nearest Prototype and Nearest Neighbor Clustering with Twofold Memberships Based on Inductive Property (2013)
  • Author(s): Satoshi Takumi, Sadaaki Miyamoto
  • Journal Title: Journal of Advanced Computational Intelligence and Intelligent Informatics Volume: 17 Pages: 504-510
  • Peer Reviewed
• [Journal Article] A Method of Two-Stage Clustering with Constraints Using Agglomerative Hierarchical Algorithm and One-Pass k-Means++, (2013)
  • Author(s): Yusuke Tamura, Nobuhiro Obara, Sadaaki Miyamoto
  • Journal Title: Advances in Intelligent Systems and Computing Volume: 245 Pages: 9-19
  • DOI: 10.1007/978-3-319-02821-7_4
  • NAID: 130005456161
  • ISBN: 9783319028200, 9783319028217
  • Peer Reviewed
• [Journal Article] Algorithms of Crisp, Fuzzy, and Probabilistic Clustering with Semi-supervision or Pairwise Constraints (2013)
  • Author(s): Sadaaki Miyamoto, Nobuhiro Obara
  • Journal Title: Proc. of 2013 IEEE International Conference on Granular Computing Volume: 1 Pages: 225-230
  • Peer Reviewed
• [Journal Article] Inductive Clustering and Twofold Approximations in Nearest Neighbor Clustering (2012)
  • Author(s): S. Miyamoto, S. Takumi
  • Journal Title: LNAI Volume: 7647 Pages: 355-366
  • Peer Reviewed
• [Journal Article] Comparing Different Methods of Agglomerative Hierarchical Clustering with Pairwise Constraints (2012)
  • Author(s): S. Takumi, S. Miyamoto
  • Journal Title: Proc. of SCIS-ISIS2012 Pages: 1545-1550
  • Peer Reviewed
• [Journal Article] A Method of Two-Stage Clustering with Constraints Using Agglomerative Hierarchical Algorithm and One-Pass K-Means (2012)
  • Author(s): N. Obara, S. Miyamoto
  • Journal Title: Proc. of SCIS-ISIS 2012 Pages: 1540-1544
  • NAID: 130005456161
  • Peer Reviewed
• [Journal Article] Analysis of Disaster Information on Twitter Using Different Methods of Clustering Based on a Fuzzy Neighborhood Model (2012)
  • Author(s): Y. Komazaki, S. Suzuki, S. Takumi, S. Miyamoto
  • Journal Title: Proc. of 5th International Symposium on Computational Intelligence and Industrial Applications Pages: 1-5
  • Peer Reviewed
• [Journal Article] Top-down vs Bottom-up methods of Linkage for Asymmetric Agglomerative Hierarchical Clustering (2012)
  • Author(s): S. Takumi, S. Miyamoto
  • Journal Title: Proc. of 2012 IEEE International Conference on Granular Computing Pages: 542-547
  • Peer Reviewed
• [Journal Article] Hierarchical Clustering Using Transitive Closure and Semi-supervised Classification Based on Fuzzy Rough Approximation (2012)
  • Author(s): S. Miyamoto, S. Takumi
  • Journal Title: Proc. of 2012 IEEE International Conference on Granular Computing Pages: 438-443
  • Peer Reviewed
• [Journal Article] Clustering in Tweets Using a Fuzzy Neighborhood Model (2012)
  • Author(s): S. Miyamoto, S. Suzuki, S. Takumi
  • Journal Title: Proc. of WCCI 2012 IEEE World Congress on Computational Intelligence Pages: 251-256
  • Peer Reviewed
• [Journal Article] Sequential Regression Models with Pairwise Constraints Using Noise Clusters (2012)
  • Author(s): Hengjin Tang, Sadaaki Miyamoto
  • Journal Title: Journal of Advanced Computational Intelligence and Intelligent Informatics Volume: 16 Pages: 814-818
  • Peer Reviewed
• [Journal Article] Agglomerative Hierarchical ClusteringWithout Reversals on Dendrograms Using Asymmetric Similarity Measures (2012)
  • Author(s): Satoshi Takumi, Sadaaki Miyamoto
  • Journal Title: Journal of Advanced Computational Intelligence and Intelligent Informatics Volume: 16 Pages: 807-813
  • Peer Reviewed
• [Journal Article] Analysis of Disaster Information on Twitter Using Different Methods of Clustering Based on a Fuzzy Neighborhood Model (2012)
  • Author(s): Yoshiyuki Komazaki, Shohei Suzuki, Satoshi Takumi, Sadaaki Miyamoto
  • Journal Title: Proc. of 5th International Symposium on Computational Intelligence and Industrial Applications Volume: 1 Pages: 1-5
  • Peer Reviewed
• [Journal Article] A Method of Two-Stage Clustering with Constraints Using Agglomerative Hierarchical Algorithm and One-Pass K-Means (2012)
  • Author(s): Nobuhiro Obara, Sadaaki Miyamoto
  • Journal Title: Proc. of SCIS-ISIS 2012 Volume: 1 Pages: 1540-1544
  • NAID: 130005456161
  • Peer Reviewed
• [Journal Article] Comparing Different Methods of Agglomerative Hierarchical Clustering with Pairwise Constraints (2012)
  • Author(s): Satoshi Takumi, Sadaaki Miyamoto
  • Journal Title: Proc. of SCIS-ISIS 2012 Volume: 1 Pages: 1545-1550
  • Peer Reviewed
• [Journal Article] Inductive Clustering and Twofold Approximations in Nearest Neighbor Clustering (2012)
  • Author(s): Sadaaki Miyamoto, Satoshi Takumi
  • Journal Title: MDAI 2012, LNAI Volume: 7647 Pages: 355-366
  • DOI: 10.1007/978-3-642-34620-0_32
  • ISBN: 9783642346194, 9783642346200
  • Peer Reviewed
• [Journal Article] Inductive vs. Transductive Clustering Using Kernel Functions and Pairwise Constraints (2011)
  • Author(s): S. Miyamoto, A. Terami
  • Journal Title: Proc. of 11th Intern. Conf. on Intelligent Systems Design and Applications (ISDA 2011) Pages: 1258-1264
  • Peer Reviewed
• [Journal Article] Text Clustering Using a Multiset Model (2011)
  • Author(s): S. Takumi, S. Miyamoto
  • Journal Title: Proc. of the 2011 IEEE International Conference on Granular Computing Pages: 630-635
  • Peer Reviewed
• [Journal Article] Agglomerative Hierarchical Clustering Using Asymmetric Similarity Based on a Bag Model and Application to Information on the Web (2011)
  • Author(s): S. Takumi, S. Miyamoto
  • Journal Title: Lecture Notes in Artificial Intelligence Volume: 7027 Pages: 187-196
  • Peer Reviewed
• [Journal Article] Constrained Agglomerative Hierarchical Clustering Algorithms with Penalties (2011)
  • Author(s): S. Miyamoto, A. Terami
  • Journal Title: Proc. of 2011 IEEE International Conference on Fuzzy Systems Pages: 422-427
  • Peer Reviewed
• [Journal Article] Agglomerative Clustering Using Asymmetric Similarities (2011)
  • Author(s): S. Takumi, S. Miyamoto
  • Journal Title: Lecture Notes in Artificial Intelligence Volume: 6820 Pages: 114-125
  • Peer Reviewed
• [Journal Article] KL-Divergence-Based and Manhattan Distance-Based Semisupervised Entropy-Regularized Fuzzy c-Means (2011)
  • Author(s): Y. Kanzawa, Y. Endo, S. Miyamoto
  • Journal Title: Journal of Advanced Computational Intelligence and Intelligent Informatics Volume: 15 Pages: 1057-1064
  • Peer Reviewed
• [Journal Article] Sequential Extraction of Fuzzy Regression Models: Least Squares and Least Absolute Deviations, International Journal of Uncertainty (2011)
  • Author(s): H.J. Tang, S. Miyamoto
  • Journal Title: Fuzziness and Knowledge-Based Systems Volume: 19 Pages: 53-63
  • Peer Reviewed
• [Journal Article] Sequential Extraction of Fuzzy Regression Models: Least Squares and Least Absolute Deviations (2011)
  • Author(s): H.J. Tang, S. Miyamoto
  • Journal Title: International Journal of Uncertainty, Fuzziness and Knowledge-Based Systems Volume: 19 Issue: supp01 Pages: 53-63
  • DOI: 10.1142/s0218488511007349
  • Peer Reviewed
• [Journal Article] Text Clustering Using a Multiset Model (2011)
  • Author(s): S. Takumi, S. Miyamoto
  • Journal Title: Proc. of the 2011 IEEE International Conference on Granular Computing (GrC2011) Volume: 1 Pages: 630-635
  • DOI: 10.1109/grc.2011.6122670
  • Peer Reviewed
• [Presentation] Text Clustering of Chinese Documents Using Fuzzy Neighborhood (2014)
  • Author(s): Zhang Canlun, Sadaaki Miyamoto
  • Organizer: 第40回ファジィ, ワークショップ
  • Place of Presentation: 首都大学東京, 南大沢, 東京
• [Presentation] Semi-supervised Clustering Using Hierarchical or Non-hierarchical Algorithms (2013)
  • Author(s): S. Miyamoto
  • Organizer: IEEE International Conference on Granular Computing
  • Place of Presentation: Beijing, China
  • Year and Date: 2013-12-15
  • Invited
• [Presentation] Neighborhood System and Term-Text Clustering with Application to Mining Risks (2013)
  • Author(s): S. Miyamoto
  • Organizer: The 3rd International Workshop on Soft Computing and Disaster Control
  • Place of Presentation: Bali, Indonesia
  • Year and Date: 2013-11-09
  • Invited
• [Presentation] Generalizations of K-Means Algorithms for Constrained Clustering (2013)
  • Author(s): S. Miyamoto, H. Kondoh
  • Organizer: Intl. Conf. on Future Trends in Computing and Communication-FTCC 2013
  • Place of Presentation: Bangkok, Thailand
  • Year and Date: 2013-07-13
• [Presentation] ファジィ近傍モデルを用いたウェブテキスト解析 (2013)
  • Author(s): 鈴木昭平, 松崎慧太 , 宮本定明
  • Organizer: 第29回ファジィシステムシンポジウム
  • Place of Presentation: 大阪国際大学, 大阪
• [Presentation] One-pass k-means++を用いた対制約付き二段階階層的クラスタリング (2013)
  • Author(s): 田村優友, 小原伸広, 宮本定明
  • Organizer: 第29回ファジィシステムシンポジウム
  • Place of Presentation: 大阪国際大学, 大阪
• [Presentation] Generalizations of K-Means Algorithms for Constrained Clustering (2013)
  • Author(s): Sadaaki Miyamoto, Haruka Kondoh
  • Organizer: Intl. Conf. on Future Trends in Computing and Communication -- FTCC 2013
  • Place of Presentation: Bangkok, Thailand
• [Presentation] Fuzzy Clustering: An Introduction and Recent Topics (2013)
  • Author(s): Sadaaki Miyamoto
  • Organizer: KSE 2013
  • Place of Presentation: Hanoi. Vietnam
  • Invited
• [Presentation] An Overview of Hierarchical and Non-hierarchical Algorithms of Clustering for Semi-supervised Classification (2012)
  • Author(s): S. Miyamoto
  • Organizer: MDAI 2012
  • Place of Presentation: Girona, Spain
  • Year and Date: 2012-11-22
  • Invited
• [Presentation] Statistical and Non-statistical Models in Clustering: An Introduction and Recent Topic (2012)
  • Author(s): S. Miyamoto
  • Organizer: JCS-CLADAG 2012
  • Place of Presentation: Capri Island, Italy
  • Year and Date: 2012-09-03
  • Invited
• [Presentation] A Family of Methods for Asymmetric Nearest Neighbor Clustering (2012)
  • Author(s): S. Miyamoto
  • Organizer: JCS-CLADAG 2012
  • Place of Presentation: Capri Island, Italy
  • Year and Date: 2012-09-03
• [Presentation] Inductive and Non-inductive Methods of Clustering (2012)
  • Author(s): S. Miyamoto
  • Organizer: 2012 IEEE International Conference on Granular Computing
  • Place of Presentation: Hangzhou, China
  • Year and Date: 2012-08-11
  • Invited
• [Presentation] Agglomerative Clustering Using Asymmetric Measures without Reversals in Dendrograms (2012)
  • Author(s): S. Miyamoto
  • Organizer: Fourth Japanese-Germen Symposium on Classification (JGSC2012)
  • Place of Presentation: 同志社大学, 京都市
  • Year and Date: 2012-03-09
• [Presentation] 半教師付き分類のための K-means関連クラスタリング技法 (2012)
  • Author(s): 近藤晴香, 宮本定明, 松崎慧太
  • Organizer: 第28回ファジィシステムシンポジウム
  • Place of Presentation: 名古屋工業大学, 名古屋
• [Presentation] One-pass K-meansを用いた対制約付き二段階階層的クラスタリング (2012)
  • Author(s): 小原伸広, 宮本定明
  • Organizer: 第28回ファジィシステムシンポジウム
  • Place of Presentation: 名古屋工業大学, 名古屋
• [Presentation] ファジィラフ近似を生成するクラスタリングと半教師付き分 類 (2012)
  • Author(s): 宮本定明, 侘美怜
  • Organizer: 第28回ファジィシステムシンポジウム
  • Place of Presentation: 名古屋工業大学, 名古屋
• [Presentation] ファジィラフ近似を生成するクラスタリングと半教師付き分類 (2012)
  • Author(s): 宮本定明, 侘美怜
  • Organizer: 第28回ファジィシステムシンポジウム
  • Place of Presentation: 名古屋工業大学、名古屋
• [Presentation] One-pass K-meansを用いた対制約付き二段階階層的クラスタリング (2012)
  • Author(s): 小原伸広, 宮本定明
  • Organizer: 第28回ファジィシステムシンポジウム
  • Place of Presentation: 名古屋工業大学、名古屋
• [Presentation] 半教師付き分類のためのK-means関連クラスタリング技法 (2012)
  • Author(s): 近藤晴香, 宮本定明, 松崎慧太
  • Organizer: 第28回ファジィシステムシンポジウム
  • Place of Presentation: 名古屋工業大学、名古屋
• [Presentation] Agglomerative Clustering Using Asymmetric Measures without Reversals in Dendrograms (2012)
  • Author(s): S. Miyamoto
  • Organizer: Fourth Japanese-Germen Symposium on Classification (JGSC2012)
  • Place of Presentation: 同志社大学（京都市）
• [Presentation] Two Classes of Algorithms for Data Clustering (2011)
  • Author(s): S. Miyamoto
  • Organizer: IUKM2011
  • Place of Presentation: Zhejiang University, Hangzhou, China
  • Year and Date: 2011-10-27
  • Invited
• [Presentation] ファジィ近傍に基づいたテキストマイニングとTwitter への応用 (2011)
  • Author(s): 鈴木昭平, 宮本定明
  • Organizer: 27th Fuzzy System Symposium
  • Place of Presentation: 福井大学, 福井市
  • Year and Date: 2011-09-12
• [Presentation] 階層的アルゴリズムと逐次的アルゴリズムによる制約クラス タ リ ン グ (2011)
  • Author(s): 近藤晴香, 宮本定明
  • Organizer: 27th Fuzzy System Symposium
  • Place of Presentation: 福井大学, 福井市
  • Year and Date: 2011-09-12
• [Presentation] 非対称類似度を用い た階層的クラスタリングのための平均結合法 (2011)
  • Author(s): 侘美怜, 宮本定明
  • Organizer: 27th Fuzzy System Symposium
  • Place of Presentation: 福井大学, 福井市
  • Year and Date: 2011-09-12
• [Presentation] Semi-Supervised Sequential Regression Models with Pairwise Constraints (2011)
  • Author(s): Hengjin Tang, Sadaaki Miyamoto
  • Organizer: Modeling Decisions for Artificial Intelligence 2011 (MDAI 2011)
  • Place of Presentation: Empark Grand Hotel (Changsha, China)
  • Year and Date: 2011-07-28
• [Presentation] Two Classes of Algorithms for Data Clustering (2011)
  • Author(s): S. Miyamoto
  • Organizer: IUKM 2011(招待講演)
  • Place of Presentation: Zhejiang University (Hangzhou, China)
• [Presentation] ファジィ近傍に基づいたテキストマイニングとTwitter への応用 (2011)
  • Author(s): 鈴木昭平，宮本定明
  • Organizer: 27th Fuzzy System Symposium
  • Place of Presentation: 福井大学（福井市）
• [Presentation] 階層的アルゴリズムと逐次的アルゴリズムによる制約クラスタリング (2011)
  • Author(s): 近藤晴香，宮本定明
  • Organizer: 27th Fuzzy System Symposium
  • Place of Presentation: 福井大学（福井市）
• [Presentation] 非対称類似度を用いた階層的クラスタリングのための平均結合法 (2011)
  • Author(s): 侘美怜，宮本定明
  • Organizer: 27th Fuzzy System Symposium
  • Place of Presentation: 福井大学（福井市）
• [Remarks] ホームページ
  • URL: http://www.soft.risk.tsukuba.ac.jp/miyamoto/