• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

Blind source separation based on simultaneous learning of the sparse frame representations for multi sources from their mixtures

Research Project

Project/Area Number 20500209
Research Category

Grant-in-Aid for Scientific Research (C)

Allocation TypeSingle-year Grants
Section一般
Research Field Sensitivity informatics/Soft computing
Research InstitutionThe University of Aizu

Principal Investigator

DING Shuxue  The University of Aizu, コンピュータ理工学部, 教授 (80372829)

Co-Investigator(Kenkyū-buntansha) OKUYAMA Yuichi  会津大学, コンピュータ理工学部, 准教授 (90404897)
Co-Investigator(Renkei-kenkyūsha) ANDRZEJ Cichocki  独立行政法人理化学研究所, 脳科学総合研究センター (40415071)
Project Period (FY) 2008 – 2010
Project Status Completed (Fiscal Year 2010)
Budget Amount *help
¥4,550,000 (Direct Cost: ¥3,500,000、Indirect Cost: ¥1,050,000)
Fiscal Year 2010: ¥1,300,000 (Direct Cost: ¥1,000,000、Indirect Cost: ¥300,000)
Fiscal Year 2009: ¥910,000 (Direct Cost: ¥700,000、Indirect Cost: ¥210,000)
Fiscal Year 2008: ¥2,340,000 (Direct Cost: ¥1,800,000、Indirect Cost: ¥540,000)
Keywords確率的情報処理 / ブラインド信号分離処理 / 信号のスパース表現 / 信号のフレーム表現 / Nonnegative Matrix Factorization / Sparsifying transform / Multiuser Detection / Beamforming
Research Abstract

Just as that any sentence can be constructed by several words in a dictionary, any signal or image can be either represented by several "words" in a "dictionary". Comparing with the large number of words in the dictionary, a sentence is usually be constructed by only very few words, so that these words are mapped into the dictionary sparsely. Then constructed sentence may be called as sparse coding with the dictionary. Similarly, with a dictionary for signal or image, one can represent any signal or image, and this can also be termed as sparse coding. Usually, there more words in the dictionary than the length of the words, i.e., the dictionary is over-complete, the dictionary has a structure of frame (a mathematical concept). The motivation of this research is to find more effective methods for finding this sparse representation, and then apply them to blind source separation (BSS).
BSS by using the sparse representation usually includes repeated two steps, once it is given an arbitrar … More y initialization of the estimated dictionary. In the first step, for a given dictionary the sparse representation by the dictionary is conducted. In the second step, the dictionary is learned in part and the corresponding sparse representation is modified, while the other parts of sparse representation are kept. In these two steps, the dictionary learning is more important and there still very few effective methods for it. For this purpose, we worked out a method that is termed as adaptive non-orthogonal sparsifying transform. In this method, we take the multiplication of the frame and a sparse matrix as the source signal estimation. Though there may be many possible solutions, we choose the sparsest one as our result. As a feature of the method, the words in the dictionary are ordered by their energy, rather than randomly ordered as in the usual dictionary.
In the above method, the dictionary learning and source estimation may converge very slowly and the computation is also very consuming. For solving these problems, we also worked out a method in which the dictionary and the sources are simultaneously estimated, by invoking the nonnegative matrix factorization (NMF). There are many nonnegative signals, such as image, in applications. However, usually, the result of NMF is not unique and not all of them are sparse. For solving this problem, we worked out a sparse NMF method, in which we select a sparse solution from the non unique solutions by a constraint. We propose a measure for measuring the sparsity of source signals and use its minimization as the constraint. As an alternative method, we also proposed to use a constraint on the dictionary, rather than on the sources, since the sources are usually very long and a constraint on them will be computation consuming. We found that the maximization of space spanned by the words in the dictionary is a good constraint.
Evaluations showed that our methods are efficient. Then we applied them to blind spectral unmixing, BSS or denoising of images, beamforming and direction of arrival estimation. Less

Report

(4 results)
  • 2010 Annual Research Report   Final Research Report ( PDF )
  • 2009 Annual Research Report
  • 2008 Annual Research Report
  • Research Products

    (26 results)

All 2011 2010 2009 2008 Other

All Journal Article (13 results) (of which Peer Reviewed: 6 results) Presentation (12 results) Remarks (1 results)

  • [Journal Article] Blind Spectral Unmixing Based on Sparse Nonnegative Matrix Factorization2011

    • Author(s)
      Zuyuan Yang, Guoxu Zhou, Shengli Xie, Shuxue Ding, Jun-Mei Yang, Jun Zhang
    • Journal Title

      IEEE Transactions on Image Processing Vol.20, No.4

      Pages: 1112-1125

    • Related Report
      2010 Final Research Report
  • [Journal Article] Nonnegative Blind Source Separation by Iterative Volume Maximization with Fully Nonnegativity Constraints2010

    • Author(s)
      Zuyuan Yang, Guoxu Zhou, Shuxue Ding, Shengli Xie
    • Journal Title

      ICIC Express Letters Vol.4, No.6(B)

      Pages: 2329-2334

    • Related Report
      2010 Final Research Report
  • [Journal Article] Blind Source Separation by Fully Nonnegative Constrained Iterative Volume Maximization2010

    • Author(s)
      Zuyuan Yang, Shuxue Ding, Shengli Xie
    • Journal Title

      IEEE Signal Processing Letter Vol.17, No.9

      Pages: 799-802

    • Related Report
      2010 Final Research Report
  • [Journal Article] Nonnegative Blind Source Separation by Iterative Volume Maximization with Fully Nonnegativity Constraints2010

    • Author(s)
      Zuyuan Yang, Guoxu Zhou, Shuxue Ding(丁数学), Shengli Xie
    • Journal Title

      ICIC Express Letters

      Volume: Vol.4, No.6(B) Pages: 2329-2334

    • Related Report
      2010 Annual Research Report
    • Peer Reviewed
  • [Journal Article] Blind Source Separation by Fully Nonnegative Constrained Iterative Volume Maximization2010

    • Author(s)
      Zuyuan Yang, Shuxue Ding(丁数学), Shengli Xie
    • Journal Title

      IEEE Signal Processing Letter

      Volume: Vol.17, No.9 Pages: 799-802

    • Related Report
      2010 Annual Research Report
    • Peer Reviewed
  • [Journal Article] Performance Analysis of the Iterative Decision Method for Optimal Multiuser Detection2009

    • Author(s)
      Wenlong Liu, Shuxue Ding
    • Journal Title

      ICIC Express Letters Vol.3, No.3(B)

      Pages: 615-620

    • Related Report
      2010 Final Research Report
  • [Journal Article] The Diagonal Loading Beamformers for the PAM Communication Systems, International Journal of Innovative Computing2009

    • Author(s)
      Wenlong Liu, Shuxue Ding
    • Journal Title

      Information and Control Vol.5, No.9

      Pages: 2907-2916

    • Related Report
      2010 Final Research Report
  • [Journal Article] Pseudo Online Independent Component Analysis for Dynamical Mixing Using Gradient-Optimization2009

    • Author(s)
      Takahiro Haneda, Shuxue Ding
    • Journal Title

      Journal of Advanced Computational Intelligence and Intelligent Informatics Vol.13, No.3

      Pages: 275-283

    • Related Report
      2010 Final Research Report
  • [Journal Article] Performance Analysis of the Iterative Decision Method for Optimal Multiuser Detection2009

    • Author(s)
      Wenlong Liu, Shuxue Ding(丁数学)
    • Journal Title

      ICIC Express Letters Vol.3, No.3(B)

      Pages: 615-620

    • Related Report
      2009 Annual Research Report
    • Peer Reviewed
  • [Journal Article] The Diagonal Loading Beamformers for the PAM Communication Systems2009

    • Author(s)
      Wenlong Liu, Shuxue Ding(丁数学)
    • Journal Title

      International Journal of Innovative Computing, Information, Control Vol.5, No.9

      Pages: 2907-2916

    • Related Report
      2009 Annual Research Report
    • Peer Reviewed
  • [Journal Article] Pseudo Online Independent Component Analysis for Dynamical Mixing Using Gradient-Optimization2009

    • Author(s)
      Takahiro Haneda, Shuxue Ding (丁 数学)
    • Journal Title

      Journal of Advanced Computational Intelligence and Intelligent Informatics Vol. 13, No. 3

      Pages: 275-283

    • Related Report
      2008 Annual Research Report
    • Peer Reviewed
  • [Journal Article] An Efficient Method to Determine the Diagonal Loading Factor Using the Constant Modulus Feature2008

    • Author(s)
      Wenlong Liu, Shuxue Ding
    • Journal Title

      IEEE Transactions on Signal Processing Vol.56, No.12

      Pages: 6102-6106

    • Related Report
      2010 Final Research Report
  • [Journal Article] An Efficient Method to Determine the Diagonal Loading Factor Using the Constant Modulus Feature2008

    • Author(s)
      Wenlong Liu, Shuxue Ding (丁 数学)
    • Journal Title

      IEEE Transactions on Signal Processing Vol. 56, No. 12

      Pages: 6102-6106

    • Related Report
      2008 Annual Research Report
    • Peer Reviewed
  • [Presentation] Blind Source Separation by Nonnegative Matrix Factorization with Minimum-Volume Constraint2010

    • Author(s)
      Zuyuan Yang, Guoxu Zhou, Shuxue Ding, Shengli Xie
    • Organizer
      Proc. 2010 International Conference on Intelligent Control and Information Processing
    • Place of Presentation
      Dalian, China
    • Related Report
      2010 Final Research Report
  • [Presentation] Sparse Representations of Images Via Overcomplete Dictionary Learned by Adaptive Non-Orthogonal Sparsifying Transform2010

    • Author(s)
      Zunyi Tang, Zuyuan Yang, Shuxue Ding
    • Organizer
      Proc. The 3rd International Conference on Intelligent Networks and Intelligent Systems
    • Place of Presentation
      Shenyang, China
    • Related Report
      2010 Final Research Report
  • [Presentation] Sparse Representations of Images Via Overcomplete Dictionary Learned by Adaptive Non-Orthogonal Sparsifying Transform2010

    • Author(s)
      Zunyi Tang, Zuyuan Yang, Shuxue Ding(丁数学)
    • Organizer
      Proc.The 3rd International Conference on Intelligent Networks and Intelligent Systems (ICINIS 2010), pp.120-123
    • Place of Presentation
      Shenyang, China
    • Related Report
      2010 Annual Research Report
  • [Presentation] Blind Source Separation by Nonnegative Matrix Factorization with Minimum-Volume Constraint2010

    • Author(s)
      Zuyuan Yang, Guoxu Zhou, Shuxue Ding(丁数学), Shengli Xie
    • Organizer
      Proc.2010 International Conference on Intelligent Control and Information Processing (ICICIP2010), pp.117-119
    • Place of Presentation
      Dalian, China
    • Related Report
      2010 Annual Research Report
  • [Presentation] An Iterative Algorithm for Joint Beamforming and DoA Estimation2009

    • Author(s)
      Wenlong Liu, Qian Liu, Jianfeng Li, Minglu Jin, Shuxue Ding
    • Organizer
      Proc. The 19th Intelligent System Symposium (Fan 2009) and The 1st International Workshop on Aware Computing
    • Related Report
      2010 Final Research Report
  • [Presentation] An Iterative Algorithm for Joing Beamforming and DoA Estimation2009

    • Author(s)
      Wenlong Liu, Qian Liu, Jianfeng Li, Minglu Jin, Shuxue Ding(丁数学)
    • Organizer
      Proc.The 19th Intelligent System Symposium and The lst International Workshop on Aware Computing, PP.674-678
    • Place of Presentation
      福島県会津若松
    • Related Report
      2009 Annual Research Report
  • [Presentation] An Invariant Pattern Recognition System Using the Bayesian Inference on Hierarchical Sequences with Pre-Processing2008

    • Author(s)
      Zunyi Tang, Wenlong Liu, Shuxue Ding (丁 数学)
    • Organizer
      Proc. Japan-China Joint Workshop on Frontier of Computer Science & Technology
    • Place of Presentation
      長崎
    • Year and Date
      2008-12-27
    • Related Report
      2008 Annual Research Report
  • [Presentation] A Robust Gradient-Descent Algorithm for On-Line Independent Component Analysis Based on Negentropy Maximization2008

    • Author(s)
      Takahiro Haneda, Shuxue Ding (丁 数学)
    • Organizer
      Proc. Joint 4th International Conference on Soft Computing and Intelligent Systems and 9th International Symposium on advanced Intelligent Systems
    • Place of Presentation
      名古屋
    • Year and Date
      2008-09-19
    • Related Report
      2008 Annual Research Report
  • [Presentation] A“Decision and Re-solving"Beamformer for the PAM Communication System2008

    • Author(s)
      Wenlong Liu, Shuxue Ding (丁 数学)
    • Organizer
      Proc. International Conference on Innovative Computing, Information and Control 2008
    • Place of Presentation
      Dalian, China
    • Year and Date
      2008-06-18
    • Related Report
      2008 Annual Research Report
  • [Presentation] An Invariant Pattern Recognition System Using the Bayesian Inference on Hierarchical Sequences with Pre-Processing2008

    • Author(s)
      Zunyi Tang, Wenlong Liu, Shuxue Ding
    • Organizer
      Proc. Japan-China Joint Workshop on Frontier of Computer Science & Technology
    • Place of Presentation
      Nagasaki, Japan
    • Related Report
      2010 Final Research Report
  • [Presentation] A Robust Gradient-Descent Algorithm for On-Line Independent Component Analysis Based on Negentropy Maximization2008

    • Author(s)
      Takahiro Haneda, Shuxue Ding
    • Organizer
      Proc. Joint 4th International Conference on Soft Computing and Intelligent Systems and 9th International Symposium on advanced Intelligent Systems
    • Place of Presentation
      Nagoya, Japan
    • Related Report
      2010 Final Research Report
  • [Presentation] A "Decision and Re-solving" Beamformer for the PAM Communication System2008

    • Author(s)
      Wenlong Liu, Shuxue Ding
    • Organizer
      Proc. International Conference on Innovative Computing, Information and Control 2008
    • Place of Presentation
      Dalian, China
    • Related Report
      2010 Final Research Report
  • [Remarks] ホームページ等

    • Related Report
      2010 Final Research Report

URL: 

Published: 2008-04-01   Modified: 2016-04-21  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi