×

Analysis of sparse representation and blind source separation. (English) Zbl 1089.68101

Summary: In this letter, we analyze a two-stage cluster-then-\(l^1\)-optimization approach for sparse representation of a data matrix, which is also a promising approach for blind source separation (BSS) in which fewer sensors than sources are present. First, sparse representation (factorization) of a data matrix is discussed. For a given overcomplete basis matrix, the corresponding sparse solution (coefficient matrix) with minimum \(l^1\)-norm is unique with probability one, which can be obtained using a standard linear programming algorithm. The equivalence of the \(l^1\)-norm solution and the \(l^0\)-norm solution is also analyzed according to a probabilistic framework. If the obtained \(l^1\)-norm solution is sufficiently sparse, then it is equal to the \(l^0\)-norm solution with a high probability. Furthermore, the \(l^1\)-norm solution is robust to noise, but the \(l^0\)-norm solution is not, showing that the \(l^1\)-norm is a good sparsity measure. These results can be used as a recoverability analysis of BSS, as discussed. The basis matrix in this article is estimated using a clustering algorithm followed by normalization, in which the matrix columns are the cluster centers of normalized data column vectors. Zibulevsky, Pearlmutter, Boll, and Kisilev (2000) used this kind of two-stage approach in underdetermined BSS. Our recoverability analysis shows that this approach can deal with the situation in which the sources are overlapped to some degree in the analyzed domain and with the case in which the source number is unknown. It is also robust to additive noise and estimation error in the mixing matrix. Finally, four simulation examples and an EEG data analysis example are presented to illustrate the algorithm’s utility and demonstrate its performance.

MSC:

68T05 Learning and adaptive systems in artificial intelligence
PDFBibTeX XMLCite
Full Text: DOI

References:

[1] DOI: 10.1016/S0165-1684(01)00120-7 · Zbl 0985.94006 · doi:10.1016/S0165-1684(01)00120-7
[2] DOI: 10.1137/S1064827596304010 · Zbl 0919.94002 · doi:10.1137/S1064827596304010
[3] DOI: 10.1162/089976603762552951 · Zbl 1047.68101 · doi:10.1162/089976603762552951
[4] DOI: 10.1073/pnas.0437847100 · Zbl 1064.94011 · doi:10.1073/pnas.0437847100
[5] DOI: 10.1162/089976601753196003 · Zbl 0993.68082 · doi:10.1162/089976601753196003
[6] Lee D. D., Nature 401 (21) pp 788– (1999)
[7] DOI: 10.1109/97.752062 · doi:10.1109/97.752062
[8] DOI: 10.1162/089976600300015826 · doi:10.1162/089976600300015826
[9] DOI: 10.1126/science.1066168 · doi:10.1126/science.1066168
[10] DOI: 10.1016/S0042-6989(97)00169-7 · doi:10.1016/S0042-6989(97)00169-7
[11] DOI: 10.1162/089976601300014385 · Zbl 0985.94004 · doi:10.1162/089976601300014385
This reference list is based on information provided by the publisher or from digital mathematics libraries. Its items are heuristically matched to zbMATH identifiers and may contain data conversion errors. In some cases that data have been complemented/enhanced by data from zbMATH Open. This attempts to reflect the references listed in the original paper as accurately as possible without claiming completeness or a perfect matching.