Independent Component Analysis - Binary Independent Component Analysis

Binary Independent Component Analysis

A special variant of ICA is Binary ICA in which both signal sources and monitors are in binary form and observations from monitors are disjunctive mixtures of binary independent sources. The problem was shown to have applications in many domains including medical diagnosis, multi-cluster assignment, network tomography and internet resource management.

Let be the set of binary variables from monitors and be the set of binary variables from sources. Source-monitor connections are represented by the (unknown) mixing matrix, where indicates that signal from the i-th source can be observed by the j-th monitor. The system works as follows: at any time, if a source is active and it is connected to the monitor then the monitor will observe some activity . Formally we have:


x_i = \bigvee_{j=1}^{n}{(g_{ij}\wedge y_j)}, i = 1, 2, \ldots, m,

where is Boolean AND and is Boolean OR. Note that noise is not explicitly modeled, rather, can be treated as independent sources.

The above problem can be heuristically solved by assuming variables are continuous and running FastICA on binary observation data to get the mixing matrix (real values), then apply round number techniques on to obtain the binary values. This approach has been shown to produce a highly inaccurate result.

Another method is to use dynamic programming: recursively breaking the observation matrix into its sub-matrices and run the inference algorithm on these sub-matrices. The key observation which leads to this algorithm is the sub-matrix of where corresponds to the unbiased observation matrix of hidden components that do not have connection to the -th monitor. Experimental results from show that this approach is accurate under moderate noise levels.


Read more about this topic:  Independent Component Analysis

Famous quotes containing the words independent, component and/or analysis:

    Milton’s the prince of poets—so we say;
    A little heavy, but no less divine:
    An independent being in his day—
    George Gordon Noel Byron (1788–1824)

    ... no one knows anything about a strike until he has seen it break down into its component parts of human beings.
    Mary Heaton Vorse (1874–1966)

    Analysis as an instrument of enlightenment and civilization is good, in so far as it shatters absurd convictions, acts as a solvent upon natural prejudices, and undermines authority; good, in other words, in that it sets free, refines, humanizes, makes slaves ripe for freedom. But it is bad, very bad, in so far as it stands in the way of action, cannot shape the vital forces, maims life at its roots. Analysis can be a very unappetizing affair, as much so as death.
    Thomas Mann (1875–1955)