CORR
2007
Springer
13 years 4 months ago
2007
Springer
We propose a definition for the entropy of capacities defined on lattices. Classical capacities are monotone set functions and can be seen as a generalization of probability mea...
IM
2006
13 years 4 months ago
2006
We consider the problem of computing information theoretic functions such as entropy on a data stream, using sublinear space. Our first result deals with a measure we call the &quo...
IJUFKS
2006
13 years 4 months ago
2006
When using the ordered weighted average operator, it can happen that one wants to optimize the variability (measured by the entropy (maximal) or by the variance (minimal)) of the ...
CORR
2007
Springer
13 years 4 months ago
2007
Springer
— While most useful information theoretic inequalities can be deduced from the basic properties of entropy or mutual information, Shannon’s entropy power inequality (EPI) seems...
CORR
2006
Springer
13 years 4 months ago
2006
Springer
Let X be a discrete random variable with support S and f : S S be a bijection. Then it is wellknown that the entropy of X is the same as the entropy of f(X). This entropy preserva...
CORR
2006
Springer
13 years 4 months ago
2006
Springer
In this paper, both non-mixing and mixing local minima of the entropy are analyzed from the viewpoint of blind source separation (BSS); they correspond respectively to acceptable a...
ECCC
2010
13 years 4 months ago
2010
We investigate the complexity of the following computational problem: Polynomial Entropy Approximation (PEA): Given a low-degree polynomial mapping p : Fn Fm , where F is a finite...
CORR
2008
Springer
13 years 4 months ago
2008
Springer
Information estimates such as the "direct method" of Strong et al. (1998) sidestep the difficult problem of estimating the joint distribution of response and stimulus by...
CORR
2010
Springer
13 years 4 months ago
2010
Springer
Algorithmic entropy can be seen as a special case of entropy as studied in statistical mechanics. This viewpoint allows us to apply many techniques developed for use in thermodyna...
CORR
2010
Springer
13 years 4 months ago
2010
Springer
A number of measures have been proposed for the direction of the coupling between two time series, and transfer entropy (TE) has been found in recent studies to perform consistentl...