Sciweavers

137 search results - page 2 / 28
» Estimating Entropy and Entropy Norm on Data Streams
Sort
View
ESCAPE
2007
Springer
266views Algorithms» more  ESCAPE 2007»
14 years 7 days ago
CR-precis: A Deterministic Summary Structure for Update Data Streams
We present deterministic sub-linear space algorithms for a number of problems over update data streams, including, estimating frequencies of items and ranges, finding approximate ...
Sumit Ganguly, Anirban Majumder
TSP
2010
13 years 22 days ago
Independent component analysis by entropy bound minimization
A novel (differential) entropy estimator is introduced where the maximum entropy bound is used to approximate the entropy given the observations, and is computed using a numerical ...
Xi-Lin Li, Tülay Adali
IPMI
2007
Springer
14 years 6 months ago
High-Dimensional Entropy Estimation for Finite Accuracy Data: R-NN Entropy Estimator
Abstract. We address the problem of entropy estimation for highdimensional finite-accuracy data. Our main application is evaluating high-order mutual information image similarity c...
Jan Kybic
FOCS
2008
IEEE
14 years 15 days ago
Sketching and Streaming Entropy via Approximation Theory
We give near-optimal sketching and streaming algorithms for estimating Shannon entropy in the most general streaming model, with arbitrary insertions and deletions. This improves ...
Nicholas J. A. Harvey, Jelani Nelson, Krzysztof On...
ICASSP
2011
IEEE
12 years 9 months ago
Entropy estimation using the principle of maximum entropy
In this paper, we present a novel entropy estimator for a given set of samples drawn from an unknown probability density function (PDF). Counter to other entropy estimators, the e...
Behrouz Behmardi, Raviv Raich, Alfred O. Hero