搜索结果: 1-8 共查到“信息科学与系统科学基础学科 Entropy”相关记录8条 . 查询时间(0.093 秒)
Estimators for the Entropy Rate of Binary Hidden Markov Processes(英文)
Binary hidden Markov process entropy rate bound estimator,algorithm
2015/5/28
The entropy rate of a hidden Markov process (HMP) is important in theory and practical applications, but it is hard to get an analytical expression or obtain a numerical estimator. In this paper, a ne...
An information entropy approach to salience for survey-driven simulation
An information entropy approach to salience survey-driven simulation
2014/8/8
Interpreting a 2010 survey of Houston-area households subject to hurricane Ike in 2008, the di culty in inferring ex-ante preferences from ex-post survey responses is exacerbated by many of the respon...
Sumset and Inverse Sumset Inequalities for Differential Entropy and Mutual Information
Shannon entropy differential entropy sumset bounds inequalities submodularity data processing mutual information
2012/6/19
The sumset and inverse sumset theories of Freiman, Pl\"{u}nnecke and Ruzsa, give bounds connecting the cardinality of the sumset $A+B=\{a+b\;;\;a\in A,\,b\in B\}$ of two discrete sets $A,B$, to the ca...
R\'enyi entropy of order \alpha is a general measure of entropy. In this paper we derive estimations for the R\'enyi entropy of the mixture of sources in terms of the entropy of the single sources. Th...
Explicit Bounds for Entropy Concentration under Linear Constraints
maximum entropy concentration bounds linear constraints tolerances
2011/9/23
Abstract: Consider the construction of an object composed of $m$ parts by distributing $n$ units to those parts. For example, say we are assigning $n$ balls to $m$ boxes. Each assignment results in a ...
The entropy functional, the information path functional's essentials and their connections to Kolmogorov's entropy, complexity and physics
Additive functional Entropy Singularities Natural Border Problem Invariant
2011/8/31
Abstract: The paper introduces the recent results related to an entropy functional on trajectories of a controlled diffusion process, and the information path functional (IPF), analyzing their connect...
MAXIMUM ENTROPY METHODS FOR CONSTRAINED OPTIMIZATION AND MINIMAX PROBLEMS
Maximum entropy methods constrained opt
2007/8/7
This paper presents the maximum entropy methods for nonlinearly constrained optumzation and ndulmax problems. Some properties of these method are given. Convergence theorems of the maximum entopy meth...
On Entropy Rate Graph of Binary Hidden Markov Processes
Binary hidden Markov process entropy rate parameters relation
2015/5/28
The entropy rate of a hidden Markov process (HMP) is very useful in practical applications, but it is hard to compute. In this paper, the relations between entropy rate of binary hidden Markov process...