The Stack Overflow podcast is back! Listen to an interview with our new CEO.

Questions tagged [maximum-entropy]

maximum entropy or maxent is a statistical principle derived from information theory. Distributions maximizing entropy (under some constraints) are thought to be "maximally uninformative" given the constraints. Maximum entropy can be used for multiple purposes, like choice of prior, choice of sampling model, or design of experiments.

126 questions
Filter by
Sorted by
Tagged with
30 views

How can a probability densitiy be estimated based on the maximum entropy principle, with constraints in the order statistics?

Let's say we are given a sample $\{ z_i \}$, $i=1,2,\ldots,N$, such that each value $z_i$ corresponds to the minimum of $n$ random variables $x$, i.e., $z = \min \{ x_1, x_2,\ldots,x_n \}$. The ...
16 views

129 views

The intuition of maximum entropy [duplicate]

I see a lot of implementation of maximum entropy. Can someone explain why it is possible to estimate the parameter based on maximum entropy?
123 views

What is the minimum (differential) entropy at a given variance?

Given a set of samples $S$ from an unknown multidimensional real-valued distribution, I use the multivariate normal distribution $N(\mu(S),\Sigma(S))$ to compute its upper entropy limits. This is ...
67 views

Clarifying Berger et al. “A Maximum Entropy Approach to NLP”

Unfortunately, I do not know where else to turn to for clarifications that I require regarding the notations and definitions in the initial sections of the paper by Berger et al (1996). In Section 3....
835 views

What is the best way to perform sentence segmentation for textual analysis?

I am working on textual dataset containing data from official documents like reports by companies, legal documents, speeches by directors to shareholders etc. The content of textual documents are like:...