We’re rewarding the question askers & reputations are being recalculated! Read more.

# Questions tagged [optimal]

For questions about optimality properties of statistical methods, such as optimal parameter estimation or optimal testing. Both for questions about optimality theory in general, and for questions about optimality properties of specific procedures.

32 questions
Filter by
Sorted by
Tagged with
32 views

### D-optimal DOE suggest repeated samples

I tried to generate a D optimal design but the design output sounds very weird to me. I have a (real) process and I`d like to explore 3 factors, but the process have a lot of constraints so I provide ...
18 views

### Finding the 'optimal distribution' with one unknown variable

I am trying to find the optimal distribution (of ingredients) with one unknown parameter (skillset). Example, when baking a bread the ingredients are flour,salt,yeast and water. When I ask 100 ...
16 views

### How does caret package choose the optimal parameters when there are several such values?

First Example I fitted the following penalized logistic regression model using caret package as follows, ...
28 views

### Covariance matrix for a 2D state vector

I'm performing Optimal Interpolation (which in fact is a simplified Kalman filter with constant $\mathbf{K}$). My state variable is a 2D concentration field with a size of 370 x 400 on which I try to ...
58 views

### Coefficients in Optimal Separating Hyperplane(SVM)

This question is closely related to Elements of Statistical Learning p.132 - p.134. I want to reproduce the , in p.129 and p.134, respectively. This is a toy example without given any data, so I ...
10 views

### How to find difference in optimal results v/s result from Heuristic algorithm?

my question states my problem. In my case, I have a resource allocation problem. The optimal solution can be obtained by using the brute-Force (BF) method. However, I have designed two different ...
21 views

### What is the best algorithm so far for probabilistic adaptive group testing?

I am checking https://en.wikipedia.org/wiki/Group_testing#Classification_of_group-testing_problems but could not figure out the answer. I am focusing on probabilistic adaptive group testing. The ...
134 views

### Rejection sampling for optimal $\lambda$ and $a$

Suppose $f(x) \propto \exp ({-(x-u)^2\over2\sigma^2}) I_{X>=a}$ and we cannot compute the normalizing constant. Consider rejection sampling using proposal density of a shifted exponential ...
34 views

37 views

### At which rank should I reasonably stop selecting interview candidates?

It seems that my problem could be classified as an "optimal stopping" problem, but I am unable to make much of this information. It is an important problem for my organisation (an NGO), in order to ...
226 views

### What's the difference between “Optimal linear predictor” and “best unbiased linear estimator”?

Greene (econometric analysis 7th ed. p 53) states that OLS is the "optimal linear predictor": Then on the next page, he states that OLS is also the BLUE estimator (Gauss-Markov Theorem): I ...
301 views

### Estimator that is optimal under all sensible loss (evaluation) functions

Consider a probability distribution $D$ with a parameter $\theta$ and an i.i.d. sample $S$ from that distribution. I am interested in an estimator $\hat\theta(S)$ of $\theta$ that satisfies the ...
31 views

### Feature scaling and equivalence of the mean squared loss function optimal solutions

When applying the feature scaling, what is the mathematical proof that the optimum of the mean squared loss function is the same in both without-normalisation case and with-normalisation of the ...
187 views

### Does there exist an analogous statement to BLUE (Gauss-Markov) for GLMs?

I recall from my graduate school days that the Gauss-Markov (GM) theorem states that the Best Linear Unbiased Estimator (BLUE) in a linear regression is $\vec{\beta}=(X^TX)^{-1}X^T\vec{y}$. An amazing ...
22 views

### Relationship between 4SID and 4DVAR

Background: The "4SID" method allows one to back analytic models from data using a form similar to that of a Kalman filter. (1) The 4DVAR is an approach to use data with an analytic model for weather ...
78 views

### D-optimal mixture design- poor evaluation of design

My problem is related to the design evaluation of my set of experiments. I am trying to design a mixture of 4 materials, each having certain minimum and maximum dosage constraints. To come up with a ...
26 views

### Bayes decision boundary naming [duplicate]

Why the optimal classifier is called "Bayes". I do not see the connection with being Bayesian or so. Edit: This question asks about naming. Not about math. Another phrasing of the question: Given ...
82 views

### What parameter to use when testing a SVM classifier on an independent test dataset?

I am trying to make a classifier that effectively distinguishes between control group and patient group, and then I want to use that classifier to distinguish high-risk patients who convert to patient ...
265 views

I'm starting out learning about gradient descent, and have a couple of conceptual questions. I noticed a common pitfall of gradient descent is getting stuck in the local optima. How can this be ...
27 views

### Existence of ε-optimal Borel measurable policies in stochastic control

I am reading the book "Stochastic Optimal Control: The Discrete Time Case", by Bertsekas and Shreve (hereafter called "the Book"), and I recently observed that a statement made in page 10 of the book (...
927 views

### Most efficient estimator of mean

Let's say we want to estimate a mean $E[F]$ for some unknown distribution $F$. If we only care about the MSE (and don't mind using biased and non-linear estimator), what theory is available to help us ...
24 views

### What type of statistical models would be useful for evaluating an athlete's performance?

Suppose a performance athlete wants to use statistics to design an optimal exercise regimen. The goal of the statistical model should be to essentially maximize the performance of the athlete by ...
79 views

### Probability of correct classification with optimal Bayes when increasing number of features

Consider the optimal Bayes classifier applied on a problem with N features. Let its probability of correct classification be $$P_N(corr)$$ Assume that we add an extra feature (so now we have N + 1 ...
94 views

### UMVUE of parameter $(1-\sigma^2)^{-\frac{n}{2}}$

suppose $X_1,X_2,\ldots,X_n$ be random sample of $N(0,\sigma^2)$. how can I calculate UMVUE of parameter $(1-\sigma^2)^{-\frac{n}{2}}$
6k views

### Chosing optimal k and optimal distance-metric for k-means [duplicate]

I have a data-set with roughly 20-dimensions and millions of points which I want to cluster. The goal is to find a set of clusters which: Are as distinct as possible from each other (minimum ...
1k views

417 views

### Drawing numbered balls from an urn

PROBLEM There is an urn with a set of balls where each ball is labeled with a different integer. The numbers on the balls are known and are not a range of integers. For example the set of balls could ...
Suppose I draw a sample from one of the two possible random variables $X$ or $Y$ where $X\sim\text{Binomial}(p,N)$ and $Y=A+B$ with $A\sim\text{Binomial}(p,M)$ and $B\sim\text{Binomial}(q,N-M)$. ...