The likelihood ratio is the ratio of the likelihoods of two models (or a null and alternative parameter value within a single model), which may be used to compare or test the models. If either model is not fully specified then its maximum likelihood over all free parameters is used - this is ...

learn more… | top users | synonyms

0
votes
0answers
5 views

Fit statistics and imputed data

I have a general question about pooling fit statistics when using multiple imputations. I am trying to pool the AIC, BIC, G-squared, or log likelihood across 10 imputed data sets. Is it possible to ...
4
votes
2answers
41 views

Can I use likelihood-ratio test to compare two samples drawn from power-law distributions?

I have to compare two large samples ($N = 10^{6}$) of discrete data drawn from power-law distributions to assess whether they are significantly different. I can't do that by means of ...
0
votes
0answers
4 views

Heterogeneity test for risk factor association (hazard ratio/coefficient) in two or more different survival outcomes

Suppose I'm interested in comparing smoking category (current, ex, non-smoker) as a risk factor in two or more different but similar (considerably exclusive) outcomes, say lung cancer of different ...
4
votes
1answer
67 views

Likelihood ratio test disagrees with cross-validation results

I have computed two logistic models of the same data (for different formulas) in R, and compared them using likelihood ratio test: ...
1
vote
0answers
36 views

Likelihood Ratio and Expected Value Relationship

I am to prove that: 1) The expected value of (Λ^n|H_1) = E(Λ^(n+1)|H_0) 2)The expected value of (Λ|H_0) = 1 where Λ is the likelihood ratio. I know that the likelihood ratio is equal to ...
0
votes
1answer
50 views

Should I include this fixed effect? lme4 likelihood ratio test and lmerTest anova disagree

I have a mixed-effects model with two fixed effects and one random effect (group membership) estimated using lme4. log_dv ~ iv1 + iv2 + (1 | group) I want to ...
1
vote
0answers
14 views

Testing sequentially nested models

Assume I have a simple model with (at least) four parameters $\beta_1, \beta_2, \beta_3, \beta_4$. If I would want to test $H_o: \beta_1 = \beta_2 \& \beta_3 = \beta_4$ by using the likelihood ...
9
votes
2answers
211 views

Random- and fixed-effects structure in linear-mixed models

Consider the following data from a two-way within subjects design: ...
3
votes
1answer
104 views

Understanding confidence intervals in Firth penalized logistic regression

I recently discovered penalized likelihood ratio methods to cope with sparse and/or separated data. I'm having some problems though in understanding the results a logistic regression using Firth ...
0
votes
1answer
35 views

Finding maximum likelihood estimates of parameters of multiple normal populations

I've just started studying maximum likelihood and likelihood ratio tests. I've calculated the maximum likelihood of a normal population with unknown mean and variance. However, I've been given this ...
1
vote
1answer
42 views

Probability of a model given an image

I would like to write the likelihood function for an image with respect to theoretically predicted values. Assuming uniform Gaussian noise, the pixels are statistically independent, and we can write a ...
1
vote
1answer
71 views

Compare poisson and negative binomial regression with LR test

My question is related to the question Compare negative binomial models. I have some difficulties understanding UCLA guide in http://www.ats.ucla.edu/stat/r/dae/nbreg.htm (I am using ...
5
votes
1answer
210 views

Why do p values for test of likelihood ratio vs Fisher's Exact Test not agree

In a 2x2 analysis of categorical data, what causes the p value for the test of the likelihood ratio to differ from both the Fisher's Exact Test and the test of linear-by-linear Association? ...
1
vote
0answers
18 views

Joint significance testing w/ large samples

long time listener, first time caller. Unfortunately I can't show code as the computer the analysis is done on has rather tight security. I need to test for joint significance in a logit model that ...
0
votes
0answers
36 views

Generalized likelihood ratio test

Does anyone use the generalized likelihood ratio test for detecting a sudden change in time series forecasting (ARIMA Model)? A paper by Bonne Zhu uses this technique for anomaly detection, but I ...
1
vote
1answer
106 views

Likelihood ratio test for comparing two exponential distributions

I am trying to use a likelihood ratio test to compare the parameters of two exponential distributions. by this thread Likelihood Ratio for two-sample Exponential distribution I found that I can use ...
2
votes
2answers
142 views

Testing whether the coefficients of one model and another are statistically significantly different

I am currently testing two models which have the exact same specification except for one is when z=0 and when z=1, where z could be something like male and female. Essentially, the effect of X on Y if ...
0
votes
0answers
15 views

Degrees of freedom when splitting populations

I have a question relating to degrees of freedom when I have a number parameters in a model for a population, and then I want to split the population. Say for a certain population I have a the ...
0
votes
0answers
14 views

Help finding critical on a hypothesis contrast

I´ve tried finding the variance using the moment-generating function but apparently that is not the correct method for finding the critical. Can you help me with this?
0
votes
0answers
33 views

Compare linear mixed models with Likelihood ratio tests and significant fixed effects

I am comparing two models with likelihood ratio tests and I have found the -2LL increases with the more complex model (when a 3-way interaction between 3 fixed effects is included). However, the tests ...
5
votes
1answer
167 views

How to choose between exponential and gamma distributions

I have same data and I would like to choose a model for it. To start with I fit an exponential distribution and a gamma distribution. Now I wanted to do a simple likelihood ratio test . However, I ...
1
vote
1answer
48 views

Normalized likelihoods

AIC (BIC) model selection methods are widely used. These methods can select non-nested models unlike likelihood ratio type selection that requires model to be nested. The AIC has definition ...
1
vote
0answers
54 views

Likelihood Ratio as statistical test for Transfer Entropy with MatLab

I estimated a Transfer Entropy value TE(XY). Now I want to establish the statistical significance of the estimated value. Therefore I used the method of shuffled surrogates to estimate a shuffled ...
0
votes
2answers
58 views

Likelihood ratio test to determine if average number of accidents has dropped?

I can't find any worked (non-trivial) practical example for a likelihood ratio test, believe me I have spent hours looking. Here is a question I've been trying to complete but I can't get any further. ...
3
votes
0answers
44 views

Motivating likelihood ratio test vs Wald test for paper reviewer

I've got back reviews for a paper I've submitted, with the following problem. I have two logistic regression models, say y ~ A, and y ~ A + B, where B is a factor with several levels. I have ...
3
votes
1answer
75 views

Constrained Maximization and Likelihood Ratio Tests for Nested Linear Models

Suppose $\boldsymbol \beta \in \mathbb{R}^k$ is a vector of coefficients for a generalized linear model with $g \left[ E(Y|X) \right] = X\beta$ for a link function $g$ and I wish to test the composite ...
4
votes
2answers
110 views

Generalized log likelihood ratio test for non-nested models

I understand that if I have two models A and B and A is nested in B then, given some data, I can fit the parameters of A and B using MLE and apply the generalized log likelihood ratio test. In ...
6
votes
1answer
267 views

Question about Dynkin Lehmann Scheffe Theorem

I'm self-studying for an examination, and I would like to understand how to use the Dynkin Lehmann Scheffe theorem for an applied question. I am using Bickel and Doksum's "Mathematical Statistics" ...
1
vote
0answers
241 views

Clarification on interpreting Wald's test and Likelihood ratio tests

I am running multinomial logistic regression analysis on my data. The response variable is the number of calves produced each year (0,1, or 2). I am trying to evaluate the influence of the X ...
5
votes
1answer
111 views

Goodness of fit likelihood ratio test with zero values

I have a vector of observed frequencies that have zero values in some cells and a vector of expected frequencies generated by a model. I would like to do a likelihood ratio test rather than a chi ...
2
votes
0answers
139 views

Hypothesis Testing of endpoint of Uniform distribution

Let $c$ be a positive constant. Suppose I have $X$~$Unif(0,\theta)$ and I wish to test the null hypothesis $H_0: \theta \leq c$ against the alternative hypothesis $H_1:\theta > c$. Suppose I did a ...
12
votes
1answer
276 views

Why doesn't Wilks' 1938 proof work for misspecified models?

In the famous 1938 paper ("The large-sample distribution of the likelihood ratio for testing composite hypotheses", Annals of Mathematical Statistics, 9:60-62), Samuel Wilks derived the asymptotic ...
0
votes
1answer
47 views

fitting LMEMs for repeated measures with no correlation between intercept and slope

For a simulation study, I contrast the power of different LMEMs for repeated measures. To get p-values, I use likelihood ratio tests where I compare a model including a fixed treatment effect with one ...
2
votes
1answer
360 views

What are the regularity conditions for Likelihood Ratio test

Could anyone please tell me what the regularity conditions are for the asymptotic distribution of Likelihood Ratio test? Everywhere I look, it is written 'Under the regularity conditions' or 'under ...
3
votes
1answer
368 views

Wald test and Likelihood ratio test, where do the confidence intervals on the regression coefficients come from?

So I'm trying to build my own Wald test and likelihood ratio test code within a machine learning pipeline. I can get the final fitted logistic regression coefficients from liblinear. I'm coding in ...
0
votes
0answers
39 views

Likelihood ratio tests versus signed likelihood ratio tests

What is the difference between likelihood and signed likelihood ratio tests (SLRT)? What is the use of having the "sign" function in it? In short, what is the advantage of having SLRT over LRT? ...
1
vote
0answers
58 views

How to formulate a likelihood ratio test for an exponential distribution? [duplicate]

Find the form of the likelihood ratio test of $H_0 : \lambda = \lambda_0$ against $\lambda\neq\lambda_0$ when $X_1,X_2,...,X_n$ is a random sample from $Ex(\lambda)$. Simplify it as much as ...
3
votes
0answers
343 views

Neyman-Pearson lemma: critical region and hypothesis testing

Let $X_1,X_2,...,X_n$ be i.i.d r.v's with common p.d.f. $$ \mbox f(x)=\frac{x^5e^{-x/\theta}}{5!\theta^6} $$ where $\theta$ > 0. Show that the Neyman-Pearson lemma produces a test of ...
0
votes
0answers
58 views

Type I error in t tests and LRT

In situations where unequal variance t-test is appropriate, if we use equal variance t-test, type I error would be inflated. I created a likelihood ratio test (LRT) equivalent of unequal variance ...
3
votes
1answer
281 views

Likelihood Ratio Test and boundary parameters

The chi-square approximation of the distribution of the test statistic in Likelihood Ratio Test (LRT) may not be reliable if a parameter of a model is on the boundary of a parameter space --- is ...
0
votes
0answers
56 views

Likelihood ratio test statistic

Let $X_{1},..,X_{n}$ be a random sample from a normal distribution with mean ${\theta}$ and variance 1. Let $H_{0}:{\theta}=0$ and $H_{1}:{\theta}{\neq}0$. Using likelihood ratios, show the critical ...
0
votes
0answers
43 views

hypothesis test likelihood ratio

Let $X_{1},..,X_{36}$ be a random sample from a bernouilli distribution with parameter $p$. Suppose the sample probability is $1/3$. Using a norml approximation and likelihood ratios, we wish to test ...
1
vote
1answer
225 views

Log-Likelihood Ratio Test: Difference of Equations

I have noticed that the sign at the front of the log-likelihood ratio formula changes depending on what source I have been looking at. Below are the two formula I have seen, exactly as they were ...
10
votes
2answers
392 views

What is the relationship between the GINI score and the log-likelihood ratio

I am studying classification and regression trees, and one of the measures for the split location is the GINI score. Now I am used to determining best split location when the log of the likelihood ...
2
votes
0answers
224 views

One-Sample t Test and Likelihood Ratio Test

Concerning testing the hypotheses about the mean $\mu$ of a single population I know of things like the One-Sample $t$ test where there is a null hypothesis: $H_0: \mu = \mu_0$, and a test statistic ...
1
vote
0answers
20 views

Empty asymptotic confidence interval?

I have a sample $x=(4, 3, 1, 2, 2, 2, 2, 5, 7, 3, 1, 2, 3, 4, 3, 2, 3, 3, 3, 4)$ of size $n=20$. from a binomial distribution with 10 trials and probability of success $p$. I am asked to construct the ...
1
vote
1answer
206 views

What is it meant by the “rejection region” and “power” of a likelihood ratio test?

Suppose that $X_1,...,X_n$ are i.i.d. data from a $N(\mu, 100)$ distribution. I am trying to find the rejection region for the likelihood ratio test for level $\alpha= 0.10$ of the test: $H_0: \mu = ...
2
votes
0answers
59 views

Autoregressive Markov chain simulation and the likelihood ratio test for Markov property

I am trying to estimate a Markov chain of second order (Markov chain that fulfills $P[X_t|X_{t-1},X_{t-2}]=P[X_t|X_{t-1},X_{t-2},...,X_{t-p}]$) using an AR(2) process. Once I have simulated the ...
4
votes
1answer
293 views

Hypothesis testing with Neyman–Pearson (finding cutoff quantile of Poisson dist)

I am currently trying to solve a problem that should be very easy, yet I am stumped, and help would be GREATLY appreciated!! The background of the question is this: Q: The number of typing errors in ...
2
votes
0answers
28 views

Ways the likelihood ratio test may fail

I have a question related to: Why is a likelihood-ratio test distributed chi-squared? On point 2 of @StasK's answer, he states: The theorem assumes that all the relevant derivatives are ...