AIC stands for the Akaike Information Criterion, which is one technique used to select the best model from a class of models using a penalized likelihood. A smaller AIC implies a better model.

learn more… | top users | synonyms

0
votes
0answers
3 views

Does QIC (AIC) of a model need do be lower ten of a null model? [on hold]

I am begginer in statistics. I am working with GEE models winth geeglm function on R, I am comparing the models and what puzzeles me is if QIC (AIC) of a model need do be lower ten of a null model? ...
0
votes
0answers
40 views

Combining AIC and BIC

For my dataset of ~19K data points to cluster, I want to use a criterion to choose the number of clusters. BIC (Bayesian Information Criterion) gives too few clusters (~180) while AIC (Akaike ...
0
votes
0answers
25 views

Proportion of deviance explained > 1.0?

I have a series of linear mixed models fit by REML and selected among them using AICc. I usually present the proportion of deviance explained by each model as a measure of goodness of fit where ...
1
vote
0answers
13 views

AIC (QIC) - comparision of models?

I am comparing models created by geeglm function in R software. Does QIC of a model need to be lower than QIC of a null model? (in geeglm, geepack, R)
0
votes
0answers
13 views

Difference between non significant coefficient p-values and variable exclusion using AIC

I am trying to fit a linear regression model with two continuous explanatory variables and one factor with two levels. Rather than predictability, I am especially interested in the interpretability of ...
3
votes
1answer
19 views

Different AIC values in trace and final output in `auto.arima`

I am trying to fit a time series with function auto.arima in the "forecast" package in R that is choosing the best model automatically. Since I am using it for my ...
3
votes
1answer
16 views

Is it valid to reduce the AICc penalty for multiple variables, when some variables should be grouped?

I have a data set of mean trait values for each of 18 populations, and want to test whether several ecological variables are related to variation in traits. I'm using the corrected Akaike information ...
1
vote
0answers
25 views

Determine best ARIMA model with AICc and RMSE

I have done a training set to fit different ARIMA models and then a test set to assess their performance (with R). From what I understood, I can use the AICc to determine the best model by choosing ...
1
vote
0answers
33 views

AICc and value for k

Looking for some confirmation. We have a set of 12 soil water sensors and originally were planning on using RMSE to determine our best model of six for each sensor, but have since decided to include ...
1
vote
0answers
16 views

Averaging linear regression model using AIC's relative likelihood

I've learned here that when two models have a big relative likelihood, one could compute a weighted average of those models in order to estimate the "unconditional" variable effect. However, some ...
2
votes
1answer
26 views

Use of post hoc tests following model selection based on AIC

I am working on a dataset of vegetation characteristics recorded over three seasons in two different areas used by buffalo. I have run generalised linear mixed models to determine whether vegetation ...
8
votes
0answers
153 views

Simple linear regression, p-values and the AIC

I realise this topic has come up a number of times before e.g. here, but I'm still unsure how best to interpret my regression output. I have a very simple dataset, consisting of a column of x values ...
1
vote
0answers
25 views

Model comparison via AIC or BIC for different likelihood maximization procedures

Maximum likelihood estimation of different models (which all model the same variable and assume the same likelihood function) is done by a different method for each model. Simple numerical ...
0
votes
0answers
16 views

Assess the model of Multinomial Logistic Regression

Some people told me that AIC and residual deviance are good statistics to assess multinomial logistic regression model. But I don't know how to use it in multinomial logistic regression. Anyone here ...
0
votes
1answer
22 views

How are “MuMIn::mod.sel()” and “car::Anova()”/"lmerTest::anova() different for selecting the most optimal model? Is it only the AIC and AICc?

I want to compare several models built using the codes I have written in R for a mixed-effects model. I already knew that anova() function in car package provides <...
0
votes
0answers
11 views

Are models within 2 deltaDIC of each other considered equivalent?

I think its a rule when using AIC that should the best model be within 2 unit AIC of the second best model, both are considered with equal weight. Does the same rule-of-thumb apply to Deviance ...
2
votes
0answers
34 views

Comparing count data models?

I am trying to fit Negative binomial, Zero Inflated Negative Binomial, Negative Binomial Hurdle, and Random effects negative binomial. Here is the value of AIC for different model: Negative Binomial: ...
2
votes
1answer
37 views

What to conclude about these models? Random intercept + Fixed Slope vs. Random intercept and Slope

In the 'nlme' R package, for instance, I ran the following models: ...
9
votes
0answers
60 views

What does the Akaike Information Criterion (AIC) score of a model mean?

I have seen some questions here about what it means in layman terms, but these are too layman for for my purpose here. I am trying to mathematically understand what does the AIC score mean. But at ...
6
votes
1answer
110 views

What is the point of dividing data into training and test parts to assess prediction properties when we have AIC?

Asymptotically, minimizing the AIC is equivalent to minimizing the leave-one-out cross-validation MSE for cross-sectional data [1]. So when we have AIC, why does one at all use the method of dividing ...
3
votes
2answers
80 views

AICc is picking overly complex models - something stricter?

I'd like to know if there are stricter alternatives to automated model selection than AICc / AIC / BIC. We have approximately ten thousand curves, and for each we'd like to find the most parsimonious ...
0
votes
0answers
37 views

Multiple testing & model selection using AICc

I have a situation very similar to this post. I am finding the best-fit mixed effects model among a set of 5 candidate models for 7 different dependent variables (y1 to y7) using the same dataset of ...
1
vote
1answer
18 views

AIC of a two-part/hurdle model?

I have continuous data with a point mass at zero, so my plan is to use a two-part model where I first model whether an observation is zero or non-zero in a logistic regression and then model the ...
5
votes
1answer
98 views

Using the drop1 command in R and AIC

While using the drop1 command in R for model building, it is said the variable with the lowest AIC value must be dropped. What could be the reason for the same? I know AIC talks about information loss ...
1
vote
1answer
115 views

How freqently are the information conditons for proper Akaike information criterion application actually met?

Akaike information criterion (AIC) is limited to goodness-of-fit for assumed distributions. That is, for an assumed distribution (especially homoscedastic) one can assume a maximum likelihood function....
0
votes
1answer
40 views

ARMA model selection: in-sample vs. out-sample accuracy measures

I have a time series for 1000 days for many firms. I am interested to know, in general, on what basis I should select an ARMA model (the nature of my problem restricts integration order to 0). Should ...
0
votes
0answers
46 views

Why are the both of two models' AIC the same?

I would like to ask a question of AIC when we use Generalized Linear Model with R. I show you 4 my models. "x" is continuous variable. "f" is categorical variable and has two levels, C and T. "x*f" ...
0
votes
1answer
30 views

VAR model: include all lags up to AIC-suggested order or just the significant ones?

I'm building a regression model in which I have a dependent variable OSE, and two independent variables, MSCI and Brent. In this model I wish to include lagged variables. I performed an AIC for my ...
0
votes
1answer
52 views

AIC, model selection and overfitting

I am looking for references that specifically show that Akaike's Information Criterion (AIC), or its corrected form (AICc), can in some practical applications -- that is, not in the asymptotic regime -...
0
votes
0answers
19 views

Obtaining AICc weights after glm.nb

I am performing negative binomial regression using glm.nb() function from MASS package and calculating AICc using package "AICcmodavg". I need also to obtain the (AICc) weights using aictab() function ...
3
votes
1answer
35 views

Is AIC a valid criterion for the selection of variance structures in GLS?

In generalized least squares, I’ve specified a weights function that accounts for heterogeneity in residual variance that exist along the range of a covariate. The validation graphs (residuals ...
0
votes
0answers
16 views

range of possible values and model complexity

I have a prediction model where the likelihood is a function of two components $(A,B)$ $L \sim \bf{A}^\alpha + \bf{B}^\beta$ , where both $\bf{A}$ and $\bf{B}$ are $n\times n$ matrices ($n$ is the ...
1
vote
0answers
17 views

Model Averaging: Standard Error vs Adjusted Standard Error

I'm having trouble understanding when to use Std. Error or Adjusted SE in model averaging (model.avg). What/Why/When to use Adjusted SE? This is my code: ...
1
vote
0answers
31 views

AIC and nested models

There is a related question here but two highly upvoted answers there don't seem to agree with each other, and in any case I wanted to take a different tack. Is AIC useful for comparing: non-nested ...
1
vote
0answers
27 views

Different AIC values for the same SARIMA model in different R packages

I've been trying to run a simple time series model for a data set. My biggest question is when I run the auto.arima model (from package "forecast) for this data set ...
0
votes
1answer
41 views

logistic regression - class created with non significant coefficients?

I've created an example table (just in order to create a function) with: ...
1
vote
1answer
31 views

AIC on Savitzky-Golay width

I want to use a Savitzky-Golay filter to smooth some data. There is a right width to use based on the data that it is smoothing. A number of papers basically use "eyeball norm" on the parameters but ...
1
vote
0answers
19 views

Likelihood ratio test seems to show little difference between models with AICc difference of 3

I'm running a multinomial logistic regression analysis of the behavioural responses of deer to camera traps using no reaction, reaction and strong reaction as dependent variables and season, camera ...
3
votes
0answers
96 views

Variable selection vs Model selection

So I understand that variable selection is a part of model selection. But what exactly does model selection consist of? Is it more than the following: 1) choose a distribution for your model 2) ...
0
votes
0answers
20 views

Scenario of how to compare models

I have a binary classification problem where the distribution of classes is skewed. I've already trained some scoring models with logistic regression. Now I would like to compare them. How to do this ...
1
vote
0answers
17 views

Is it meaningful to compare a logit and probit model with the same no. of observations and independent variables using AIC and BIC?

For my dissertation i want to show that the logit and probit model produce the same results. So far i've compared the marginal effects, percent correctly predicted and done a scatter plot of the ...
6
votes
0answers
115 views

Does BIC try to find a true model?

This question is a follow-up or attempt to clear up possible confusion regarding a topic I and many others find a bit difficult, regarding the difference between AIC and BIC. In a very nice answer by @...
1
vote
0answers
13 views

Comparing categorical variable importance across groups; zero and one beta regression

I am attempting to compare behavioral responses across two species (one native and one invasive). Predictors run the range of types including continuous (size), discrete (day of trial) and ...
0
votes
0answers
22 views

How can a result from reduced mixed model be insignificant (with smaller BIC and AIC) when the whole model gave significant results

Hi I have made a linear mixed model with a number of covariants that could be relevant to control for. This entire model gave me a significant result. However when I reduce the model, removing the ...
0
votes
0answers
81 views

Log-likelihood ratio test vs. information criteria for model selection

I am trying to select the model with the best fit among GARCH(1,1), ARMA(2,2) and GJR-GARCH(1,1) models for a time series of log returns. The results from IC (Akaike, Bayesian) and likelihood-ratio ...
1
vote
0answers
32 views

Justification for AIC/BIC vs F-statistic when using stepwise backward elimination

I note that some stepwise backwards elimination methods use AIC to make the decision about which variables to eliminate, and others use the F-statistic. Why would I use one over the other, and is ...
0
votes
1answer
36 views

Using AICc distributions to assess goodness-of-fit and model selection

I have a couple of ordinary differential equation models that I'm trying to fit to time-dependent biological data ($y_n$). One model is more complex than then other as it has more free parameters. I ...
1
vote
1answer
42 views

Is it inherently invalid to use BIC for model averaging?

If I understand AIC/AICc vs. BIC correctly, AIC presumes that there is no "true" model and that any given model is simply a "best worst approximation". However, BIC presumes that there IS a "true" ...
1
vote
1answer
26 views

Model comparison: better AIC, but worse Mean Actual/Predicted Response

I have made two regression models using gamma regression, and fitted them to 80% of my data, with the intention of doing out-of-sample analysis on the 20%. Model 2 is just Model 1, with one extra ...
0
votes
0answers
13 views

Usage of AIC for comparing models [duplicate]

Can AIC be used to compare a model with exponential smoothing with linear regressions?