AIC stands for the Akaike Information Criterion, which is one technique used to select the best model from a class of models using a penalized likelihood. A smaller AIC implies a better model.

learn more… | top users | synonyms

0
votes
0answers
11 views

G and R matrices in mixed model and model selection

I have data in which the plants were subjected to four conditions and measured weekly for a month. I would like to incorporate "plot" as a random factor into my linear mixed model using SPSS. I am ...
0
votes
0answers
13 views

Can we use the AIC values to compare a hurdle poisson model to a multinomial logit model?

I estimated two different models using an SP survey: Hurdle poisson and multinomial logit with 5 alternatives. My dependent variable is the number of weekly trips (0,1,2,3,4,5 trips) that students ...
0
votes
0answers
5 views

Relative variable importance for simple model set

I am evaluating models based on AIC. I started by running the simplest models and the dot model (no covariates) is the best model, with little support for any others. When reporting the relative ...
0
votes
0answers
4 views

multimodel inference when using rms package

I would be glad to have some advise about how to proceed with multimodel inference to obtain weighted estimates based on AICc after running ordinal logistic analyzes with "rms' package. I used the ...
2
votes
1answer
16 views

Model averaging when linear and quadratic effects are modeled in a global model

I am trying to derived estimates of model-averaged parameter effects on a fairly complicated set of models using an information-theoretic approach. I have several models that investigate continuous ...
0
votes
0answers
6 views

Is there a BIC or AIC formula for correcting a G-statistic?

I am using the G-test (http://en.wikipedia.org/wiki/G-test) for scoring models with different numbers of parameters in a model comparison problem. Is there a BIC or AIC formula to correct a ...
1
vote
0answers
29 views

Diagnostics for logistic regression and how to include/interpret interactions between categorical and continous variables?

I am working on a project that aims to identify the factors that affect the probability of detecting targets placed in different habitats in aerial photographs. I have done a lot of reading concerning ...
-1
votes
0answers
29 views

Model selection using AIC and BIC approach [duplicate]

What are the measures AIC and BIC actually mean? How they are used to select a model from any two competing models of the same data? Please some one illustrate it with an example.
2
votes
1answer
15 views

AIC: relative versus absolute predictive error

I've read two interpretations of Akaike's Information Criterion (AIC) that seem to be in conflict, and I was hoping that someone could help me understand how to reconcile them. Interpretation 1: ...
2
votes
1answer
108 views

Suitable metric for consistency of parametric models

When fitting a parametric model to a data set assuming that our selected model class contains the truth, what performance metric should be used so that parameters converge to the truth as sample size ...
2
votes
2answers
72 views

comparing non nested models with AIC

say we have to glmms mod1 <- glmer (y ~ x + A + (1|g) data= dat) mod2 <- glmer (y ~ x + B + (1|g) data= dat) These models are not nested in the usual sense ...
1
vote
1answer
36 views

Calculation AIC without loglikelihood-function

I want to calculate the AIC without calculating the loglikelihood-function (which seems complicated). If the residuals are normally distributed, this can be done, according to wikipedia, as follows: ...
2
votes
2answers
41 views

AIC criterion: definition

I have two questions regarding the AIC criterion : AIC=$2k-2ln(l)$ Where does the number 2 comes from? As we usually minimize it why don't we consider only : $k-ln(l)$. (Maybe I am missing ...
1
vote
1answer
24 views

model comparison when alternatives are not all nested within one another

I am running a glmm with three fixed effects: opponent 1 size ("1") opponent 2 size ("2") opponent 1 size - opponent 2 size ("diff") I am unable to run all three variables in the model at once ...
0
votes
0answers
43 views

how to extract AIC(Akaike's Information Criterion) in LAR(Least Angle Regression) in R Studio?

I'm already done in conducting the whole LAR Algorithm using lars() function in R Studio. But my problem is how to extract or use AIC in R Studio for choosing enough the number of variable that will ...
1
vote
1answer
40 views

Comparing two models

I am interested in comparing two logistic regression models. The two models are nested: model 1 contains all predictors, and model 2 contains all predictors except 1. My goal is to test if removing ...
1
vote
0answers
30 views

the role of AIC versus p-values in model selection

Let's say you are trying to choose between two models. One has two significant fixed effects. The other includes only one of the two fixed effects from the aforementioned model but has a lower AIC ...
1
vote
0answers
32 views

Model selection using mean AIC for very huge data sets

I want to select a model which best performs for a very huge data set. However, the data set is too large to calculate a model within reasonable time. If this is the case, is the following a ...
1
vote
1answer
40 views

Choosing between two parameters in a model

I have a few parameters that are related (let's call them X1 and X2), and I want to use whichever one will provide the strongest model. The model has many other parameters. Would I simply be able to ...
1
vote
1answer
36 views

AICc and K for categorical factors and interactions

I am new to multimodel inference. I am trying to create a model that has multiple categorical factors and possible interactions. For example say that my model is... Y ~ X1 + factor(X2) + ...
1
vote
1answer
32 views

Can AIC be used to compare an ARMA model to an ARMA-GARCH model?

Suppose I have one time series and two competing models that describe it. Model 1 is ARMA$(p_1,q_1)$, model 2 is ARMA$(p_2,q_2)$-GARCH$(r,s)$. I obtain AIC values of model 1 and model 2. I would ...
1
vote
1answer
40 views

Normalized likelihoods

AIC (BIC) model selection methods are widely used. These methods can select non-nested models unlike likelihood ratio type selection that requires model to be nested. The AIC has definition ...
4
votes
1answer
54 views

Prediction vs. Explanation and its Effect on Statistical Methods [duplicate]

In layman's terms, what is the difference between predicting and explaining in statistics? I was looking for the differences between AIC and BIC and found this post with an answer stating: My ...
1
vote
0answers
22 views

Number of parameters for AIC for a particular model

I know there have been a few well answered questions on this topic, but i have found myself in a bit of a special case this time. I am using AIC for model selection, and i am having trouble counting ...
0
votes
1answer
33 views

Correlation between predictor variables in an AIC model

I'm using multinomial logistic regression analysis to analyse deer behavioural responses to camera traps based on 7 predictor variables. I have 2 models which are very close together in AIC value ...
12
votes
5answers
397 views

What is the upside of treating a factor as random in a mixed model?

I have a problem embracing the benefits of labeling a model factor as random for a few reasons. To me it appears like in almost all cases the optimal solution is to treat all of the factors as fixed. ...
1
vote
0answers
16 views

Choosing models with similar AIC values [duplicate]

I'm using a multinomial logistic regression analysis to examine deer behavioural responses to camera traps in terms of 7 predictors (both singly and their interactions). I have found that the model ...
0
votes
1answer
40 views

Understanding output stepAIC

I am using the stepAIC function in R to do a bi-directional (forward and backward) stepwise regression. I do not understand what each return value from the function ...
1
vote
0answers
42 views

How can I use Akaike's Information Criterion to compare two models of multi-peaked emission spectra?

I have several photoluminescence emission spectra that I am trying to fit curves to. The spectra each have a slight baseline and four peaks. The independent variable $x_i$ is wavelength (converted to ...
2
votes
2answers
56 views

Is cross validation for validating a model or for selecting best model in different kinds of models?

I am confused about the concept of cross validation and its usage. As I read about cross validation before, it is a way of validating a model. I did cross validation in my project (developing ...
0
votes
0answers
25 views

Akaike test and random effect model

I am analyzing a panel data (25 years x 30 countries) through OLS, FE, RE and mixed model (xtmixed). The results I get from the LM test and the Hausman show that I have to focus on the RE model. For ...
0
votes
0answers
14 views

IT-AIC approach for mixed effects model

I was reading around the Information Theoretic-AIC approach of model selection where AIC values are used to select the candidate set of models. I am quite clear on this. My question is this: for ...
1
vote
0answers
108 views

Model diagnostics for a glmmPQL in R mixed-effects model

Several texts (both online and published books) have been reviewed prior to asking this. What diagnostics are accepted as best practise for a generalised linear mixed-effects model fitted in R using ...
6
votes
2answers
209 views

AIC, BIC and GCV: what is best for making decision in penalized regression methods?

My general understanding is AIC deals with the trade-off between the goodness of fit of the model and the complexity of the model. $AIC =2k -2ln(L)$ $k$ = number of parameters in the model $L$ = ...
1
vote
0answers
33 views

Model without endogeneity correction has lower AIC than one with correction

I have two models, one with endogeneity correction (includes correction terms obtained using Heckman) and one without. The correction terms are significant in the second stage model, yet the AIC/BIC ...
0
votes
2answers
193 views

Unimodal or bimodal data (MATLAB)?

I am trying to figure out what I did wrong or what I could do to get accurate results. I have n vectors of data, and I am trying to decide whether each dataset is unimodal or bimodal. I assumed that ...
1
vote
1answer
121 views

The 'best' model selected with AICc have lower $R^2$ -square than the full/global model

I have used the R lme function (nlme package) to construct linear mixed models, with a single random effect (as a random intercept) and a varIdent variance structure on a fixed effect (that is a ...
1
vote
0answers
39 views

Cross-Validation vs. AICc for LASSO

I was working on a research project in which I try to estimate the the individual contribution of a group of regional political leaders to local economic growth. The major challenge is that there is ...
3
votes
1answer
129 views

If summarizing stats from multiple models is it meaningful to report a mean AIC?

I am currently summarizing results from several groups of models. Is it meaningful to report a mean AIC for each group of models? If not then how best to give a summary measure for each model ...
0
votes
0answers
31 views

after using AIC, how to determine the contribution or effect size of a individual covariate?

I am confused and looking for advise. I have found myself in this same situation repeatedly in the last few months. I want to know if covariate X is influential or important. However, I also ...
1
vote
2answers
121 views

How to refer to AIC model-averaged parameters and confidence intervals

I am writing up results from regression analysis where I used AICc model averaging to arrive at my final parameter estimates. I am wondering how best to refer to these parameters and their 95% ...
0
votes
0answers
41 views

Choose random structure in LME. Should I rely on AIC?

I want to choose the best random structure for my mixed-effects model. I have compared four models: without a random part, random intercept, random intercept and slope, and random effects: ...
6
votes
2answers
97 views

Does Box-Cox parameter estimation count towards parameters for AIC?

Suppose I have a regression model with e.g. 2 parameters $y = ax + b$ But the data are non-normal so before regressing I transform both sides with Box-Cox estimation. Thus I get two Box-Cox ...
12
votes
3answers
422 views

Meaning of 'number of parameters' in AIC

When computing AIC, $AIC = 2k - 2 ln L$ k means 'number of parameters'. But what counts as a parameter? So for example in the model $y = ax + b$ Are a and b always counted as parameters? What ...
2
votes
1answer
121 views

Possible to calculate AIC from $r^2$, $\sigma$ and/or p-value for $r^2$

As per the heading, is it possible to add AIC to some previously computed models based on the stats I have (which include $r^2$, its p-value, $\sigma$ for each variable individually)? They are all ...
1
vote
0answers
38 views

Model averaging effect sizes of Gamma family GLMs

I'm trying to get some model averaged effect sizes from a set of candidate models, all of them assuming a Gamma error distribution, according to the theory given by the book from Burnham and Anderson ...
1
vote
0answers
44 views

Can you calculate a AIC value using the non-linear maximization (nlm) minimum value in R?

So the formula for AIC is: AIC = 2k - 2ln(L) L is the maximized value of the likelihood function. I'm modeling oxygen data in R using Non-Linear Minimization (nlm) of a maximum likelihood estimation ...
2
votes
1answer
72 views

Different AIC values for the same model using step()?

I'm working with a GLM to try and optimize the model, and there are 152 predictive variables. A LOT of these are not significant, so I'm trying to figure out which ones to remove through use of the ...
1
vote
1answer
46 views

Different estimated parameters in similar models in R

A particular series (std), seems to exhibit a trend-like behavior. According to the ADF test for this series: ...
1
vote
0answers
56 views

Comparing AIC among models with different amounts of data

I have a data set with many missing observations for certain parameters (NA values) in it. I have been performing model selection using AIC. Based on AIC scores I have reduce the model to the form ...