# Questions tagged [model-averaging]

The process of combining different models to get a better resulting model than any of the constituents. Eg, computing a parameter estimator as the average of the estimators from each component model.

65 questions
Filter by
Sorted by
Tagged with
12 views

### No random effect variance estimated from model averaging?

When averaging multiple GLMM models which include random effect no estimate of random effect variance is given in the results of the averaged model, why is this? I assume there is a good reason, but I ...
26 views

### Bayesian model averaging when none of the models is well specified

Usually, from what I've read of Bayesian Model Averaging (BMA), a typical assumption is that one of the models is well specified... However, what will happen when all models are misspecified? What ...
36 views

### Why is pseudo-Bayesian Model Averaging using WAIC giving counterintuitive results for my model? Issue with unconstrained data uncertainty?

I'm currently working on a model which fits a pair of curves which are parameterized by some shape and scaling parameters. I want to produce weights for two different models. In my first model, which ...
87 views

### Regularization via model averaging?

Say you have the model $$\Phi^{-1} \left(y\right)=\beta_0 + \beta_1 x$$ I am interested in adding some regularization, specifically concerning the parameter $\beta_1$, to introduce some "skepticism" ...
51 views

### Is It Valid To Calculate Model-Averaged Confidence Intervals In the Same Way As Model Averaged Predictions?

I'm fitting a series of mixed-effects models, and I'm trying to calculate the model-averaged predictions and their confidence intervals. If I have a set of $R$ models $\{M_1,...,M_R\}$ I know that ...
36 views

### When averaging models, which models need to meet assumptions?

I have 16 variables and am running all possible models (65,535 total!), then averaging the best models. A model including all variables has normally distributed residuals, but some of the 65,535 ...
108 views

### Is there a difference between averaging individual regressions and including a random effect?

I have a bit of a theoretical question about random effects models and regression. If I have a set of clustered, longitudinal data (say repeated measurements of $y$ on a number of different ...
19 views

### Coefficient Averaging to Predict Value at end of Time-Series/Possible Random Effects Model?

I have some discrete time series data that consist of the following variables of interest: Project ID ($project\_id$) The total budget for a particular project ($tot\_budget$) The person who runs the ...
47 views

### Combining regression models from separate data sets

What is the best way to combine regression betas from separate data sets? For example, a data set is split in two based on some fundamental characteristic, and the same two factor regression is run ...
214 views

### Weighting of multiple linear regressions in an ensemble

If I have a continuous dependent variable and N continuous predictors, and I fit all possible regressions with zero up to N variables, how should I weight those regressions for prediction? One ...
57 views

### Is this Bayesian model averaging?

A classical example of Bayesian model averaging (BMA) is the regression setup where the choice of different sets of covariates corresponds to different models $\mathcal{M}_k$, $k = 1, \ldots, K$, ...
114 views

### Can model averaging be applied on models fitted to different data sets?

I have two data sets collected from two different sets of participants on their behaviour. EDIT: Both have the same response variables (Propensity to behave in a certain way - Yes or No). But they ...
67 views

### BMA - at what posterior effect probability can we say that a variable has an effect?

in the setting of a Bayesian model averaging, we are not dealing with P--value when we are assesing variable importance, but with the posterior effect probability of each variable. My question is, at ...
72 views

### Interpretation of a classic multinomial logit vs. BMA of multinomial logit

EDIT #1 Most likely I have set up the function bic.mlogit in a wrong way. @Jesper Hybel, hopefully, directed me in the right way. With the new setup I get two sets ...
55 views

### vector of weights

I am using the MuMIn package for model averaging. However, I am not clear of the function par.avg(). In this function, we need to specify the following, ...
431 views

### Effect sizes for model averaging

The goal is to find if one factor is stronger than the other in the models I have considered. I am using the information-theoretic approach. Since $n/K>40$, I am using AIC. Firstly the model is ...
638 views

### For model-averaging a GLM, do we average the predictions on the link or response scale?

To compute the model-averaged predictions on the response scale of a GLM, which is "correct" and why? Compute the model averaged prediction on the link scale and then back-transform to the response ...
80 views

### Model Averaging errors using lme4 in R

I am running a glmer model on a response variable with binomial distribution and random term. My data has 3 explanatory categorical variables and I have successfully run dredge() on them and their ...
915 views

### Model averaging in mixed models

I am reading this blog post regarding using model averaging for mixed models and the last para says "https://sites.google.com/site/rforfishandwildlifegrads/home/mumin_usage_examples" ...
211 views

### Model-averaged for a glm.nb [closed]

How can i do a model averaged for a negative binomial model. I try with the AICcmodavg but it is not compatible with glm.nb models. Any help would be appreciated Thank you very much Magdalena
275 views

### How does model averaging with a categorical variable work?

I have a series of models (~14) which do not include a categorical variable. One model (#15) however, does have a categorical variable with 3 levels. Normally for this model one of the categories ...
470 views

### McFadden Pseudo R² in averaged model

McFadden's pseudo-R² is a well-known coefficient of determination. If I am right, it can be calculated by 1-(mod_deviance/null_deviance), where ...
291 views

### Model averaging and intercept interpretation in Splines

I have two questions regarding Multivariate Adaptive Regression splines (MARS) 1) How is intercept interpreted in MARS? In linear regression, my intercept is shown in the image below In a linear ...
763 views

### Combining bagging and stacking, with and without clusters and heteroskedasticity

Question 1: Start with the classing case of bagging, say in random forest. Fit $B$ trees to bootstrap samples of the data. Average the predictions of the $B$ trees to form a final prediction. ...
22 views

### Can you increase confidence from two similar predictions based on independent data

Let's say I have two models to predict the out come of a game. Model A uses the player specific statistics (speed, reaction times etc.) and predicts a 75% chance of a win for my team. Model B uses ...
325 views

### Confidence interval of averaged-regression fit

I have a model; Y ~ mX, where Y is a set of new random number generated using Poisson distribution. i.e $Y_i \sim \text{poisson}(H_i)$. Hence I am performing 100 replications, during each replication,...
26 views

### Is the average of multiple function's minimum equivalent to the minimum of the average function of the multiple functions?

Sorry if the wording is confusing, I feel it accurately articulates the question although being a bit of a head teaser. Essentially I am running many cross-validated models. Each model produces a (...
221 views

### Models combinations

My goal is time series forecasting. I have created a number of models to make predictions. I know that forecast quality can be improved by combining predictions from different models(linear ...
1k views

### One multiple linear regression, or many simple linear regressions for prediction?

I would like to create a model which predicts the amount of energy used in an area, dependent on the number of properties in 5 categories (detached, semi, flats, bungalow and terrace). I have daily ...
62 views

425 views

### Bayesian Model Averaging: How to use in this example?

Let ${M_1, M_2}$ denote two competing forecasting models. With Bayesian model averaging we can get $p(y_{T+h}|y_{1:T}) = \sum_{j=1}^2p(y_{T+h}|y_{1:T},M_j)*p(M_j|y_{1:T})$ $1:T$ represents the ...
1k views

### Model averaging approach — averaging coefficient estimates vs. model predictions?

I have a basic question regarding approaches to model averaging using IT criteria to weight models within a candidate set. Most sources that I have read on model averaging advocate averaging the ...
317 views

### Bayesian Model Averaging with MCMC draws

I aim at improving my understanding of Bayesian model averaging in the context of predictions and I am somewhat stuck on how to implement this numerically. Lets say I have two models $\mathcal{M}_1$ ...
589 views

### Weights to combine different models

I have built different classification models (logistic regression, randomforest, and xgboost) for a dataset. I would like to combine the prediction of all the models to reduce the variance and ...
242 views

### What exactly is the Bayesian model average probability of the following?

I am struggling to understand Bayesian Model Averaging. Suppose I have got a simple Bayesian network, $X\to Y$ where X and Y are binary variables and I have got 2 models: Model 1 (simple): P(Y=1\...
98 views

### Model averaging

We have the equation: $P(C|X)=\sum_{i}P(C|X,M_{i})P(M_{i}|X)$ I should technically be able to prove that it works even when the total number of models is 1, so I go from the right hand side of the ...
389 views

### Calculating QAICc and Averaging GLMM models with various overdispersion

I am having difficulty figuring out how to calculate a dispersion parameter to calculate QAICc for a GLMM with a binomial fit. I have tested for overdispersion using this code: ...
959 views

### How to implement Bayesian Model Combination?

I'm interested in formal procedure mentioned in "Turning Bayesian Model Averaging Into Bayesian Model Combination" (Kristine Monteith 2011). I have a set of $N$ "best" AIC ranked models and I want to ...
11k views

### Interpreting model averaging results in R

I am trying to understand and know what to report from my analysis of some data using model averaging in R. I am using the following script to analyse the effect of method of measurement over a given ...
524 views

### Model Averaging: Standard Error vs Adjusted Standard Error

I'm having trouble understanding when to use Std. Error or Adjusted SE in model averaging (model.avg). What/Why/When to use Adjusted SE? This is my code: ...
1k views

### Confidence bands for model averaged predictions of GLMMs

I use R with the MuMIn package for Multimodel inference. My global Model is ...
Suppose I have a data set of N observations (n = 1...N) for out-of-sample estimation and values of ($y_n$). I have also ...