Questions tagged [intercept]

The intercept in regression-type models is the value of the Y variable when all X variables are 0.

Filter by
Sorted by
Tagged with
0
votes
0answers
11 views

The inclusion of a random intercept is really affecting beta values — why?

I'm running a mixed-effect logistic regression in Stata 16.0. I can't say much about the data because it's confidential. Nevertheless, here is a fictional example: If we sample students within schools,...
0
votes
1answer
23 views

Interpreting constant in regression with an interaction term

In a regression model with a single categorical exposure and no interaction term of the form: $y = \beta_0+\beta_1x_1$ the $\beta_0$ can be interpreted as the result in the reference group. So for a ...
0
votes
0answers
13 views

Confidence interval x-intercept

The x-intercept of a linear regression is -y.intercept/slope. If I wanted to obtain a confidence interval (CI) for a x-intercept of a linear regression, coud it be wrong to find the CI of y-intercept ...
2
votes
0answers
30 views

In R there is a problem of intercept and without intercept ,Pearson's Correlation does not follow! Why? (see the bolded resuls)

Xvec <- rnorm(200) Yvec <- 2.6*Xvec + rnorm(200) lmodxy <- lm(Xvec ~ Yvec) lmodyx <- lm(Yvec ~ Xvec) summary(lmodxy) Output ...
1
vote
1answer
46 views

What is the role of an intercept in an I-Spline basis?

I have the following data to which I want to fit a monotone non-decreasing spline. ...
0
votes
1answer
45 views

Test for comparing x-intercepts of two linear regression

I would like to know how to compare, and then calculate significant differences, if any, between the x-intercepts of two regression lines. Practially, I shoud compare the values of x when y=0. I know ...
2
votes
1answer
19 views

Uncovering the make up of the intercept in a generalized linear mixed model

I could use some help Finding the make up of the intercept in a generalized linear mixed model. FYI, I use a 2013 Macbook Pro with a 2.4 GHz dual-core intel chip, 8 GB of ram, macOS big sur 11.2.2, ...
14
votes
1answer
550 views

Why the does the intercept of my null model not equal the mean when I log transform the outcome variable? How do I interpret it?

I have an outcome variable that is right skewed, so I log transformed it. I made a null model with only the log-transformed outcome variable, but when I exponentiate the estimate, it does not equal ...
13
votes
5answers
216 views

Different usage of the term “Bias” in stats/machine learning

I think I've seen about 4 different usages of the word "bias" in stats/ML, and all these usages seem to be non-related. I just wanted to get clarification that the usages are indeed non-...
0
votes
1answer
30 views

Logit model intercept use

I want to estimate a Logit model where the independent variables are binary and one of them is categorical, so the whole data set consists of dummy variables. First of all, I am puzzled whether I ...
0
votes
0answers
43 views

Using LIME without intercept term?

I'm playing with LIME to explain the prediction of a machine learning model. LIME trains a (locally weighted) linear surrogate model around a point of interest. The weights of that surrogate model are ...
0
votes
0answers
13 views

Ordinal regression model in R - multiple coefficients appearing for only one dependent variable. Can someone help me analyze?

I am running an ordinal logistic regression model in R (with an ordinal dependent variable). For my model I am also only including one primary independent variable (which is also ordinal). However, ...
2
votes
1answer
24 views

What does c refer to in AR(p) and MA(q) model mathematical definitions?

What exactly does c represent in these formulas defining AR(p) and MA(q) models? MA(q): (https://otexts.com/fpp2/MA.html) AR(p): https://otexts.com/fpp2/AR.html
0
votes
0answers
11 views

Interpret significant intercept

I performed Wald tests on my GEE model (in fact, using anovas on nested models) and got no significant variables. Since I could not run a model without any independent variable I left distance in the ...
0
votes
0answers
19 views

Syntax for a random effect in an R regression - not sure if nested, and how to express?

I am running an ordinal regression for an experiment I have conducted, where the DV is ratings on a 5-point scale, and the predictors are the type of item, the type of participant (native speaker/L2/...
1
vote
1answer
27 views

Random effect coefficient: actual coefficient or deviation from main fixed effect?

This is a very simple question, but I'm starting to doubt myself: I have a mixed model which I estimate in Matlab with fitglm ...
0
votes
0answers
10 views

Problems with multicollinearity tests of no intercept models

i have an $\mathrm{AR}(1)$ model in R, $y_t \sim y_{t-1} + X_{1,t}+ \cdots+ X_{n,t}$ with no intercept and i want calculate some individual multicolinearity tests for each variable in the model. The ...
1
vote
2answers
163 views

Why does removing the constant term prevent the dummy variable trap? [duplicate]

I understand that if you have a dummy variable with $m$ categories that you should include $m-1$ categories in order to avoid perfect collinearity between regressors. However I don't understand why ...
0
votes
1answer
25 views

Adding drift to an ARIMA(0,1,1) (0,1,1) model in R

I'm trying to add drift to my ARIMA(0,1,1)(0,1,1) model in R, however R is giving me the error message, Warning message: In Arima(insample, order = c(0, 1, 1), seasonal = c(0, 1, 1), include.drift = ...
4
votes
4answers
107 views

Why is the intercept different from the mean of Y when X=0?

I was hoping to find here a solution to some aspects of linear regression I had trouble understanding. Let's take an example of regression with the following variables: $y:\:$ depression (continuous)...
1
vote
0answers
29 views

Components of the intercept within regression and colon interaction (:)

I'm trying to figure out which elements are part of the intercept within a regression model characterized by colon interaction (:). This is the model: Y ~ A*B + A:B:C The independent variables are: <...
0
votes
0answers
33 views

Independent variable is correlated with intercept, creating singularities

I am building a logistic model with about 20 variables. I have used the following code: `fullmod = glm(cancer ~ B_SEX+BLINE_AGE_AT_BASELINE+B_BMI+B_chro+B_fdrc+B_hrt+B_LMET+ B_MET+B_FV+B_EDU+B_INC+...
2
votes
2answers
306 views

When forcing intercept to zero, how R-squared is changed? [duplicate]

I have some questions. In a linear model, I want to force intercept to zero. The program (I used JMP) does not provide R-squared when intercept becomes zero. So, I calculated R-squared by myself by ...
1
vote
0answers
34 views

Understanding the intercept in an unadjusted logistic regression

I have performed an unadjusted logistic regression using weights (obtained via genetic matching) as below. I am using the survey package to make working with the ...
0
votes
0answers
18 views

Intercept in a dynamic panel model

I have been taught that including fixed/random effects in a dynamic panel model yields inconsistent estimates when using OLS and hence motivates the usage of other estimation methods. However, does ...
-1
votes
1answer
44 views

Is the intercept fit differently for each regressor in Multiple Linear Regression?

is the intercept B0 in y = B0 + B1X1 + .... fit differently for every feature x1. Is it different for every feature coefficient or the same for all feature coefficients and why so?
0
votes
0answers
33 views

Interpreting estimates in a Poisson regression

I know similar questions have already been answered but in this particular case I need some additional help. I am working with this data set: https://github.com/proback/BeyondMLR/blob/master/data/...
2
votes
1answer
70 views

A queston regarding the meaning of the intercept in regression

Suppose we have a dataset where the indepedent variable $x$ is the work experience in years of an employee and $y$ is his salary in dollars. Such a dataset could consist of the following elements $$(...
5
votes
2answers
510 views

'Size' of intercept at linear regression

I have a question about this table. Why does the constant (intercept) change so dramatically from Model 1 to Model 2?
0
votes
0answers
37 views

Variance of intercept in multiple regression

I'm calculating a variance of coefficients in a multiple regression with three predictors. I have built matrices necessary for calculation of variance of independent variables, for example, for b1 I ...
0
votes
0answers
31 views

Logistic Regression with dummy variables? [duplicate]

I am working on a problem where response variable is binary and my features are dummy variables. I observed when I include intercept to model all the dummy variables' p-values are equal to 1. When I ...
1
vote
2answers
114 views

How do I interpret the regression output using Artificial Neural Network in R? [closed]

I'm working on a covid-19 dataset, and I'm interested in using the Artificial Neural Network (ANN) to measure the effect of some independent variables namely: confirmed cases, new cases, and total ...
0
votes
1answer
30 views

Weighted average, then adding an intercept term

I am working with a problem where we are calculating the weighted average of DNA modifications. Modified sites are placed into four different groups and the average weight is calculated from there. ...
0
votes
0answers
31 views

Why the OLS parameters of a linear regression are correlated? [duplicate]

I found that in a simple regression model y=β0+β1x+ε, the parameters β0 and β1 are negatively correlated. Is there a explanation for this correlation? I found this property here, but I would like to ...
0
votes
0answers
7 views

Mixed Effects Logit Intercept

When I run a simple model using the ordinal package from R. model1 <- clmm(A~ B*C+ (1| Subject), data = df, threshold = "flexible") summary(model1) I ...
0
votes
0answers
31 views

Logistic Regression with unbalanced data, intercept effect

In several papers I have read that when doing a logistic regression with unbalanced data, the entire effect of the imbalance is carried by the intercept. However, I cannot understand why this occurs, ...
0
votes
0answers
37 views

Should I give up the intercept when calculating general trend of time series?

I have a time series of customers. Say, every customer has 30 observations of how may items he purchased over a period of 30 months. I would like to add a feature indicating what the general trend of ...
0
votes
2answers
109 views

How to interpret insignificant intercept in logistic regression with orthogonal polynomial encoding

I have conducted a logistic regression. Model <- logistf(A ~ C, family ="binomial"(link = "logit"), data=Data) The dependent variable is ...
0
votes
0answers
73 views

Likelihood Ratio Test for Intercept in Simple Linear Regression?

I’m trying to construct a test statistic for the likelihood ratio test for the following hypotheses about the intercept of a simple linear regression: $$y_i = \alpha + x_i\beta$$ $$H_0: \alpha=0$$ $$...
0
votes
0answers
26 views

Why does level means coding only work for one (dummy) variable? [duplicate]

Consider the following reproducible example: ...
0
votes
0answers
7 views

Ability of neural network for regression to learn to predict input 0 where functional form doesn't hold for the data at input 0

Hopefully the title to this question wasn't too confusing. I have a feed-forward neural network with $tanh$ activation functions on each of the (four) hidden layers. I'm performing a one-dimensional ...
2
votes
2answers
124 views

Alternative to R$^2$ in linear regression without intercept

It has been extensively described in this website the reason why one cannot properly calculate the $R^2$ - neither the Adjusted $R^2$ - in regression models fitted without an intercept. What is a good ...
2
votes
0answers
44 views

plot probabilities from mixed effect logistic regression with random intercept and fixed continuous and categorical covariate

I have created a mixed-effect logistic regression model with a random intercept, a ...
0
votes
0answers
16 views

Count Time Series Following Generalized Linear Models - Questionable Intercept

I am attempting to appropriately examine the relationship between a count time series variable (outcome) and a continuous, mean-centered time series variable (predictor). ...
0
votes
0answers
43 views

How to interpret the intercept of a multiple regression analysis after accounting for continuous and categorical variables

I'm attempting to run a regression analysis on a continuous outcome variable y, using a primary predictor variable that represents a treatment (...
0
votes
1answer
58 views

How to interpret an insignificant intercept in a model with significant coefficients?

Imagine a regression with one dependent variable (y) and two explanatory variables (x1 and x2). Both coefficients of x1 and x2 are significant. But the intercept is around 0.1 is not significant. How ...
0
votes
1answer
1k views

The definition of a constant term in a fixed effects model

Is it considered necessary to include a constant term in the definition of a panel data model which. among other regressors, includes a variable representing fixed effects?
0
votes
0answers
28 views

How do we explain together the results of paired t-tests and simple linear regression?

Description of my experiment: I have 2000 samples. For each sample I am measuring a metric Mi using four different methods A,B,C and D. These methods of measurement are completely independent. Ideally,...
1
vote
1answer
93 views

Effect of treatment in a model with random effects

I am working with Eyes (volume), each person has two eyes and I am using random effects to account for this in my model. (linear mixed effects model) The problem with nlme is that the output needs ...

1
2 3 4 5 6