Questions tagged [multivariate-regression]
Regression with more than one response (dependent) variable.
0
votes
0answers
25 views
OLS regression with multiple dependent variables that are correlated with each other
Suppose I want to see the impact of an explanatory variable $X$ on two different dependent variables: $Y_1$ and $Y_2$. Suppose also that I find that $Y_1$ and $Y_2$ are correlated.
Assuming that all ...
2
votes
2answers
70 views
Predict a vector of values with constraints? [duplicate]
I am aware of a variety of methods for simultaneously predicting multiple outcomes known sometimes as multivariate regression/analysis. However, my situation is a little more special. I am trying to ...
0
votes
0answers
20 views
What is the correct way to follow up a multivariate multiple regression?
I recently conducted a study in which I used a series of multiple linear regressions to predict different outcomes (y1-y6) using the same set of predictor variables (x1-x8). My hypotheses were that ...
0
votes
1answer
31 views
Multivariate (Multi-responce) for negative binomial (GLM) in R
I developed a multivariate linear regression using lm() function in R. However, I am having trouble coding a Multivariate model in R for glm(), especially for the negative binomial.
Can anyone point ...
1
vote
1answer
40 views
Hypothesis testing: significance
i conducted a survey that aims to find out if Australians prefer Australian phones over Chinese phones.
My hypothesis states: Australians prefer Australian phones over Chinese phones
This was ...
0
votes
0answers
13 views
Question about the correlation between residual/error and regressors [duplicate]
In multivariate regression:
Why can the sample correlation between the error term and a regressor be ≠ 0, but the sample correlation between the residual and a regressor has to be = 0?
0
votes
0answers
42 views
Write Lack-of-fit Sum of Squares in Quadratic Form
Let
\begin{equation}
SSLF = \sum_{i=1}^{m}n_{i}(\bar{y_{i}} - \hat{y_{i}})^{2}
\end{equation}
then
\begin{equation}
\sum_{i=1}^{m}n_{i}(\bar{y_{i}} - \hat{y_{i}})^{2} = n(\bar{\overrightarrow{y}} -...
3
votes
0answers
29 views
Integrated mixed model testing correlation and difference in correlation across factors
I'm currently performing the following analysis :
Computing $r_j(Y_{ij}, X_{ij})$ for each design cell (factor with level 1 or 0 for each unit)
Estimating effect of factor on $r(Y,X)$ with a linear ...
0
votes
1answer
20 views
Null hypothesis for individual coefficient's p-value in multivariate logistic regression
When calculating $p$-values for individual coefficient $a_i$ (for variable $X_i$) in a multivariate logistic regression, is the null hypothesis
that all $a$'s are zero?
that $a_i$ is zero and others ...
1
vote
0answers
33 views
Testing for Heteroscedasticity of Multivariate Multiple Regression [closed]
I want to test for heteroscedasticity on a regression model with multiple dependent variables using R. I want to see if the indenpendent variable has an effect on the variance of all of the dependent ...
1
vote
1answer
37 views
Linear regresson with four values as input and two values as output
I have the following problem for a personal project of mine: I am solving a system of two differential equations that has 4 changing parameters. The output are two vectors of numbers. Let's say I am ...
0
votes
1answer
42 views
Multivariate regression vs. multiple univariate regression models
This is a naive question, but I am a little confused over the term "multivariate" regression. And note this question does not (to my knowledge) pertain to "multiple" regression.
When people use the ...
0
votes
0answers
20 views
thin-plate spline projection pursuit regression?
Is projection pursuit regression limited to univariate smoothing splines only? I am essentially looking for a multivariate ppr method. Is there such a method that searches for the most curved surfaces ...
0
votes
0answers
12 views
Default inferential methods for multivariate exploration or model checking
What are your default methods to explore or understand a multivariate relationship between let us say a fixed outcome $Y$ and a limited set of explanatory variables $X_i$ ($i=1,…,n$) (with $k$ not too ...
0
votes
0answers
31 views
multivariate linear regression without b_0 [duplicate]
I created a multivariate regression following the scheme
$$y = \beta_0 + \sum^n_{i=1}\beta_i*x_i$$
and got an average deviation ofaround 5%.
When I tried the regression without the $\beta_0$ I got a ...
0
votes
0answers
38 views
multi-response outcome: multivariate or univariate regression?
I have a dependent variable which represents participants' responses on 20 words, coded as 1 = correct , 0 = incorrect
Question: I am keeping the regression as univariate for now (as far as dependent ...
0
votes
0answers
106 views
multivariate normal distribution with mean vector 0 and covariance matrix Σ
I am newby in statistics and I have huge data with "p" variables and "n" samples. My data is a two dimensional matrix with "n" columns (each column is a sample) and "p" rows (each row is a variable). ...
0
votes
0answers
61 views
Suppression Effect or Something Else?
I am working on a project using multivariate regression where I have an independent binary variable exerting a non-significant effect on my dependent variable. However, upon inclusion of another ...
0
votes
0answers
28 views
Multivariate Out-of-Sample Evaluation
I have a question about multivariate hypothesis testing in out-of-sample evaluations.
Generally, let`s asssume we want to predict three different stock returns in a 1-month ahead forecasting setting. ...
0
votes
0answers
17 views
How to quantify the effect of one variable in a multivariate problem
I'm sitting here watching election returns and idly wondering whether it's possible, with 470 elections, to quantify the effect of a single variable--gender--when we know elections are influenced by ...
1
vote
2answers
56 views
$R^2$ and p-value for multivariate linear regression with confounders
I am working on a project where I am interested in the following variables:
Dependent variables: $y_1,\, y_2,\, y_3,\, y_4,\, y_5$ (continuous)
Independent variables: $x_1,\, x_2, \ldots,\, x_{18}$ ...
2
votes
1answer
84 views
Conjugate priors for dynamic model $x_{t+1}=Ax_{t}+\eta_t$
What conjugate priors do we have for the model(multivariate) $x_{t+1}=Ax_{t}+\eta_t$, where $\eta_t\overset{iid}\sim N(0,\Sigma)$?
I was thinking of using $\tilde{x}=Diag[x_1,...,x_{n-1}]$, $\tilde{y}...
2
votes
1answer
66 views
Different method for parameter estimation auto.arima
I am trying to fit a multivariate time series with the auto.arima() function in R. Since my time series has seasonality I included Fourier approximation and used ...
0
votes
0answers
14 views
Distribution of maximum variance explained by 1 variable
Say I do principal component analysis on $n$ variables, and I sort the fractions of variance explained to find the largest. What is the probability distribution for this figure?
For context I just ...
0
votes
1answer
48 views
What is the best way to test and validate a multivariate regression using OLS?
I am implementing a multivariate regression from scratch using Ordinary Least Squares to get the weights. I noticed that this method does not have any hyperparameters to tweak, so I am not sure what I ...
3
votes
0answers
35 views
What plots and summary statistics are usually used for exploratory data analysis of multivariate time series?
For multivariate cross-sectional data, tools such as scatterplot matrices, the five numbers summary, faceted boxplots and so on, allow an efficient exploration of a new data set, and can suggest how ...
1
vote
0answers
16 views
Using the Volume of Sales obtained today to predict volume of Sales at the Event
I wonder if anyone can help.
I have a set of data on event ticket sales. I have information on eventdate, location, capacity, cumulative sales, sales date, total sales.
I want to be able to build a ...
0
votes
0answers
41 views
Multivariate categorical linear models
I've got a real-valued normalised input with around 300 dimensions (features). The output is a two-dimensional categorical variable. And I want to perform feature-selection on the input space. So far ...
0
votes
0answers
30 views
What are the novel techniques for multivariate response prediction?
What are the novel techniques of multivariate response prediction?
Are there any GAM model versions for multivariate predictions?
1
vote
1answer
272 views
forward model selection on multivariate polynomial regression with high dimension data
I am trying to fit the best multivariate polynomial on a dataset using stepAIC(). My problem is that I have more variables (p=3003) than observations (n=500), so ...
0
votes
1answer
134 views
Variance of linear combinations of Normal RVs in linear regression
I am working with a standard multivariate linear regression model ($Y = X \lambda + \epsilon$, $Y$ and $\epsilon$ of length $n$, $X$ is $n$ x $m$, $\lambda$ of length $m$). $X$ is said to be "column-...
1
vote
1answer
107 views
Multivariate Power Function Regression Analysis of Data Set with Two Dependent Variables
I have been struggling to create a general equation for a data set with two dependent variables. I have been trying to use excel to model the equation but I am unable to match my data set. Using ...
3
votes
1answer
184 views
Predicting a single response variable with a multivariate regression model
For my research I am interested in performing inferential and predictive analysis on a single response variable. I have already made one univariate and one multivariate regression model. In the ...
1
vote
2answers
80 views
Bivariate/multivariate models for multinomial response variables
I need to fit two categorical (potentially correlated) response variables (each has three classes) on a set of explanatory variables, while considering for the response variables' correlation. What ...
1
vote
1answer
41 views
How to determine the type of regression to be used? [closed]
I am relatively new into the machine learning field and I came up with the following problem that is giving me some headaches, so any help on it would be greatly appreciated for my inner peace.
...
2
votes
0answers
120 views
multivariate cox regression - combining genotypes for each SNP
For 53 SNP I have coded genotypes as 0 for aa, 1 for ab, and 2 for bb for 29 samples and I have outcome and time to outcome. Here outcome is called "BCR" below.
I am using the survival package in R ...
2
votes
0answers
28 views
Geometric intuition of residuals sample variance as a ratio of two determinants
We are estimating a regression
$$
y_i = \hat\beta_1 + \hat\beta_2 x_i + ... + \hat\beta_k z_i + \hat u_i
$$
I am searching for the geometrical intuition behind the formula
$$
sVar(\hat u) = \frac{\...
2
votes
0answers
83 views
Multivariate Regression with Uniform Errors
I'd like to know if there is a multivariate regression model with uniform errors. More specifically, I'd like to find the Maximum Likelihood Estimators for $\beta^a$ and $\beta^b$. The model is given ...
1
vote
2answers
331 views
Logistic regression with multiple outcome variables (all categorical)
I am completely in over my head with logistic regression at the moment, so what follows is probably very basic and silly questions. But I would appreciate it hugely if anyone took the time to respond ...
1
vote
3answers
181 views
Estimating the contribution of covariates in a boral latent variable model
I'm attempting to use latent variable modelling, as described by Hui (2016) and using the boral package in R, to explore relationships between plant species composition and environmental variables ...
1
vote
0answers
24 views
What is the added benefit of conducting a “multivariate multiple regression” over several “multiple regressions”? [duplicate]
SPSS, Stata and SAS can all conduct multivariate multiple regressions (i.e. more than 2 continuous predictors and more than 2 outcomes) as GLM.
Consequently, the multivariate tests answers the ...
0
votes
2answers
58 views
R-Square Change in a Multivariate Regression
I am investigating whether the predictive validity of the Big Five personality traits can be improved by controlling for sources of self-report error (e.g. memory, interpretation biases, ect.). I am ...
0
votes
1answer
455 views
Multiple dependant variable in multiple linear regression [duplicate]
I have 8 independant variables and 2 dependant variables.Iam using multiple linear regression.I just finished the regression topic so iam a starter in this.Can anyone say how to approach this one??
1
vote
1answer
105 views
How to interpret mean squared error matrix in the context of multiple time series?
Consider the time series of 2 variables $x_1$ and $x_2$, put together $y=(x_1,x_2)$:
$$
y_t = \begin{bmatrix}
v_1\\ v_2
\end{bmatrix} +\begin{bmatrix}
c & d\\
e & f
\end{bmatrix}y_{t-1} + u_t....
0
votes
1answer
13 views
What do you call variable that switches on/off the effect of another?
Suppose we have a model
$Y = \beta_1 X_1 + \beta_2 X_1X_2 + \epsilon$
Hence $X_1$ has an effect on $Y$ regardless of the value of $X_2$, but $X_2$'s effect on $Y$ is mediated or enabled by $X_1$.
...
0
votes
1answer
90 views
Regression predicting 2 dependent variables
Imagine I have a big dataset $\textbf{X}$ that constitutes my independent variables and I want to predict a vector of 2 components, $\mathbf{Y} = (y_1, y_2)$. A regression will be something like $\...
1
vote
0answers
26 views
Multiple imputation when have more than 1 outcome variable
Is there a good paper or reference for doing multiple imputation when there is more than one outcome variable? Anything that specifically addresses building the imputation model or software to use for ...
2
votes
1answer
97 views
time series mainly characterized by structural breaks - how to model?
I am given a financial time series that is characterized by a bunch of structural breaks, i.e. the series isn't moving (literally at all), but at some points in time the series jumps up or down. Then ...
8
votes
2answers
1k views
gaussian process regression for large datasets
I've been learning about Gaussian process regression from online videos and lecture notes, my understanding of it is that if we have a dataset with $n$ points then we assume the data is sampled from ...
0
votes
0answers
33 views
Given midterm and finals; select answers which predict overall success
Midway through the course, students' grasp of topics ['category'] gets tested. Same for finals. Like:
...
