Techniques for analyzing the relationship between one (or more) "dependent" variables and "independent" variables.

learn more… | top users | synonyms (1)

0
votes
0answers
3 views

Is it possible to use entropy maximisation to get around collinearity in linear regression?

Say I have a linear regression problem with highly collinear predictors. Is it possible to use entropy maximisation rather than OLS to fit this model? If so, which (preferably Free) software ...
0
votes
1answer
22 views

Visualising developmental binary data: plot model fit or data means?

In my disciple (developmental psychology) it is becoming common to visualise data as the fitted model with CIs, rather the actual data (means with CIs). The typical example is where we are interested ...
0
votes
1answer
14 views

How can I calculate the AUC of combined variables using SPSS

thank you for taking time out to read this. I have previously ran ROC curves to get the AUCs for single test variables but I do not know how to derive the AUC for combined variables (2 test ...
0
votes
1answer
23 views

Linear regression to minimize the Cost Function

I am new started machine learning program. I find it difficult to understand gradient descent algorithm. I am going through machine learning from coursera by Andrew Ng.All of his lecturer in second ...
0
votes
0answers
15 views

Standard error increases by more than 1000 times

I have a following model: $y=a+b_{1}x_{1}+b_{2}x_{2}+b_{3}x_{1}x_{2}+b_{4}x_{3} +other terms $ Let's say, I am only interested in coefficient $b_{3}$. The coefficient $b_{3}$ is 0.54 and t value is ...
0
votes
2answers
24 views

Non-linear Relationship between two variables

Please allow me to explain the background for my questions first. I ran a specific test comprising of adding various doses of a certain chemical and then measuring the effect of these various doses ...
0
votes
0answers
7 views

Regression on World Bank country-level data

I am a beginner at regressions, and I am working on a country-level index based on the volume of certain internet traffic patterns and other indicators (the details of how this index is calculated are ...
0
votes
0answers
17 views

Methods for supervised regression learning

What ML methods should I try for a data set of around 1000 samples? The output variable is dependent on say 10 regressors of which 8 are real numbers and the other 2 are categorical. Or they might ...
0
votes
1answer
20 views

quadratic relationship in multiple regression

I am running a multiple regression to test the relationship between X1 and Y. I control for X2, X3, X4,etc. Before running the regression, I plot X&Y and find that there is a quadratic ...
0
votes
0answers
20 views

Does removing variables decreases the variance of the random error estimator?

Lets say if have a regression of $y= f(x_1,x_2,x_3)$; if I remove $x_2$,$x_3$, I'll get regression of $y=f(x_1)$ By removing these variables, did I decrease variance of the random error estimator? Or ...
0
votes
0answers
12 views

Regressing in different time intervals

I asked a similar question on the Math Stack Exchange but I explained it poorly so I did not get a satisfied answer. I have 3 variables $T$, $R$, and $Y$. I want to do a sensitivity analysis to ...
1
vote
0answers
7 views

Spatial regression with misaligned predictor (point) and outcome (point)

My outcome (Y) is the type of traffic crash event measured at every intersection (on a street grid). Covariates are measured at the locations of the events. The predictor of main interest (X, a ...
0
votes
0answers
6 views

Using linear learning to rank algorithm in a mixture language model

How do I tune the parameter alpha automatically?In this formula S(Q|D) = alpha * P(t|D) + (1-alpha) P(T|D) Friend advice me to use linear learning to rank algorithm ( any example?) The formula is ...
2
votes
0answers
29 views

Linear model with proportions as the dependent variable

I have a linear model where the dependent model is a proportion (or a probability). I know I should probably use another type of model, and I am. I would still like to use also a linear model because ...
0
votes
0answers
23 views

How to install libsvm extention on Ubuntu? [on hold]

I use libsvm on Linux and it works (although I don't know Linux and I use it only for that). Now, I'm trying to extend svm procedure to deal with ordinal regression as here: ...
0
votes
0answers
19 views

Is there a chi-squared test for logistic regression?

I am wondering if there is a chi-squared test in logistic regression (LR) in order to measure/test the influence of one or two specific variables on the whole model. Is the LR-Test doing this job in ...
0
votes
1answer
16 views

Regression model selection for gross motor function analysis

I am using the Gross Motor Function Measure (https://www.canchild.ca/en/measures/gmfm.asp) to explore the relationship between age and gross motor function in a cohort of children. I have chosen ...
0
votes
1answer
14 views

Out of Sample and In Sample testing

I am very confused in testing regressions and know that there are many explanations available online, but I am still not getting anything it in my mind. Suppose I have daily data for past 100 days, I ...
0
votes
0answers
11 views

How do I orthogonalize one variable to others in an ARIMA regression context?

I have one socioeconomic variable Y, with which I can correlate with variables V1, V2, V3, V4. So Y consists {Y1, Y2, ..., Yt}, V1 consists of V1_1, V1_2, ..., V1_t, etc. I put them into a seasonal ...
0
votes
0answers
13 views

forecasting household size using longitudinal survey (panel-data)

I have a multidimensional longitudinal survey dataset that gathered general demographic characteristics (~100 variables) of ~10,000 households over a 10 year time period (3 surveys with 5 years ...
0
votes
0answers
9 views

Use range information to improve the accuracy of regression

I have built a model using GLS with reasonable success. The model has the form $E[Y]=g^{-1}(X\beta)$. However, I recently obtained some new data $Z$. For each observation $y_i$, there might be 0 or ...
2
votes
1answer
40 views

Regression - What to do with insignificant variables?

Please pardon me if you find this question very silly but this doubt has been troubling me for some time now whenever I want to run a regression. I am working on SAS. I have a dataset which has ...
0
votes
1answer
57 views

What are the key steps in solving Machine Learning Problem [on hold]

I am trying to make a summary to myself, what are the key steps for solving a Machine Learning problem. I tried to read good books, talked with peer, discussed many issues here, checked many web based ...
1
vote
0answers
13 views

fixed vs random regression in panel data

Anyone could explain me the differnce between fixed and random effects concerning panel data regressions? With examples? I have actually used panel data regressions for some of my predictive models ...
0
votes
0answers
15 views

What mean coefficients in autoregressive model and how calculate them?

What mean coefficients in autoregressive model and how calculate them ? yt=c+ϕ1yt−1+ϕ2yt−2+⋯+ϕpyt−p+et, ϕ1, ϕ2 ... This coefficients are "fourier transform"? Can ...
3
votes
0answers
39 views

What explains the correlation between the slope and intercept?

If $R^2$ explains the variation explained by a model, what explains the correlation between the coefficients given for a slope parameter and an intercept? I have been thinking of it in two ways: If ...
1
vote
0answers
16 views

k-fold cross validation for LASSO regression model

Assume we have a simple linear regression model expressed as $Y= X \beta + e$. We know that finding the regression coefficients $\beta$ using the LASSO method is performed by penalizing the Least ...
1
vote
0answers
18 views

Role of Distribution , likelihood function, and MLE in regression ?

I'm currently a beginner in learning statistics. In regression part, we started to learn (software) using MLE method for estimating parameters in the models. In order to calculate MLE, likelihood ...
1
vote
0answers
9 views

Different kinds of minimax convergence rates

Stone (1980) provides a minimax rate of convergence $a_n$ for pointwise estimation of a regression function, defining it as $\lim \inf_n \sup_{\theta \in \Theta} P_\theta( \hat{T}_n - T(\theta) > ...
0
votes
1answer
36 views

Logistic regressions questions about line fitting vs. probabilistic interperetation

Suppose I have data points $(x_1^1, x_2^1), (x_1^2, x_2^2), (x_1^3, x_2^3), \ldots$ in $\mathbf{R}^2$ that fall in one of two classes, $y^i=0$ or $y^i=1$. I can find a linear separator for these ...
0
votes
0answers
20 views

Correct interpretation of linear coeffs for 1 interaction, 1 numeric, 1 categorical

Good day, XValidators. This is my 1st question in the community. I'm at my wit's end here. Nowhere in the interwebz nor in youtoubeland can I find an answer to the following: Assume you have this ...
1
vote
1answer
22 views

Regression on Inferred Variables

Given a set of labels $y$ and design matrix $X$ we often compute a linear regression to find a set of parameters $\hat{\beta}$ such that $E[y|X] = X\hat{\beta}$. However, how does one perform ...
0
votes
1answer
14 views

How SAS handles missing values while fitting linear regression model

While fitting a linear regression model in SAS, if the dataset has missing values (either missing y, or missing x or both), will SAS just ignore the records that have at least one missing value(y,x)? ...
1
vote
1answer
12 views

Gradient Scores from Binary Logistic Regression

My research concerns the language of Alzheimer's patients. As the disease progresses, their language becomes more concrete and less abstract - they seem to 'lose' their abstract vocabulary more ...
0
votes
0answers
16 views

Applying parametric tests on non-parametric data

I'm doing a research and I have some concerns, and I'd appreciate your kind assistance on them. Basically, I'm designing an instrument to measure something (a single dependent variable), and I'm ...
4
votes
1answer
21 views

Merging observations in Gaussian Process

I am using Gaussian process (GP) for regression. In my problem it is quite common for two or more data points $\vec{x}^{(1)},\vec{x}^{(2)},\ldots$ to be close to each other, relatively to the length ...
0
votes
1answer
30 views

how should I do regression analysis where response is number in each category

I try to find genes that related to output which is numbers in three category. The simplified analogy is: first we take an zygote and measure the expression of a gene, and clone this zygote to many ...
0
votes
0answers
16 views

R survreg returns reciprocal of incidence rate ratios?

I'm working through some poisson regression for survival data using R. As I understand it, the exponentiated output from survreg with dist = "exponential" should give the incident rate ratios. I ...
2
votes
1answer
45 views

Interpretation of linear regression where the outcome can only possibly cause the value of predictors and not viceversa

We want the verify the association between artificial pregnancy (artificial insemination) versus natural pregnancy and a series of pregnancy conditions (hypertensions, diabetes, etc). We first ...
0
votes
0answers
13 views

Interpreting interaction term via margins command? [on hold]

I am using Stata. I regressed test score on a wealth dummy (high/low) and a maternal education dummy (high/low) and some control variables, among them age (3,4,5 and 6 years), in a linear regression. ...
0
votes
1answer
18 views

Advice on a model or approach to layered dataset

I am attempting to develop a model to estimate the number of people in a space based on the Wi-Fi Traffic. At present, I have a dataset (in xml) which is structured like the following: ...
0
votes
0answers
7 views

How to use co linear variables in developing a model

I am trying to develop a model to predict a price which depends on market indexes, Market indexes are correlated (they rise and fall together). Price also changes in same direction with indexes. I ...
0
votes
0answers
9 views

large difference between pearson and deviance residuals

pearson deviance 7.46917 2.8423 6.85298 2.78224 I am fitting logistic regression model in SAS. What should be reason of large difference between pearson and deviance residual as mentioned above ?
0
votes
1answer
35 views

Can I use Cox Regression here?

I have a data-set where I want to do a regression of survival probability given amount of drug injected into a subject. The more drug injected, the less likely the subject will survive after say, 3 ...
1
vote
2answers
43 views

How should I check the assumption of linearity to the logit for the continuous independent variables in logistic regression analysis?

I am confused with the assumption of linearity to the logit for continuous predictor variables in logistic regression analysis. Do we need to check for the linear relationship while screening for ...
1
vote
0answers
36 views

Why would I need both a validation set & a test set if I'm not selecting a model?

I have a dataset with two features and one outcome. I was asked to separate the data into three parts such that 70% of the data is a training set, 20% is for validation and 10% for testing. The model ...
0
votes
0answers
28 views

Interpreting circular-linear regression coefficient

I'm trying to use the circular package in R to perform regression of a circular response variable and linear predictor, and I do not understand the coefficient ...
3
votes
1answer
95 views

Model selection, issues of judgement

I have a general question on model selection strategies in regression models. In my research, the main goal is rarely prediction but almost always estimation of effects of certain variables. I have ...
0
votes
1answer
30 views

Difference between modelling and testing association

I have data set with binary outcome, with 5 continuous covariates and 4 discrete covariates. I am little confused as to how I test for association, for the discrete covariates, I used a chi sq test, ...
1
vote
0answers
19 views

Segmented Regression With Control Group Implementation and Interpretation

I have been reading the following paper on segmented regression for interrupted time series - Wagner 2002 and wanted to learn a proper analysis of such data where there is a control group. The paper ...