# Questions tagged [regression]

Techniques for analyzing the relationship between one (or more) "dependent" variables and "independent" variables.

23,303 questions
Filter by
Sorted by
Tagged with
22 views

### I am a beginning researcher. I need a textbook or any reading material for step by step research and data analysis [closed]

I want to learn the researching methods and data analysis step by step starting from scratch. starting from the basis statistics to the advance level that includes: Regression, Simple and Multiple. ...
6 views

### Regression methods for indicator function as covariate

I am looking for a regression method to fit the following model: $$Y=\beta_0 + \beta_1X+\beta_2 I(X>\beta_3)X + \varepsilon,$$ where $\varepsilon \sim N(0, \sigma^2)$, and $I$ is the indicator ...
7 views

### Out of distribution prediction, not sample

My dataset contains samples that are recorded time signals. I want to predict the start of some event in the time signal. Say I train a neural network with mean squared error as loss function to ...
10 views

### What does it mean to have a model fit via GLS with REML? Aren't GLS and REML two different methods of estimation?

As in the title. I am confused. We often read that a regression model was fit using the OLS, GLS, TLS or ML. But recently I found a text about the analysis of repeated data, where it was modelled ...
982 views

### Does the delta output from a k-fold cross validation indicate the estimated classification error?

I'm currently working on a logistic regression analysis and want to determine if my model validates well. I used the following R code using the "boot" package: ...
904 views

### Averaging data then fitting vs fitting then averaging in non-linear regression?

I have a very similar problem like in this question. The difference is that I am dealing with non-linear regression. Moreover, the answer to that question suggests that there should be no difference ...
35 views
+50

### Converting Categorical Data to Numerical by Sampling

Suppose I had sampled $1000$ individuals from a population in order to learn about two different questions, both of which had categorical, binary answers. (For the sake of this hypothetical, let's say ...
949 views

### Insignificant coefficients in Logistic Regression after LASSO variable selection

I am trying to use the LASSO technique to identify which variables to include in my model. I used cross validation to identify the value of lambda which minimizes the CV error. For this minimal value ...
255 views

### Nonparametric/nonlinear regression

I am looking for a survey/book on some state-of-the-art non-parametric (or nonlinear regression) methods, preferably with an inclination towards sequential data. Till date I have used ...
375 views

### Linear regression with depended predictor variables

Short story: Why is it important that the predictor variables of a linear regression model are independent? If I am not interested in the coefficient but only in the question, which predictor variable ...
9 views

### Unique Variance Explained by Regressors [closed]

I have a question that needs a bit of help: "The pearson correlation between x1 and y is r=0.4 and SSY=100. When a second variable, x2, will be added to the regression model, we get R^2=0.25. How ...
15 views

### Independent Variable effect's change Between Two Periods

I used the Cox proportional-hazards model, which investigates the relationship between the time of occurrence of an event and a set of explanatory variables in the presence of censored data. The goal ...
2k views
+50

### Testing predictive power of a set of features

This is perhaps a typical setup in Bioinformatics: we need to build a model to predict a dependent biological variable (say $y$), given a large set of (usually genomic) features $X$ (which might not ...
190 views

29 views

### Which regression method causes the ordered coefficients to decrease quickly in absolute value? [closed]

Which regression method causes the ordered coefficients to decrease quickly in absolute value? Lasso lets the coefficients shrink to zero, but I don't know if that has to be in the order of the ...
129 views

### Adjusting for age and gender in ANOVA

I am performing an ANOVA to compare the means of three groups. However, I need to adjust for the effects of age and gender in the ANOVA. I'm not quite sure how to go about it in R. Conventionally, I ...
15 views

### Choosing the most appropriate method for different data sets [closed]

I have five datasets with the following characteristics: Data Set 1: Many small but comparable coefficients, but no zeros (n=100, p=90) Data Set 2: Most of the coefficients are zeros (n=100, p=2001) ...
2k views

### Setting max_depth greater than the number of features in a Random Forest

I was using random forest regression to predict the price of a house. There are only 3 features in data set. Initially when I had set max_depth=2 the result was ...
14 views

### Constraining regression coefficient to non-zero

I have a regression problem where I don't want the coefficients to be negative. Is setting negative coefficients of OLS to zero the same as constraining the coefficient to be non-zero and solving it ...
137 views

### Generalized least squares error estimation

First of all, I have to admit that I am not statistician so some of my nomenclature could not be very rigorous and maybe a bit confusing; pleas ask me to clarify if necessary. The Problem Let's say ...
120 views

### Environmental variable vector in NMDS

I am using Non-metric MultiDimensional Scaling (NMDS) on a Bray-Curtis dissimilarity matrix. Then, I am trying to link the resulting NMDS axes (let's say "components") to environmental ...