Questions tagged [nonlinear]
This tag is deprecated because it is too broad. Please find a more specific tag.
343
questions
-2
votes
0
answers
12
views
Regression model: Y = aX1 + b(X2)^2 [closed]
I received an exercise with requirement of finding a regression model of Y = aX1 + b(X2)^2 for the given data tabe.
Thanks in advanced!
0
votes
0
answers
6
views
Lagged nonlinear independent variable?
I came across a paper that write the following:
The first set of independent variables, REPRESSION(1)i,t-1, REPRESSION(2)i,t-1, REPRESSION(3)i,t-1, REPRESSION(4)i,t-1, are binary indicators measuring ...
- 55
4
votes
1
answer
71
views
Can nonlinear regression identify this equation?
I want to estimate the following regression equation:
$y = a + \frac{b}{r*x + 1}$
x is the independent variable, and a, b and r are parameters to be estimated. I have been told that the model is not ...
0
votes
0
answers
19
views
What would be a good machine learning model to predict how independent variables with low correlation affect the dependent variable?
I am currently trying to build a machine learning model to predict how a variable "age" affect the efficacy of a worker. The dataset includes many dependent variables, but the only variable ...
- 1
1
vote
0
answers
25
views
Are polynomial models unreliable at data extremes? [duplicate]
I have fitted a polynomial regression (4 degree model) to describe a non-linear relationship between my two variables. My question is why does this model begin to decrease towards the right hand side ...
- 789
0
votes
0
answers
17
views
how do we capture effect of X1 on other variables when its effect depends on level of X2?
imagine we have five variable X1, X2, X3, X4, X5. what I am looking to find is the effect of X1 on X3,X4,X5 when the X2 is at its lowest and highest periods.
for this, I applied the TVAR function in ...
3
votes
0
answers
60
views
Why do you take the natural logarithm plus one? [duplicate]
I have read in many different studies now that take the natural logarithm of one plus x.
For example, in econometrics many studies use the natural logarithm of one plus the total assets.
I do not ...
- 41
1
vote
1
answer
45
views
Non-Normal Residuals in Real World Data
I have a dataset that includes real world data (not experimental or survey data) for a set of countries year by year for 40 years. The data was collected by entities such as the World Bank and United ...
- 11
2
votes
0
answers
11
views
What would be a good model fit for a rise-and-fall time series data?
I have two time series measurement of protein "activation" under two different conditions, (A) and (B). My end goal is to fit a model and use the model parameter that best describes the rate ...
- 131
1
vote
1
answer
56
views
Interpretation of multilevel negative binomial output
I am wondering how to interpret the coefficients returned in a multilevel (repeated measures nested within person; random intercepts-only) negative binomial regression. Output is pasted below ...
- 21
2
votes
1
answer
58
views
Linear regression expression of a non-linear model
$Y=\frac{x_1x_2}{β_0+β_1x_1+β_2x_2}$
It was written on some slide of my econometrics class that such a model could be expressed in the form of a linear model, but I am struggling to derive it by ...
- 21
3
votes
1
answer
183
views
Are ARCH and GARCH linear or non-linear models?
Are these models considered linear models?
I was reading an article that stated that GARCH(1,1) is superior to non-linear GARCH Models.
Source: https://www.researchgate.net/publication/...
- 33
1
vote
1
answer
85
views
What is the definition of a non-linear estimator? I heard that ratio of estimators is non-linear
Why don't we consider nonlinear estimators for the parameters of linear regression models?
says that LASSO is a non-linear estimator.
I think LASSO has a solution via matrix multiplication. I don'...
user318514
0
votes
1
answer
51
views
Power calculation by simulation - what do I do with model failures?
I'm trying to run a power calculation by simulation on a set of exponential decay datasets using the nlme package in R. Here's the process:
Simulate a bunch of exponentials, using some conservative ...
- 111
0
votes
1
answer
43
views
Transformation of periodic data prior to PCA?
Basically I have periodic data (angles from -180 to 180) that I want perform a PCA on. However, since the data is periodic, a change in angle from say 170 to 10 will not be accurately reflected. I was ...
3
votes
1
answer
45
views
Can Correlation based feature selection discard features that show no correlation by themselves but are meaningful only if combined?
Assuming a feature selection process based on correlation or some other metric, is it possible to overlook input features that by themselves show no actual correlation with the target values, but that ...
- 33
1
vote
0
answers
18
views
Mapping Parametric Curves with auxiliary variables
The image below displays an approach of using an auxiliary variable to map the parametric curves of a standard normal pdf and cdf.
In Equation (1), z as r.v. is clearly one-dimensional. However, after ...
1
vote
0
answers
302
views
Using curve_fit for Non-Linear, Multi-Variate Models [Python] [closed]
Warning: ML Noob.
I have a 3D dataset (data at the bottom) with 2 feature variables and 1 target variable. Polynomial Regression produced unsatisfactory results and it seems that the relationship of ...
1
vote
0
answers
31
views
How to test a product of a OLS estimators?
I estimated a vector $\beta $ using OLS $\hat \beta =(\hat e_1 \hat e_2 \hat e_3)$ and I have the covariance matrice $\hat v(\hat \beta )$.
How can I test this null hypothesis $H_0 : \hat e_1 \hat ...
- 211
0
votes
0
answers
63
views
Estimating the coefficients of a non-linear regression
I am trying to estimate the coefficients $\lambda, \alpha, \beta_1, \beta_2, \gamma, \eta$ in the below equation using Python and some financial data
$$ \lambda \times \text{(participation %)} \times \...
- 133
1
vote
1
answer
203
views
Is Ordinal logistic regression linear or nonlinear?
Quick question, is ordinal logistic regression a linear or nonlinear model?
Finding different sources supporting the other, and the more I read the more I get confused myself.
Perse, it should fall ...
- 23
0
votes
0
answers
22
views
Advice on fitting curve to three-pooled plant decomposition model in r
I have just finished running a plant decomposition experiment measuring the decomposition of pine needles across climate and lithological types. We have mass loss, plant chemistry data (c, n, labile ...
0
votes
0
answers
35
views
How do I fit a nonlinear mixed effects model with multiple observations from the same sample units using nlmer()?
I am trying to fit a nonlinear mixed-effects model with lme4. However, I am not sure how to adequately account for my sampling design.
The model is supposed to ...
0
votes
0
answers
49
views
Need a predictive (binary outcome) model for a set of binary variables and one continuous variable
I have a data set of about 1600 binary results, that I want to predict from 9 binary variables and a continuous variable. The relationship between the continuous variable and the result variable by ...
0
votes
1
answer
95
views
Fitting a cubic-like curve to data in R
I tried using nls() in R to fit the following expression to a set of data:
where g=9.8, alpha & B_0 are unknown, a = 0.01, z_0 = 0.3 such that:
theory <- as.formula(V~-(9.8)ab*(pi)(0.02^2)(T)(...
0
votes
0
answers
23
views
Distribution of product of samples from two Normal distributions [duplicate]
Hello!
I have two normally distributed random variables $M \sim N(\mu_1,\sigma_1^2)$ and $V \sim N(\mu_2,\sigma_2^2)$ having physical meaning as $M$ - mass and $V$ - volume.
I need to figure out the ...
1
vote
0
answers
35
views
Additive error model for non-linear case
I have checked other questions regarding additive noise model, but I could not convince myself for non-linear case. Assume the data vector $\mathbf{d}$ is described by a possibly non-linear ...
- 11
0
votes
1
answer
69
views
Kaplan's Non-Linearity Test
I've been searching for an R package or function that applies the Kaplan non-linearity test to univariate time series but they are nowhere to be found. Such test has been widely applied in the ...
- 680
1
vote
1
answer
438
views
Possible non-linearity pspline Cox model
Our working group ran a Cox regression with a p-spline to model the possible non-linearity of continuous variables. However, I'm a bit confused with the interpretation of the linearity or non-...
- 606
2
votes
0
answers
496
views
How to fit logistic regression to circular data?
I've made a script that can do normal logistic regression with sigmoid(linear model). However, I have data that has a circular decision boundary and looks like this.
My question is how I can modify ...
- 21
1
vote
0
answers
110
views
Degrees of freedom for a $\chi^2$ with non-linear polynomial model
I have a $\chi^2$ below for some model function $F$: $$ \chi^2 = \sum_{i=1}^{i=M} \frac{\left(y_{i}-F\left(x_i;\vec{a}\right)\right)^2}{\left(\Delta y_{i}\right)^2} $$ I know that non-linear model ...
- 143
2
votes
1
answer
54
views
If X^2 is not significant but X is significant, do I have to remove X^2 and run again the regression analysis?
Model DV ~ W+PDSR+Corr+(FAGDP1+FAGDP2)+log(PCGDP)+Exp+Pop+Health
FAGDP2=FAGDP1^2
Result:
After removing FAGDP2(FAGDP1^2) from the model, FAGDP1 turns to be insignificant
Am I right in removing FAGDP^...
11
votes
2
answers
4k
views
RMSE vs MSE loss function - the optimization solutions are equivalent?
If we optimize a function $f$ with respect to loss $L$, which is defined as RMSE; Are we going to get the same solution as optimizing MSE ? Even, if the function $f$ is non-linear (e.g. a neural ...
- 547
1
vote
0
answers
418
views
Quantile regression with an exponential function
The following equation: y = a*x**b where y is a nonlinear function of x. By taking logs, the equation can be expressed as: ln(y) = ln(a) + bln(x). I would like to run a quantile regression instead of ...
- 11
0
votes
0
answers
114
views
standar error of non-linear regression
I'm trying to compute the standar error of a non-linear regression fit, I find the answer in this post
Non-linear regression confidence interval
But i did't find that formula in any other place,and I ...
1
vote
0
answers
16
views
"Nonlinear" random spatial field: an example
I want to generate a "nonlinear" random spatial field in the sense that the autocorrelation function in function of the lag/distance $h$, $\rho(h)$, should be not equal to the $R(h)$ ...
1
vote
2
answers
393
views
Isn't ReLU just a linear function? [duplicate]
I am doing Andew Ng's Deep Learning course and he says that ReLU is better than Sigmoid, but it makes no sense to me at all.
The biggest advantage of activation functions are too get a non-linear ...
2
votes
1
answer
81
views
Proof of how to calculate the coefficient of variation of a nonlinear function
I'm struggling to find the proof of Eq. D.14b shown in the figure below:
The variable $b$ represents the “Least Squares” best-fit to the slope between $r_e$ and $r_t$ which both depend on $X_1$ to $...
- 391
1
vote
0
answers
56
views
Why do we use Relu if it's mostly linear
We use activation functions in neural nets to introduce some non-linearity. Now I understand that Relu is a non-linear function and I had no problems with it.
But today I learned that when the output ...
- 43
1
vote
0
answers
19
views
Simultaneous interaction model with nonlinear equations
I observe many groups of 3 individuals, and I want to estimate an interaction model of the form:
$$\begin{array}{rl}
y_1&=f_1(x, y-1)+e_1\\
y_2&=f_2(x, y-2)+e_2\\
y_3&=f_3(x, y-3)+e_3
\end{...
3
votes
1
answer
137
views
Non-normal data transformation - what does it imply exactly and what does my results mean?
I am missing some understanding here. I am inspecting the relationship between the heart rate variability (HRV) and errors in the Sustained Attention to Response Task. When I conduct a basic linear ...
- 77
1
vote
1
answer
193
views
Bayesian fitting of a nonlinear model [closed]
Some years ago I developed a nonlinear model and java fitting engine that performs well enough to be useful, but is definitely a hack. I would like to modernize and publish an open-source tool (...
- 21
6
votes
2
answers
261
views
Regression with flexible functional form
I am assuming a model of the form
$$Y_i=\alpha+\beta X_i+g(\mathbf{Z}_i)+\epsilon_i,$$
here $\mathbf{Z}_i$ is an $m$ dimensional vector and $\epsilon_i$ is i.i.d. white noise. I would like to ...
- 320
0
votes
1
answer
654
views
Correlation is a symmetric measure, but scatter plot matrix shows asymmetric dependence
The correlation matrix demonstrates that correlation is a symmetric measure: $\rho(X,Y) = \rho(Y,X)$ since the lower off-diagonals are mirror images of the upper off-diagonals.
The scatterplot matrix ...
- 3,343
0
votes
0
answers
471
views
How to use a scatter plot to detect non-linear co-dependence between two variables?
A scatter plot matrix of 3 time series (financial returns data) are shown below. It is a multivariate representation of a scatter plot, with the individual pairs shown in the off-diagonals.
The ...
- 3,343
4
votes
2
answers
1k
views
Can non-linear dependence be detected between two variables by regressing them?
Linear regression is meant for linear relationships right, so, if I don't trust linear correlation and want to find out if random variables $y$ and $x$ have a non-linear relationship, can't I just ...
- 3,343
16
votes
4
answers
2k
views
What is the best programmatic way for determining whether two variables are linearly or non-linearly or not even related
What is the best programmatic way for determining whether two predictor variables are linearly or non-linearly or not even related, maybe using any of the packages scipy/statsmodels or anything else ...
- 283
0
votes
0
answers
27
views
Does a low correlation level warrant the need to try a different dependence measure?
Can it be determined somehow whether the correlation coefficient between two random variables would be insufficient for assessing the level and type of co-dependency between them, and that another ...
- 3,343
1
vote
1
answer
64
views
Solving a system of nonlinear equations involving only products of unknowns
I would like to find the solution of a system of equations of the form:
$A = w_1 F(x_k) + w_2 F(x_l) + w_3 F(x_m) +...$,
where the unknowns are the $w_i$ and the function $F$, while my data are the $A$...
1
vote
0
answers
89
views
Stopped by zero step from line search - R stops optimization early
I am trying to minimize an objective function, $J(\theta)$, with respect to $\theta$, a 19-dimensional parameter vector. $J(\theta)$ is a smooth nonlinear function so I have tried various gradient-...
- 11