Use this tag only for regression models (q.v.) in which the response is a nonlinear functions of the *parameters* (not because it's a nonlinear function of the *predictors*).

learn more… | top users | synonyms

0
votes
0answers
9 views

Pareto two-tailed GLM regression

How can I perform a Pareto two-tailed GLM regression? Any reference to link functions and code in R?
0
votes
1answer
46 views

What is the difference between GLM and splines?

Suppose we want to predict $Y$ given the following $X$ observations: ...
1
vote
2answers
62 views

Estimating “Probability” in normal probability plot

I plotted normal probability plot in R using qqnorm and qqline. I want some help on: How to estimate "probability" that a data ...
0
votes
0answers
34 views

Selection of failed fitting results in MC Simuation

I recorded a set of experimental rates $r = r(c,T,P)$ at 2 values of $c$ and >15 values of $T$. $r(c,T,P)$ obeys the following functional form: $$ r(c,T,P) = ...
1
vote
0answers
18 views

'systemfit' package and systems of non-linear equations/regression

I am trying to estimate a system of non-linear equations using 'systemfit' package in R. I have had issues with it. The two equations share the same parameters i.e. "sigma", "al" and "ae". I expect ...
3
votes
2answers
71 views

Linear post-treatment of nonlinear regression

I have often found in practice, using nonlinear regression techniques such as feedforward neural nets or random forests, that the resulting actual-vs-fitted plot (on training set) seems obviously ...
0
votes
0answers
8 views

Function domain as a problem for linear output unit

I'm doing some regression using neural net(using MLP implementation from http://deeplearning.net/tutorial/mlp.html, I used my own but it produced the same results before I opted for this one), ...
3
votes
2answers
47 views

Non-linear least absolute deviation regression with multiple global minima

I am fitting a single exponential decay formula with three parameters (a,b,c): y ~ $a \exp(-xb) + c$ using the LAD cost function: $ \min \sum |(y - f(x))| $. $x$ is in units of time (as is $b$), and ...
0
votes
0answers
11 views

hierarchical logistic regression Block non-significant, interaction significant

I'm using hierarchical logistic regression and having some difficulty. Im trying to predict self-harm vs none based on IVs age, gender, alcohol, educational attainment. They are all yes/no except ...
7
votes
3answers
371 views

What does “curvilinear” mean?

As far as I can tell, curvilinear is defined vaguely but means the same as nonlinear. Is that correct? Or does curvilinear have a distinct definition?
0
votes
0answers
25 views

Beyond multiple linear regression for longitudinal data?

I have a relatively large dataset from a longitudinal study (~100k subjects and ~10 random effects) where the outcome is a real-valued parameter. A simple run of R's ...
0
votes
1answer
39 views

How to compare different nlme models ?

If there are 2 nlme models with same non-linear mean function, model 1 and model 2, how do you compare them ? Which R function does this for us ? And when there are random effects or fixed effects, I ...
2
votes
1answer
17 views

Varying Non-Linear Parameters Based on Groups in R

I'm trying to develop a non-linear model, but I'd like to have the values for the parameters vary by group. To give you an example, a section of my data (just random numbers here) looks like: ...
4
votes
1answer
96 views

Model with non-linear transformation

I don't understand this concept well and need help. I was choosing whether to use a linear model or apply a non-linear transformation in my model formula. To do a diagnostic, I quickly plotted my ...
2
votes
1answer
43 views

Choosing variable transformations in non-linear relationships

I am confused about how to apply a transformation to my predictor/response variables to test curvilinear relationships. I read about log transformations, polynomials, quadratic functions. But I am not ...
3
votes
2answers
82 views

Good machine learning algo for partial derivatives?

Does anyone know of good robust algos to estimate partial derivatives of a regression model? I am talking about a general regression model like this: $\mathbb{E}(y|x_1, x_2, ... x_n) = f(x_1, x_2, ...
0
votes
0answers
19 views

how to implement linear or non linear regression for 3d position estimation?

I am a beginner in Machine Learning. For my project I need a regression algorithm that can estimate the 3D position of a device based on some constraints (moreover inputs). I know how to implement ...
2
votes
2answers
136 views

R: Fitting a model with periodic, nonlinear and categorical components

Can anyone give me some advice on how to fit a model with linear (some categorical), non-linear and time series components in R? I don't want to use a non-parametric model like a Loess smooth or ...
2
votes
0answers
41 views

Catagorical variables with very uneven distributions? Removal/modify/leave?

In my current dataset I have quite a few categorical variables. Most have decent distributions between the categories. 30:40:30 splits etc. where these are percentage of dataset members per category ...
3
votes
2answers
37 views

What model would be appropriate for predicting electrical consumption given multiple (mostly) independent variables?

I have about 1000 samples worth of daily electrical consumption for a building. I'd like to build a predictor based on a number of observable inputs, including: daily temperature (continuous) hours ...
3
votes
1answer
38 views

Fit nonlinear parameter

I'm attempting to fit this model: $P = C_0 + C_1*U^r$ Given known vectors of observations $P$ and $U$, I want to fit values for $C_0$, $C_1$ and $r$. How do I make this fit in R? or preferably GSL ...
1
vote
2answers
24 views

Can time be squared to develop a curvilinear model of crop yield against time?

I am developing a linear model of yield against time (33 years of yield data) where year is 1975,1976....2007. I want to know whether change in yield over time was linear or not. So I fitted a linear ...
2
votes
1answer
62 views

N-sigma curves for a non-linear least square curve fit

I'm using python's scipy.optimize.curve_fit routine (which uses a non-linear least squares) to fit an exponential function of the form: ...
1
vote
1answer
42 views

Multiple regression analysis with spatial data as independent variable

In my PhD thesis I am working on spatial modeling of different chemical parameters in groundwater, and for spatial modeling I am also using the multiple statistical approach. I have a question about ...
4
votes
1answer
133 views

Residual plot for nonlinear regression

I have a couple of questions regarding performance of nonlinear regression models. Are the residuals from a nonlinear regression model supposed to be randomly distributed too (as in linear ...
2
votes
1answer
13 views

Error on extrapolated values from a fitted function

I have some data points and I fitted a function (2nd order polynomial here) to the data. The algorithm (scipy.optimize.curve_fit) gave me the optimal parameters and ...
-1
votes
1answer
35 views

Why can certain variables in a multiple regression not be included in logarithmic form?

I have a multiple regression equation where log(salary) = b0 + b1(ceotenure). What is the purpose of putting the dependent variable in logarithmic form? How would you interpret the change in y for a ...
6
votes
1answer
234 views

Nonlinear regression

I have some functions of $x$, in the form of $d\sqrt{x}$ or $d\log(x)$ where $d$ is known. I would like to rewrite (approximate is fine) them in the form $a/(1 + bx^c)$, where $a$, $b$ and $c$ are ...
1
vote
1answer
60 views

$R^2$ correspondence for nonlinear time series

Is there a statistical measure for nonlinear time series data that is comparable to $R^2$ value in linear regression (giving an idea of how well the fit is)? The data is not monotonic, so I cannot ...
0
votes
0answers
26 views

Linear Kernel taking more time to train than RBF Kernel (SVR)

I'm doing a Support Vector Regression with about 70k samples with 500 features each. I'm using sklearn implementation of SVR and my input for the train set is a sparse matrix. But, for my surprise, ...
1
vote
0answers
30 views

Guessing starting values for PARAMETERS statement in PROC NLIN

How to guess what should be the starting values for beta estimates, which we need to specify in PARMS or PARAMETERS statement while using PROC NLIN (PROC NLIN is used to run non-linear regression in ...
0
votes
0answers
59 views

Google Prediction API Flaws

I have been testing the google prediction api https://developers.google.com/prediction/ It seems to be excellent, i gave it 5 features so it can predict a regression problem, the API fitts the data ...
6
votes
1answer
121 views

Gaussian mixture regression in higher dimensions

Problem: I have a discrete representation of a surface/height-map $z = f(x,y)$ that i want to model as a mixture of gaussians (please take probability distributions out of your mind for a moment). ...
0
votes
1answer
26 views

How can I apply LR with non-linear features?

My training data looks like this: ...
4
votes
3answers
329 views

Any algorithms better than polynomial regression

I am trying to fit a baseline through my data, and I am not getting close enough with polynomial regression. I used gradient descent to set the parameters. Are there any other ways or algorithms that ...
3
votes
1answer
115 views

Is this identifiable?

I am interested in the following model : ($1 \leq i \leq p$, $1 \leq j \leq n_{i}$) $$y_{i,j} = A (1+a_{i})(t_{i,j}+\gamma_{i}) + \varepsilon_{i,j}$$ where $A \in \mathbb{R}$, $(a_{i})_{1 \leq i ...
0
votes
1answer
29 views

Looking for measurement for nonlinear model

I use KNN regression to train out a model. The model estimates running time of a program based on different inputs, and the output is a single variable, which is time (double type). I want to ...
0
votes
0answers
26 views

Parametric spline regression after Gaussian process regression?

I'm trying to develop a (functional) model to predict the output of a computer simulation. I've run a small set of experiments, varying the 4 predictors $a$, $b$, $c$, and $d$ via LHS, and calculated ...
0
votes
0answers
25 views

Regression with t distributed autocorrelated errors

I am new, so please bear with me, until its correctly formulated: In short: I am doing simultaneous non-linear regression (parameter estimation) of two different parametric models to three different, ...
0
votes
1answer
67 views

Confidence region about a regression model

I have a set of means and standard deviations. For each mean I can calculate a 95% confidence interval. I plot these means and confidence intervals against an independent variable and I fit a best ...
1
vote
0answers
52 views

Predictive model for heavy tailed distribution

I have a variable with values strongly skewed towards zero: table() ...
1
vote
1answer
39 views

Nonlinear model wirh effects over linear term

I have been working in R with nonlinear models such us: $Y = \alpha_{0}\text{(varia)} + \alpha_{1}\text{Time}\text{(varia)} + ...
0
votes
1answer
54 views

significance of coefficients and significance of marginal effects

Suppose I have a non-linear model, say probit/logit, how can I understand the significance of a coefficient as opposed to the significance of it's marginal effect? Say, I just need to know the ...
0
votes
0answers
56 views

Piecewise nonlinear regression by MLE in R software

I have been working with nonlinear models whose parameters have been estimated by Maximum Likelihood. Also, I use the "Vuong" test for model selection in non-nested models, this test requires to have ...
1
vote
0answers
10 views

What do I do with zero columns in a tensor.prod.model.matrix?

Suppose my two marginal bases are given by (for variable $p$ and $t$ the degree is equal to $1$ and $5$ inner knots are used). ...
1
vote
0answers
30 views

Comparing nested, non-linear models

I would like to compare the fit of two non-linear regression models: 1) $$ Y = (\Pi^{10}_{i=1}\beta_i^{x_i})^{1/\Sigma \beta} $$ 2) $$ Y = \begin{cases} (\Pi^{10}_{i=1}\alpha_i ...
1
vote
1answer
46 views

Regresssion of Accurate Data

I'm collecting calibration data for a device which involves three variables $S$, $L$, and $x$. For a given coordinate $(S, L)$, the device will provide me with the corresponding value of $x$ to a high ...
1
vote
1answer
88 views

Multiclass logistic regression update algorithm

My question pertains to section 2, called "Multi-class Logistic regression", of this pdf, especially the update rules. (The entire section is only a couple of paragraphs.) Everything seems to make ...
7
votes
2answers
268 views

Selection of k knots in regression smoothing spline equivalent to k categorical variables?

I'm working on a predictive cost model where the patient's age (an integer quantity measured in years) is one of the predictor variables. A strong nonlinear relationship between age and risk of a ...
1
vote
0answers
34 views

How to calculate standard errors of a non-linear model prediction?

I'm trying to understand how to show the prediction error of a model fit in R using the non-linear least squares function nls. Although there is an argument ...