The process of fiting some statistical model to a particular set of data. Mostly done on a computer, and using varied numerical methods such as optimization or numerical integration, or simulation.

learn more… | top users | synonyms

0
votes
0answers
24 views

Best way to model this data, qfit or fpfit? How to get equation?

So I have this relationship, which is obviously not linear. The purpose is to see if there is (and what kind of) a relationship between FRAG (test score) and MD-R (mm^2/s). There are other covariates ...
0
votes
0answers
22 views

argument for using nAGQ=0 in glmer (lme4)

I am fitting a generalized linear mixed model using the glmer function from the package lme4. As I have 200 individuals and want to do cross validation, I have to run a model 200 times. I wanted to ...
1
vote
0answers
52 views

Comparing two emprical distributions [closed]

I have a time series empirical density distribution and other multiple empirical time series density graphs. I would like to compare how similar is the first empirical PDFs against the other empirical ...
-1
votes
1answer
27 views
0
votes
0answers
38 views

When does it make sense to fit a distribution to data?

More in general, if a fitted generative model is at best a biased approximation, and let's say we're interested in the predictive distribution, there is always an information loss associated with the ...
2
votes
1answer
41 views

Fitting an arc from samples taken at evenly spaced angles

I have an application where I am rotating an object and measuring its position in X,Y as it rotates. There is some measurement error in both X and Y at each point (haven't yet been able to ...
0
votes
0answers
35 views

Heston Model parameter estimation

I would like to know, whether there is some literature or paper (even better) available that examines the Heston model parameter estimation. I am not searching for calibration, it should only focus ...
0
votes
1answer
27 views

How to find (using R) the function which my experimental data follow?

I have an experimental time-depending data (Mean as a function of Time). I want to find the function which my data follow. I have already tried fitdistr and Gam, but it hasn't really helped. Could ...
1
vote
1answer
34 views

Finding the best fitted distribution for an experimental data with R

I have read most of the similar questions and answers, but still can not solve my problem... I have an experimental medical time-depending data, which I want to analyse and classify. I'm trying to ...
0
votes
0answers
11 views

How to check if the data follow a certain Conditional random field model

I have certain data for which I think that there is a relation between neighbouring points given certain features. However, I don't know how to get intuitive plot that shows this relation. I checked ...
0
votes
0answers
16 views

Fitting a student t distribution in R using fitdistr() yields error “non-finite finite-difference value” [migrated]

Reproducable example which will give the mentioned error code every time is: (Note that even without set.seed, the error comes up every time) ...
2
votes
1answer
30 views

Estimating the parameters of a Beta distribution using the sample average and standard deviation

This is a simple question, but I just want to be sure. Imagine that we have a sample of $n$ data $\{x_1, \dots, x_n\}$ and that we want to fit them to a Beta distribution. Imagine that we have ...
2
votes
1answer
61 views

Why does this data throw an error in R fitdistr?

I'm trying to fit a weibull distribution to this but am having problems. Not sure why. What causes the NaNs? Thanks! ...
1
vote
0answers
28 views

Fitting a Gumbel mixture model in R

I am trying to fit some data to a Gumbel mixture model, however there doesn't seem to be any libraries that does this. I tried coding up my own MLE method, but am having problems. Any suggestions of ...
0
votes
0answers
20 views

How to optimize costly, smooth, multidimensional, varying scale function with flat regions and slight noise

I am trying to optimize hyperparameters of a complex model. Each iteration takes roughly 30s (during which the lower level model is run many times). I believe the underlying function to be generally ...
0
votes
0answers
10 views

What are the criteria to choose for a bootstrapping, frequency, forecasting of fitting method to fit demand data?

My goal is to calculate the inventory height of several products. To do so, I have to calculate the probabillity a certain demand occurres. However to determine the distribution based on historical ...
0
votes
0answers
9 views

How do I fit a distribution to just a few data points obtained through an elicitation process

I currently have only 4 scenarios, each assigned a likelihood (%) and cost impact (£). It relates to costs for a construction project. For example: 25% = £5m, 50% = £50m, 20% = £65m, 5% = £150m. I ...
2
votes
1answer
82 views

Fit monotone polynomial to data

I want to fit monotone polynomials to data. Murray, Müller and Turlach (http://dx.doi.org/10.1007/s00180-012-0390-5) provide an implementation in R ...
13
votes
3answers
265 views

How can I programmatically detect segments of a data series to fit with different curves?

Are there any documented algorithms to separate sections of a given dataset into different curves of best fit? For example, most humans looking at this chart of data would readily divide it into 3 ...
6
votes
0answers
82 views

Fitting the differences between two curves

The problem I'm trying to solve is to algorithmically figure out whether two curves converge or diverge in a graph (visually the problem is almost trivial). For examples: The left one is ...
1
vote
0answers
29 views

What equation should I fit to this plot? (similar to double exponential?)

I have data that looks somewhat like the following plot (and dataset). It's been suggested that a double exponential (e.g. k (exp(−αt) − exp(−βt))) might fit it, but I can seem to get it to fit (using ...
2
votes
0answers
23 views

Best GARCH model using R [closed]

Is there any function in R such as the auto.arima for the ARIMA processes that finds the most suitable GARCH order for a given data?
0
votes
0answers
29 views

A strategy to find outliers in a fitted Poisson distribution

I'm using SciPy to fit Poisson distribution to some empirical data in order to find possible misfits. The thing is there are no built-in tools to find outliers in the SciPy kit and I've got no will to ...
0
votes
0answers
19 views

Fitting Data with Ties Using unique() Walk-Around and ks.test

I'm looking for a distribution that best fits my data. Looking at the frequency plot, seems like the distribution could follow a Gamma or Weibull distribution. With that in mind, I use the ...
0
votes
1answer
41 views

What is the difference between predict() with and without offset-term when using vglm() of the VGAM package in R?

I am fitting a regression model based on the generalized poisson distribution. Here is an example ...
0
votes
0answers
33 views

Deriving errors for fitted parameters using Monte Carlo

I have the following data: One 2D image, each of its pixels is a measurement. I will call this "data map". One 2D image, each of its pixels is the error (1 sigma) of the above measurements. I will ...
1
vote
0answers
41 views

Using ARIMA to Create a Model in R

I'm trying to get understand why the values for my model are different when using two different functions. The first one is from Example 9.2 (International Visitors to Australia), using the ...
0
votes
0answers
10 views

Power Law reweighting the tails [duplicate]

I am trying to show that from two sets of data, one obeys a power law and the other not. I am trying to quantify that using a numerical tool performing a power law. My tool, python-scipy fitting tool, ...
3
votes
1answer
130 views

Automated detection of outliers in one dimensional data

I have several datasets that I need to be able to fit (the goal is to find the outliers). The datasets were created by groups of images and the x is an index number of the image and y is a focus ...
5
votes
1answer
52 views

Least squares with exponential model

I'm trying to fit values from this model $$y(x)=ae^{−bx}+c$$ where a, b and c are 3 different parameters that I want to find with least squares. So using least squares I want to find the value of a, ...
5
votes
2answers
93 views

Fit exponential distribution with noise

I'm trying to fit an exponential with noise (which in this case is a constant $c$) like this one $$ y(x) = \alpha e^{- \alpha x} + c \text{ ,}$$ having $(x_i, y_i)$ values (So $\alpha$ and $c$ are ...
9
votes
2answers
493 views

Difference between regression analysis and curve fitting

Can anybody please explain to me the real difference(s) between regression analysis and curve fitting (linear and nonlinear), with an example if possible? It seems that both try to find a ...
0
votes
1answer
50 views

How does the covariance matrix of a fit get computed?

I often have to fit data of physical experiments as a student. I always use (python's) functions like numpy.polyfit or scipy.optimize.curve_fit for that purpose. They also allow you to retrieve the ...
1
vote
0answers
40 views

Fitting measured, real-world data to theoretical distribution: How to test goodness?

I have a large sets of real-world user data (30k, 80k, 90k measurements). To be precise those are simply session lengths for a specific system. I want to create a theoretical model of this, to ...
1
vote
1answer
37 views

How can I avoid misidentification of a exponential distribution as Gamma or Weibull?

I'm trying to write a piece of code in R that identifies a set of sample data as belonging to a specific distribution and pull the specific distribution parameters, by performing the K-S test and ...
2
votes
0answers
47 views

what to do with ridiculous but valid leverage points

So I'm having some difficulty fitting a linear model to the data (see other post here glm model fit - can't find a family/link combination that produces good fit). In particular, I'm worried ...
1
vote
1answer
93 views

glm model fit - can't find a family/link combination that produces good fit

I am having difficulty finding a correct glm model to fit my data. The outcome is the length of time in months a person will spend in prison (sentence length). It's technically a count, all positive ...
2
votes
2answers
130 views

How to change the null hypothesis of the coefficient in the least squares fitting?

I have a least square fitting like this: fit = lsfit(log10(M), log10(RS), wt) This function lists statistics and p-values for the coefficient considering the ...
0
votes
1answer
99 views

Linear models: estimating the b vector on R

Starting from the basic linear model problem: $$ y=Xb+e $$ And the least squares method of $b$ estimation $$ \hat{b}=(X'X)^{-1}X'y $$ And also considering a model not of full rank (an one-way design, ...
3
votes
0answers
68 views

How to avoid an overfitting?

The standard way to avoid an over-fitting is to use a "validation set". It means that we split the data into two parts. The first part we use to fit (train) and the second part we use to validate. ...
0
votes
0answers
29 views

Purpose of fitting parallel lines

I'm a student. I have a dataset of a set of observations split across three factors/categories. I'm being asked to fit three regression-lines with identical slope (but different intercepts, ...
1
vote
0answers
56 views

Fitting an envelope to x-y data in R

I have some data that I'd like to create an envelope for it. As in the picture, the data is always positive and I'm looking for something that will capture my crudely hand drawn red line. It should ...
0
votes
0answers
19 views

min ChiSquare to fit dipole axis

I am trying to fit a dipole. As I am not sure about some aspects (and not sure whether I understand it at all) I would like to ask this question here. Basically I have a distribution of $n$ sample ...
0
votes
0answers
30 views

How to fit quantized data

I have some measurements which were quantized during measuring. Now I want to get the overall change during a period of time, e.g. 15 minutes. Because of quantization however, the same value is ...
1
vote
0answers
15 views

How to divide scattered points among multiple curves? [duplicate]

I have the following scattered points graph: To me, it seems that the points describe 2 (maybe 3) logarithmic curves. Is there a way to say which point belongs to which curve?
1
vote
1answer
57 views

Do predicted values differ if variables included stepwise or simultaneously?

You make a linear model #1 of the following form to predict adult human height: $$ y = \beta_{0.1} + \beta_{1.1}\text{Height}_\text{dad} + \beta_{2.1}\text{Height}_\text{mom} $$ You calculate fitted ...
0
votes
0answers
38 views

choosing between non-linear/logistic regression models

We are fitting regression models to dose-reponse data obtained from drug assays. Where a drug has an effect on cell viability, there is often a sigmoidal relationship between the proportion of viable ...
1
vote
0answers
14 views

Linear fit parameter-errors as a function of the number of data-points

I am trying to work out the errors of $m$ and $b$ in a linear least-square fit of a straight $y = m \cdot x + b$ to $N$ equally-spaced data points $Y_i$ on the interval $I = [-\Delta x \cdot ...
0
votes
0answers
30 views

How do I interpret which model is the best fit for my distribution (AIC)?

I'm new here so looking for some guidance; How do I interpret the following variables to understanding which model is considered the best fit to my distribution. ...
0
votes
0answers
31 views

Fit a transition matrix

Probably I am asking something very simple, but I am unable to figure out the answer from previous posts. I have a set of data with the age (in years) an the condition (in a class form 1 - good to 5 - ...