Questions tagged [parameterization]

For questions about how to parameterize some statistical model, or comparisons between different ways to parameterize.

Filter by
Sorted by
Tagged with
3
votes
0answers
47 views

Family of flexible parametric mappings $f_\theta:(0,1) \rightarrow \mathbb{R}$?

For the purpose of reparameterizing a model (mostly with the goal of improving MCMC efficiency), I am looking for a family of flexible parametric mappings $f_\theta:(0,1) \rightarrow \mathbb{R}$ such ...
7
votes
1answer
11k views

What does the cost (C) parameter mean in SVM?

I am trying to fit a SVM to my data. My dataset contains 3 classes and I am performing 10 fold cross validation (in LibSVM): ...
0
votes
1answer
221 views

Estimate parameters for skew normal distribution

I know there is already at least one question answer with this, but I think the solution does not apply in my case. I have a population for which I know the mean, variance and skewness. I saw how to ...
1
vote
1answer
56 views

Different logistic regression models

I've been revising the concepts of logistic regression and suddenly realized that the probability function of the logistic model in the book ISL looks absolutely different from other sources. For ISL ...
0
votes
1answer
551 views

Using lasso regression in Matlab with constraints on lambda values

I have successfully ran a lasso regression on Matlab, however, some of the lambda values result in a non-steady state solutions for my linear problem. I would like to basically force the regression to ...
1
vote
2answers
7k views

What are the model parameters and hyperparameters of Random Forest classifier?

The parameters required for a Random Forest classifier are as follows: Depth, $d$ No. of random features, $K$ No. of trees, $I$ Randomizer seed, $R$ Which of the above are hyperparameters and which ...
2
votes
1answer
473 views

Posterior of Dirichlet distribution parameters

I want to obtain posterior distribution for parameters of a Dirichlet distribution $x = (p_1,p_2,p_3) \sim Dir(p_1,p_2,p_3; a_1,a_2,a_3)$ with uniform $P(a_1,a_2,a_3)$ and observed data $X=\{x_1,x_2,.....
1
vote
1answer
57 views

Is it legitimate to use bootstrap to estimate regression parameter with hypothetical sample data?

Consider a simple OLS model: $$ y = \beta_0 + \beta_1x_1 + \beta_2x_2 +\epsilon $$ Suppose $x_2$ is dummy variable which has value either 1 or 0 and the model is successfully fitted with collected ...
1
vote
0answers
18 views

How the process parameters changes with the length of data aggregation?

Is there any general relationship for a process(e.g. ARMA, O-U process) applied to financial data over different time intervals. e.g.In this question there is an answer telling the O.P. to aggregate ...
1
vote
1answer
756 views

parameter tuning using nested cross validation

Parameter tuning in SVM has been performed using a nested cross-validation(CV) approach with 45 folds(outer loop) and 13 folds(inner loop). In this process, the outer loop will have 45 prediction ...
19
votes
5answers
2k views

What's in a name: hyperparameters

So in a normal distribution, we have two parameters: mean $\mu$ and variance $\sigma^2$. In the book Pattern Recognition and Machine Learning, there suddenly appears a hyperparameter $\lambda$ in the ...
2
votes
0answers
241 views

MCMC efficiency and nonlinear reparametrizations

The efficiency (e.g., effective sample size per density evaluation) of most MCMC methods depends on the parametrization. However, so far I have come across little work in the MCMC literature that ...
3
votes
0answers
56 views

How to parameterize coefficient matrix to restrict eigenvalues?

Consider the $r-$dimensional autoregression $$ y_t = Ay_{t-1} + v_t, v_t \overset{iid}{\sim}N(0,\Sigma). $$ It is well known that if all eigenvalues of $A$ have modulus less than unity then this ...
7
votes
3answers
364 views

GLMs must be 'linear in the parameters'

I am experiencing some cognitive dissonance about what 'linear in the parameters' means. For example, here and here. For example, my understanding is $y_i = \beta_0 + \beta_1\beta_2x_1 + \exp(\beta_3)...
1
vote
0answers
66 views

What is a parameter in Bayesian analysis?

In any case study, when we use Bayesian analysis to solve our problem we consider a model parameter which is sometimes known and sometimes unknown. And using this parameter(and of course prior data) ...
1
vote
0answers
59 views

Support of distribution (distribution fitting)

This might be a weird question. I want to know why Matlab still run to produce estimated parameter whenever I input data which doesn't belong to the support of the distribution? E.g. I want to know ...
1
vote
0answers
148 views

Choosing the good initial value of the Newton-Raphson iteration method for Maximum Likelihood Estimation

I want to estimate the four parameters of Exponentiated Modified Weibull Extension (EMWE) distribution introduced by Sarhan and Apaloo (2013) with the Maximum Likelihood Estimation. Because the first ...
2
votes
2answers
677 views

Justification of simulated annealing versus random search

I have a set of 16 integer parameters to optimize. The parameter space is too big for an exhaustive search, so I am using simulated annealing instead. I think my simulated annealing works - it finds ...
2
votes
1answer
200 views

Hierarchical Weibull model: choice of parameterization

I am experimenting with fitting a Bayesian hierarchical model using right-censored and Weibull distributed time-to-first-event data. However, I have some issues that might be related to the Weibull-...
1
vote
0answers
420 views

Help: Random Forest optimization (image classification)

I'm having trouble classifying images using a random forest. The images all have a very similar scale, but they may be rotated arbitrarily around a fixed point in the image. The core problem is ...
1
vote
0answers
57 views

Completely understanding the Confidence Interval - how is it not a probability of containing a population parameter?

I've been doing data analysis for a while, but recently I questioned my understanding of the oft-misunderstood confidence interval. So, I read multiple sources. Many of them say explicitly that the ...
2
votes
1answer
166 views

What is the relationship between covariance matrix and its variance parameter in linear mixed model?

In parameter estimation for linear mixed model for unknown variance, I met some statements saying that "we assume G (as variance) is only known up to its variance ...
1
vote
0answers
22 views

Get level set from 3D dataset obtained exploring a 2D space parameter

I am exploring a 2 parameter space performing simulations. As a result I get a surface as a function of these 2 parameters. I know this is probably simple but I don't know how to look for it. Now I ...
5
votes
2answers
4k views

How to interpret slope parameter estimates for linear models in R?

I wish to analyse a simple lab experiment. I have 8 fish. Four are fed on diet A, and four on diet B. I measure their Nitrogen (N) over 5 time periods (so 5 repeated measures per fish). I wish to know ...
8
votes
1answer
4k views

Can I get the parameters of a lognormal distribution from the sample mean & median?

I have the mean and median values for a sample drawn from a lognormal distribution. Note that this is not the mean and median of the logs of the variable, though I can of course calculate the logs of ...
1
vote
1answer
603 views

Using K-fold cross validation as a hint for number of neurons in hidden layer. Possible flaws?

I have a dataset of 14 continuous variables and would like to predict one (say y) using all the remaining ones (say X). I decided to use a neural network with linear output (since I am doing ...
3
votes
1answer
313 views

Parameter estimation for Kumaraswamy distribution

I'm interested in estimating the shape parameters of a Kumaraswamy distribution from sample data. The closest research I can find is Jones' paper from 2009 which analyses a maximum likelihood method, ...
0
votes
1answer
86 views

Gibbs sampling: ancillary and sufficient parametrization

After asking a question about Gibbs sampling earlier, I have another one for you. I have not been able to find laymen's background on this, the only referenced use I've found for this is in ...
1
vote
1answer
76 views

Ways to stabilize OLS betas [closed]

I am estimating the parameters of a system of OLS equations in Matlab. $y=X\beta+\epsilon \to \hat \beta=(X'X)^{-1}X'y$. My $X$ is a $5\times 5$ matrix and $y$ is a $5\times 1000$ matrix, so $\beta$ ...
2
votes
1answer
1k views

Calculating parameters for a mixture of beta distributions

I have two beta distributions with known parameters: ...
8
votes
1answer
1k views

What is the point of graphical models?

I spent the day learning about the bnlearn package in R only to discover that Bayesian models do not work with undirected graphs. I'm trying to learn about the Markov Random Field Network, and so far ...
-1
votes
1answer
268 views

How should I parametrize a nonlinear increasing function?

I want to learn a nonlinear monotone increasing function $f$ parametrized using a set of weights $w$. Given an input $x$, I can calculate the gradient of the loss with respect to $f(x)$ $\nabla_{f(x)}...
1
vote
2answers
662 views

Spherical Parameterization of Variance-Covariance Matrix in Mixed-Effects Regression

I wonder if someone can please help me with a passage on the article by José Pinheiro and Douglas Bates on unconstrained matrix parametrization. hat ties directly into the question. Although the ...
2
votes
0answers
117 views

how to find the aleatory uncertainty in parameter using Bayes?

Generally, the uncertainty can be categorized into aleatory and epistemic according to whether it can be reduced or not. In Bayesian statistics, one "true fixed parameter" is presumed as discussions ...
2
votes
1answer
51 views

Objective interpretation of a parameter

In the following model equation (purely statistical / descriptive model, no mechanistic information involved): $$ Y = a \times X^b $$ considering that $Y$ and $X$ are two measurements, say, $Y$ is ...
0
votes
1answer
376 views

Log likelihood for inverse gamma

For a gamma distribution, the answer to this question shows that you can just use the log of the gamma distribution density function. Is the same true for inverse gamma? It is the same as the log of ...
1
vote
1answer
287 views

Questions regarding interpretation of item parameters: inconsistent results between classical item analysis and item response analysis

I was not trained as a psychometrician, so my questions may be concept-related. If you know different resources, books, or articles that can clear my confusions, please let me know. Thank you very ...
1
vote
0answers
23 views

p-test for parameter

Statisticians, number magicians, I was wondering what the best way is to check for the equality of two parameters including possibly a confidence interval and p-value. $$H_0:\beta_1=\beta_2\vert\ \...
4
votes
1answer
806 views

Questions Regarding Item Response Models – the 3PL model vs. the mixture of 2PL and 3PL model

I currently work on an item analysis for an assessment. The assessment consists of 25 multiple-choice questions. Each question has 4 choices with one correct answer. I used different IRT models to ...
1
vote
1answer
546 views

Count Data Model, Poisson Distribution and Rounding?

In doing a count data model using a Poisson distribution, should the estimate (output) be rounded (or the ceiling) if your target variable is always a whole number in the input training target data ...
0
votes
1answer
44 views

OLS parameter estimation of an expression?

During my research for a class, I came across a paper that said they estimated an equation using OLS. But the parameter they were estimating appeared to be an expression that looked like this (not the ...
1
vote
0answers
151 views

Under what assumptions can parameter estimate uncertainty be estimated from the Hessian?

Given a model with some parameters, some data it's attempting to reproduce, and a distance function to quantify how well the predictions correspond to the data, I can fit parameters via a general ...
1
vote
1answer
168 views

Beta binomial mean different from actual mean

I have data that I am fitting a beta binomial distribution to. The VGAM package for R is being used to do this. However, the the mean of the fitting beta binomial distribution is vastly different from ...
5
votes
1answer
212 views

Parameters in a non-parametric model

I have not understood this Wikipedia statement: The difference between parametric model and non-parametric model is that the former has a fixed number of parameters, while the latter grows the ...
2
votes
2answers
607 views

Estimation of probability mass function using finite samples [closed]

Suppose $X_1, X_2, \dots, X_N$ are $N$ random samples of a discrete probability distribution such that $X_i \in \{1, 2, \dots, K\}$. The probability distribution $p$ used for sampling is ...
1
vote
1answer
2k views

Beta distribution vs beta binomial distribution: alpha and beta

I have been attempting to estimate alpha and beta from a beta binomial distribution given my data. There are R packages like VGAM to do this. I am wondering if there is a difference between estimating ...
1
vote
1answer
461 views

Prior for gamma distribution in “mean form”

I need to specify priors for the parameters of a gamma distribution. Normally the gamma distribution is parametrized in either the "rate-form'': $f\left(x;\alpha,\beta\right)=\frac{\beta^{\alpha}}{\...
1
vote
1answer
47 views

Is there a family of processes centred on the Poisson process?

I am looking for a model, characterized continuously by a single parameter, to describe the arrival times of buses with unit expected interarrival time. At one extreme of the parameter (say $\theta=1$)...
1
vote
0answers
122 views

What have I done wrong implementing this Bayesian method for fitting a circle to noisy data?

I have noisy measurements of movement along a circle. I want to fit a circle to these measurements. I tried two methods, a straight forward moment fit, and then an ODR fit (described here. However ...
7
votes
1answer
3k views

CV for model parameter tuning AND then model evaluation

I have a basic question on using cross-validation for model parameter tuning (model training) and model evaluation (testing) similar to this Model Tuning and Model Evaluation in Machine Learning I ...