# Questions tagged [robust]

Robustness in general refers to a statistic's insensitivity to deviations from its underlying assumptions (Huber and Ronchetti, 2009).

503 questions
Filter by
Sorted by
Tagged with
15 views

### Robust statistics to determine the linear relation of a random varialbe to a group of other random variables

https://solvemprobler.com/blog/2015/12/19/calculating-stocks-beta-using-r/ Beta for a security is defined above. Where it is basically the slope of the linear regression of the daily return of the ...
20 views

### Choice of constants in a robust z score

I'm trying to calculate a robust z score, and I'd like to understand the constants I'm using, and their impact on my statistic. One corner case I've noticed is when my sample happens to be all the ...
27 views

### how to test variance of sample mean for very skewed distribution?

The underlying distribution is not known explicitly but rather inferred from a sample of around 10 million cases. It represents the cost of something and after normalizing the mean to 1 it has the ...
158 views

Suppose we have $n$ paired observations $(x_1,y_1),(x_2,y_2),\ldots,(x_n,y_n)$, where $y$ is the response variable and $x$ is the covariate. Consider a simple linear regression model $$y_i=\alpha+\... 1answer 34 views ### Robust linear regression for complex valued data in R Are there any existing R packages capable of performing a robust linear regression on complex valued data? I have a set Y of complex valued (a + b i) data, that are linearly dependent on another ... 0answers 34 views ### Which modern robust methods should be used (under what circumstances/as a standard)? [closed] I started reading about modern robust methods as an alternative to classic parametric techniques because I keep encountering issues with normality and, at times, violations of other classic parametric ... 1answer 41 views ### What is the medoid function and its relation to the median? The medoid function is defined in this graph neural network paper as:$$ t := \arg\min_{y\in \mathcal{X}}\sum_{j=1}^N||x_j-y||$$which is a "multivariate generalization of the Median" and \... 0answers 17 views ### Suitable definition of breakdown point for estimators of bounded statistics (i.e constrained estimation) Let \Theta be a nonempty compact subset of \mathbb R^d. For example, the reader may think of the closed unit-ball \Theta := \{\theta \in \mathbb R^d \mid \|\theta\|_2 \le 1\}. Consider an ... 0answers 26 views ### PCA vs Robust PCA Apart from that robust PCA ignores the outliers, how can you say it differs or is advantageous to standard PCA? 2answers 54 views ### Interpreting mixed effects model results. Why are my coefficients for mixed effects model are so large? I am an economics grad student and I am in the process of writing a paper disproving using the Gini coefficient as a solitary measure of income inequality in migration determinants analysis. I have ... 0answers 31 views ### I have a question regarding the robustness of the T test for two for independent samples I have a large sample, 200 participants in each group, and normality is violated (the shapiro-wilk test showed that all data were non- normally distributed p<0.05) but i assume that can still ... 0answers 18 views ### Statistical Method for Large Data Sets: Obtain Means via Clustering I seek a sanity check on a technique I developed to characterize reasonably large data sets with a single statistic each. The data are pause duration measurements taken during 20-minute open field ... 0answers 10 views ### Robust wave variograms I am reading a research paper Eyer 1999 in which they characterize variable stars using Robust wave variograms so what is mean by Robust wave variogram and how can we analyze time series of any data (... 0answers 42 views ### What are some online algorithms for robust measures of scale? I've found good robust measures of scale, and I've found one or two good online algorithms for robust measures of location, but I haven't been able to find an online algorithm for a robust measure of ... 1answer 63 views ### Robustness check for cross-sectional data by merging data sets and creating year dummy variable I am currently working on the effects of maternal education on child mortality with cross-sectional data. I got data sets for 2008, 2010 and 2014. I am thinking of doing a robustness checks and I ... 1answer 28 views ### Convex set of huber's contamination model In the celebrated Huber's robust estimation paper, he considered the following model x_i \sim (1-\epsilon) P_\theta + \epsilon G where P_\theta is assume to be standard normal. Under this model, ... 0answers 126 views ### convert R2 score from sklearn (variance score) to the R squared coefficient? I am trying to run RANSAC robust fit method on my data and predict correlation between my X and Y data. I have decided to use this method because in my small dataset I have identified one outlier. I ... 0answers 11 views ### Robustness of the Brown–Forsythe test against a change of skewness or other moments Consider the case of two random variables obeying log-normal distributions. Suppose that the \mu parameters are equal but the \sigma parameters aren't. This would imply that not only the variances-... 1answer 29 views ### Which Robust fit method to apply to exclude single outliers? I got some data samples (a,b) and I am trying to calculate correlation between a and b. As I am new in this type of analysis, I have calculated Rsquared with linear regression method and got 0.5 as ... 0answers 23 views ### Improving robustness of XGBoost on large tabular dataset with small signal and lots of noise I have been working with XGBoost on a large set of panel data. There are 20m+ rows with 200 features. The data includes weather related data points for 100s of cities, recorded every day, for several ... 1answer 458 views ### Are Bayesian methods robust to violations of normality? Consider the simple case$$x|\sigma^2 \sim N(0,\sigma^2)\sigma^2\sim IG(\alpha,\beta) Then, marginally, $f(x) \propto (\beta + x^2/2)^{-\alpha}$, is a t-distribution. Does this mean that the ...
16 views

One measure of an estimator's robustness is the breakdown point, which tells us how many adversarial observations are necessary to make the estimator useless. However, is there a notion of non-...
31 views

### Comparing ß-coefficients in robust linear regression between groups - different p-values between f.robftest() and lmrob() - what is the difference?

I want to evaluate if a variable predicts the change of another variable following an intervention. Therefore, I compare the linear regression lines between the intervention and control group. I tried ...
31 views

### Estimators of location and scale versus mean and variance

This question is rather semantic than statistical. In Robust Statistics, estimators of mean and variance of a distribution are often called respectively "estimators of location" and "...
60 views

### Are robustness and generalizability the same thing?

An optimal parameter $\theta^*$ is robust if it does not change much when calculated for different samples of data from a population. $\theta^*$ has good generalizability if its predictive power ...
18 views

### Robustness of latent variable models

Influence functions are a tool to study robustness. They tell us the effect of perturbing one datapoint on the trained parameters. E.g. by taking $x_i \mapsto (1+\epsilon)x_i$. How can this be used on ...
28 views

### Robustness of ELBO

The ELBO $\mathcal{L}(\phi)$ is used to quantify how good an approximate posterior $q_\phi(z|x)$ is for a dataset $x$ and an (unknown) true posterior $p_\theta(z|x)$. However this is all under the ...
68 views

### Robustness of MAP estimate

In Bayesian inference, we have a dataset $x$ and assumed to come from a known parameterized distribution with unknown parameters $\theta$. We then seek to maximize the posterior $P(\theta|x)$ in order ...
282 views

### Is there an R function for a robust three-way mixed ANOVA?

I'm a PhD student in the social sciences and I have run into some issues analyzing my dissertation data - namely, non-normality, and to a lesser degree, heterogeneity of variance. Specifically, I am ...
10 views

### Which assumptions and constraints are relevant in a mixture model to use either a Gaussian, Weibull, Gumbel or other distribution?

For a dataset that I'm analyzing, I can obtain a series of distributions on a given feature space, and I can assume that they take the form of collections of uni-modal clusters (think of something ...
50 views

### Sampling distribution of loss function

So I believe the sampling distribution of the likelihood function is a basic idea in frequentist statistics. For example, the Fisher information $\text{Var}_x(\nabla_\theta \log P(x|\theta))$ which ...
29 views

### Are there formal measures for classifier or regression robustness?

Are there performance measures that produce a numerical value of the robustness of a classifier or regression. By robustness I mean graceful degradation in performance to unexpected input (similar to ...
53 views

### Robust regression for heavy-tailed random design

As far as I know, there are robust regression methods for outliers in response $Y$ and heavy-tailed error $\epsilon$. The settings for the design matrix (predictor) $X$ is either fixed design or sub-...
42 views

### Winsorized mean - trimming furthest points instead of both endpoints

I'm wondering if the Winsorized mean can be improved by trimming the 5% farthest points from the mean instead of trimming 5% on each endpoint. Concretely: Consider the Winsorized mean, where we ...
40 views