Convergence generally means that a sequence of a certain sample quantity approaches a constant as the sample size tends to infinity.

learn more… | top users | synonyms

0
votes
0answers
16 views

Is the assumption of linearity necessary for the convergence of the least squares method to the MSE solution

More formally, say there are input vectors $\bf x$ and scalar outputs $Y$ being generated i.i.d. from a joint distribution $p$ and we are interested in estimating $\mu({\bf x}) = {\mathbb ...
0
votes
0answers
19 views

Convergence warnings in glmer

I am running a Generalized Linear Mixed Model in R 3.0.2 using lme4 1.1-7 for a dichotomous outcome variable (success, 0 = no, 1 = yes) ...
0
votes
0answers
15 views

Convergence of Random Variables meaning

What is the intuitive explanation of convergence of random variables? what is meant by saying that a sequence of random variables CONVERGE?
1
vote
0answers
22 views

Asymptotic consistency with non-zero asymptotic variance -what does it represent?

The issue has come up before, but I want to ask a specific question that will attempt to elicit an answer that will clarify (and classify) it: In Poor Man's Asymptotics, one keeps a clear distinction ...
2
votes
1answer
49 views

Almost sure convergence and limiting variance goes to zero

Say an estimator converges with probability one and at the same time its variance goes to zero in the limit. How is it different than an estimator that converges with probability one but its variance ...
0
votes
0answers
22 views

Convergence of an estimator with infinite variance

Is it true that an estimator with infinite variance can converge both in probability and with probability one?
0
votes
0answers
13 views

Why does Co-ordinate descent work? [closed]

If it works does it mean that "function is convex if it's convex in any direction"?
0
votes
1answer
66 views

Convergence of Random Sequence

I have a two statements. One says: $$-\frac{1}{T} \sum_{t=1}^T X_t \rightarrow a $$ in probability as $T \rightarrow \infty$. The other: $$-\frac{1}{g(T)} \sum_{t=1}^{g(T)} X_t \rightarrow a $$ in ...
2
votes
1answer
56 views

Understanding $O_p$

One thing I feel like I have never mastered is the concept of $O_p$ convergence and how to use it. I understand the basic idea and what bounded in probability means, but I always have a hard time ...
1
vote
0answers
29 views

Certainty estimate for prediction of largest of several converging variables

Problem I want to have an estimate for the certainty which of several (3-4) variables is the variable with the largest value, given some sample values which should eventually converge to different ...
1
vote
0answers
29 views

Can a perceptron be modified so as to converge with non-linearly separable data?

Normally, a perceptron will converge provided data are linearly separable. Now if we select a small number of examples at random and flip their labels to make the dataset non-separable. How can we ...
1
vote
1answer
17 views

Weight Decay in Neural Neural Networks Weight Update and Convergence

I have a neural network (That I created using java) for a class assignment that is working when I do not use any weight decay value, but when I use a value greater than or equal to .001, my accuracy ...
4
votes
1answer
56 views

Glivenko-Cantelli Theorem

The Glivenko-Cantelli Theorem (http://en.wikipedia.org/wiki/Glivenko%E2%80%93Cantelli_theorem) states that if $F$ is a distribution function, $X_1,\dots,X_n \sim F$, and $\hat{F}_n$ is the empirical ...
1
vote
1answer
85 views

Maximum convergence rate of empirical probability

Given a sequence of events $$(a_1, a_2, \dots, a_n),$$ then the sequence of empirical probabilities of some event $\alpha$ is $$\left(p_1 = \frac{\sum_{i = 1}^1 [a_i = \alpha]}{1}, p_2 = ...
0
votes
0answers
12 views

Value Iteration exact convergence

I'm running Gauss Seidel value iteration on a weapon-target assignment problem (I can explain this more later if necessary, but i don't think it is). My VI is converging exactly in 2 iterations. I'm ...
0
votes
0answers
44 views

Multiple imputation to part of a dataset

I am working with a survey dataset which contains hundreds of variables. The item-missing data rate ranges from 0.2% to 10%. In order to retain study units with missing values and to maintain a ...
2
votes
1answer
37 views

How to measure if a mean is stable

Background I am a physics major, however I am currently interning at a psychiatry/neuro-imaging laboratory. The primary area of research in my lab is diffusion tensor imaging (DTI). A lot of the ...
0
votes
0answers
15 views

How to intuitively understand the relationship between difference convergences?

Given a series of random variables $X_1, X_2, \cdots, X_n, \cdots$ convergence in quadratic mean ⟹ convergence in probability ⟹ convergence in probability distribution How to intuitively understand ...
0
votes
1answer
49 views

Consistency of unbiased estimator of error term variance in Multiple regression

Let $Y=X\beta+\epsilon$. We know that $\frac{e'e}{n-k}$ is an unbiased estimator of $Var(\epsilon)$, where $e$ is the vector of residuals, and $\epsilon$ is multivariate normal distributed in this ...
2
votes
1answer
49 views

Convergence Issues for Bootstrap Distributions

the following is part of a proof from van der Vaarts book on asymptotic statistics: I want to show that if for a continuous distribution function F ...
3
votes
1answer
92 views

Use only the last sample as the posterior in MCMC

I am new to statistics. After an MCMC sampler warmed up, the posterior is better estimated as the mean of several samples. (e.g. related question: http://stats.stackexchange.com//questions/56077) ...
1
vote
1answer
28 views

Convergence of Gini index

Let $\theta(F)=2\int^1_0(t-q_F(t))dt$, where $\displaystyle q_F(t)=\frac{\int_0^tF^{-1}(s)ds}{\int_0^1F^{-1}(s)ds}$. For discrete distributions I'm assuming that $F^{-1}(s)=\inf\{x:F(x)=s\}$ (the ...
3
votes
2answers
27 views

X vs x Notation in law of large numbers

This may be a silly question, but I can't find a concise answer. I've been studying Convergence of Random Variables in Wasserman's All of Statistics, which starts out by explaining: $X_n$ is a ...
5
votes
2answers
78 views

Convergence in distribution of sum implies marginal convergence?

Let $X_n, X, Y$ be random variables such that $X_n + cY \stackrel{d}{\rightarrow} X + cY $ for every positive constant $c$. Prove that $X_n \stackrel{d}{\rightarrow} X$. I know if only we have joint ...
4
votes
2answers
251 views

Distribution function of maximum of n iid standard uniform random variables where n is poisson distributed

I am studying probability theory on my own and am trying to work the following problem in the book - Let $X_1, X_2, . . .$ be independent, $U(0, 1)$-distributed random variables, and let $Nm \in ...
0
votes
0answers
15 views

Let $f(x)$ be the density of $X$. What is $\lim_{n\rightarrow \infty}\mathrm{E}_X[nf(X+n)]$?

The expectation can be written as $\mathrm{E}_X[nf(X+n)] = \int_{-\infty}^\infty nf(x+n)f(x)\,\mathrm{d}x$. The expectation relies on the speed of tail $f(x+n)$ goes to $0$. I posted a related ...
5
votes
1answer
45 views

Reference request: local limit theorem for log-concave densities

The following is easy to prove and can't possibly be new. But I can't find it printed anywhere despite some effort. Can anyone tell me where it is published? Let $X_1,X_2,\ldots$ be a sequence of ...
6
votes
1answer
210 views

Extreme Value Theory - Show: Normal to Gumbel

The Maximum of $X_1,\dots,X_n. \sim$ i.i.d. Standardnormals converges to the Standard Gumbel Distribution according to Extreme Value Theory. How can we show that? We have $$P(\max X_i \leq x) = ...
1
vote
0answers
59 views

What to Do When a Log-binomial Model's Convergence Fails

There are times when one might want to estimate a prevalence ratio or relative risk, in preference to an odds ratio, for data with binary outcomes - say, if the outcome in question isn't rare, so the ...
5
votes
1answer
80 views

Simulating Convergence in Probability to a constant

Asymptotic results cannot be proven by computer simulation, because they are statements involving the concept of infinity. But we should be able to obtain a sense that things do indeed march the way ...
1
vote
0answers
39 views

Logistic Regression doesn't converge if I use a particular baseline

Apologies if the question is too broad, then please close the thread. Or maybe this belongs in StackOverflow? I observed something strange and wonder if someone more educated can shed some light on ...
0
votes
0answers
87 views

Coefficients from a Dynamic Panel Data Model of Economic Growth

I am having difficulties with the interpretation of the regression results from estimating a growth regression in a dynamic panel data set-up, estimated using Stata. (I'm using difference GMM and ...
2
votes
0answers
23 views

Convergence of a sequence of random variables [duplicate]

Suppose $P(X=1)=P(X=-1)=1/2$ and define $$X_n=\begin{cases} X\ \text{with probability}\ 1-\frac{1}{n} \\ e^n\ \text{with probability}\ \frac{1}{n} \end{cases}$$ I then need to prove or disprove ...
3
votes
2answers
125 views

Limiting distribution of the first order statistic of a general distribution

Let $Z_i,Z_2,\ldots$ be IID Random Variables with density $f$. Suppose that $P(Z_i>0)=1$ and that $\lambda=\lim_{x \to 0+} f(x)>0$. How can I show that $X_n=n \times \min\{Z_i\}$ has a limiting ...
3
votes
1answer
46 views

How to report results from analyses that did not converge

I am an analyst on a paper and, in writing up methods and results, noted that one of the proposed (logistic regression) models did not converge due to separation. I noted this in the results section ...
4
votes
2answers
91 views

Convergence in probability, $X_i$ IID with finite second moment

Let $\{X_i\}_{i\geq 1}$ be IID with finite second moment, and $$ Y_n = \frac{2}{n(n+1)}\sum_{i=1}^n \,i\cdot X_i \, , \qquad n\geq 1 \, . $$ Could you please tell me how can I show that $Y_n$ ...
1
vote
0answers
20 views

Uniform convergence of Monte Carlo approximation

Usually Monte Carlo method is used to compute integration. For example, let $g(x,\theta)$ be a continuous function about $x$ and $\theta$, $f(x \mid \theta)$ is a continuous pdf with parameter ...
2
votes
0answers
31 views

Difference between sample and sequence in Law of Large Numbers

I'm comparing the Chebychev (Weak) Law of Large Numbers (LLN) to the Kolmogorov (Strong) LLN in an econometric textbook and both definitions start off differently. The Chebychev LLN begins with If ...
0
votes
0answers
30 views

Checking convergence in MCMC with single chain

I have reed the Gelman-Rubin method for check the convergence in MCMC on $m\geq 2$ chain, but when I work with only one chain, what can i do to check the convergence? There is some method that work ...
1
vote
1answer
264 views

Gelman and Rubin convergence diagnostic, how to generalise to work with vectors?

The Gelman and Rubin diagnostic is used to check the convergence of multiple mcmc chains run in parallel. It compares the within-chain variance to the between-chain variance, the exposition is below: ...
7
votes
1answer
123 views

Is there a theorem that says that $\sqrt{n}\frac{\bar{X} - \mu}{S}$ converges in distribution to a normal as $n$ goes to infinity?

Let $X$ be any distribution with defined mean, $\mu$, and standard deviation, $\sigma$. The central limit theorem says that $$ \sqrt{n}\frac{\bar{X} - \mu}{\sigma} $$ converges in distribution to a ...
0
votes
0answers
97 views

Building an ARMA or GARCH estimation battery for models of increasing order (rugarch in r)

A loop should be build to fit ARMA and/or GARCH models of increasing order, say GARCH(0,1), GARCH(1,0), GARCH(1,1), GARCH(0,2) etc. The language is r, and I'm using the ...
2
votes
2answers
70 views

Convergence in distribution results not deriving from central limit theorem?

In the stats class I took, all the results I have encountered about the convergence in distribution of some random variables are in one way or another consequences of the Central Limit Theorem. Out ...
0
votes
0answers
37 views

MIMIC fail to converge

I am trying to fit a MIMIC model measuring poverty in a household sample. The model looks like this: (HUMCAP -> education job) (HOUSINGQUAL -> floor wall dwelling tv refrigerator radio electricity ...
3
votes
0answers
20 views

Convergence of multivariate ECDF

Gilvenko-Cantelli assures uniform a.s. convergence of univariate ECDF. My questions are: Are there similar assurances for multivariate ECDF? How is the rate of convergence dependent on the ...
2
votes
0answers
29 views

Convergence Rate for Multivariate Kernel Density Estimators

I know that univariate kernel density functions converge uniformly a.s. to the true distribution. Is this also true for multivariate kdf? Is there a theorem that gives the rate of convergence in the ...
0
votes
0answers
36 views

Convergence of Estimation

The issue is, we can have a bunch of regression models to do prediction for the test set. For a specific testing data, some perform good and some do bad. How can I use existing method or design a ...
0
votes
1answer
63 views

On the stopping criterion of coordinate descent method for linear SVM with $\ell_1$-regularization

I am trying to implement the coordinate descent method to solve the dual of linear SVM problem, but blocked at the stopping criterion. The dual of linear SVM problem is: $$\min f(\mathbf{x}) = ...
2
votes
0answers
22 views

Weak convergence implies uniform convergence in distribution?

Consider an empirical processes $\{v_T(\theta), T\geq 1 \}$ and assume it is weakly convergent to the stochastic process $\{ v(\theta); \theta \in \Theta\}$., i.e. $$ E^*(f(v_T(\theta)))\rightarrow ...
0
votes
0answers
35 views

Convergence of a matrix product

Let $A=o_{a.s.}(1)$; $A:k\times k$ matrix and $Vu=O_p(1)$; $V:k\times k$; $u: k\times 1$. Specifically, $Vu$ converges in distribution to $\mathcal N(0,I_k)$. Can we show that $VAu=o_p(1)$ or ...