A routine question from a textbook, course, or test used for a class or self-study. This community's policy is to "provide helpful hints" for self-study questions.

learn more… | top users | synonyms (1)

0
votes
0answers
16 views

Neural network and dynamical system

Dynamical systemsare those whose evolution can be described by a rule, evolves with time and is deterministic. In this context can I say that Neural networks have a rule of evolution which is the ...
0
votes
0answers
27 views

Joint posterior HPD region for the coefficients of the normal linear model

This problem appear in an exam put by Chris Sims (3b): http://sims.princeton.edu/yftp/emet04/ConfidenceCredibilityEx.pdf Suppose the following model: $y=\beta_1 +\beta_2 X_2+\beta_1 X_3 +\epsilon$ ...
4
votes
0answers
69 views

$E[e^{cX}]$ where $c < 0$ and $X$ is lognormally distributed

I am trying to calculate the expectation $$E[e^{cX}]$$ for arbitrary $c<0$ (for $c>0$ the expectation is infinite) if $X$ is lognormally distributed, i.e. $\log(X) \sim N(\mu, \sigma)$. My idea ...
0
votes
0answers
19 views

How to normalize time series?

This is a general question on normalization of data so that all the variables are within the same range. Why do we normalize data in pattern classification? How to normalize time series which is ...
1
vote
1answer
27 views

Implication of mutual information

EDIT For two signals or random variables to be independent, the mutual information (MI) must be zero. Let, $error = X -Y$ where X is the desired signal and Y is the measured signal. It is desired ...
0
votes
0answers
14 views

probability with permutation combination- 9 speakers in a conference on careers [on hold]

There is a conference on careers and 9 speakers from different professions will be there Determine the probability that the hockey player speaks the first and the astronaut the last. Determine the ...
0
votes
0answers
15 views

Confusion regarding concept of entropy and information [duplicate]

In general, entropy of a signal or image conveys the uncertainty and it is a measure of impurity. Information on the other hand tells us about how certain we are about the data. It is a measure of ...
0
votes
0answers
15 views

Out-of-time testing (basic question)

I understand the importance of out-of-sample testing, but could you tell me why I should (or shouldn't) do out-of-time testing ? The only use that comes to mind is if the predictive model applies to ...
2
votes
1answer
33 views

Conceptual question on mutual information and entropy

In respect to parameter estimation using information theoretic concepts, a signal X = S+N where S is the desired signal whose parameters we wish to estimate and N is the noise. The paper ...
3
votes
2answers
29 views

Negating conditional probability

I'm refreshing on bayes theorem and conditional probability and I ran across these practice problems. I was trucking along until problem 9, which states: ...
1
vote
1answer
26 views

Conceptual questions on Entropy and estimation

Learning Informative Statistics: A Nonparametric Approach paper presents an approach to parameter estimation by entropy minimization. There are other related works "Minimum-entropy estimation in ...
3
votes
2answers
55 views

If $X \sim$ unif$(0,1)$, what is the distribution of $U=\max \{X,1-X \}$?

Let $X$ be uniformly distributed in $(0,1)$ and set $U=\max \{X, 1-X\}$. How can I find the distributiopn of $U$? My first thought was to consider this a mixture distribution problem and use the CDF ...
1
vote
1answer
28 views

Differentiating Shannon's entropy [on hold]

Can somebody please show the steps of how differentiation of Shannon's entropy yields the following result? $H = -\sum_{l=0}^{L-1} p(l)\log_2[p(l)]$ The result of differentiating is $H_m = ...
1
vote
0answers
16 views

Two-tailed test [duplicate]

In one-tailed test , we give our decision at $\alpha$ level of significant. But in two-tailed test , why do we give our decision at $2\alpha$ level of significant? Why do we not give the decision of ...
4
votes
1answer
56 views

Verifying independence for two Random Variables

Could you please give me some hints for the exercise below? Suppose we toss a coin once and let $p$ be the probability of heads. Let $X$ denote the number of heads and let $Y$ denote the number of ...
0
votes
1answer
13 views

confidence interval for a answer [closed]

In a survey of 48 citizens, 36 registered strong disapproval with their government's economic leadership. In the previous month, the proportion of participants registering strong disapproval was 65%. 
...
-4
votes
0answers
20 views

inference Single sample [closed]

Can someone Answer this question. Thanks in advance. 6.17 the one with black circle. Right now i have no idea how to approach and solve it.Any help would be highly appreciated. Thanks.
0
votes
1answer
39 views

What are the null and alternate hypotheses? Will you use a left, right, or two-tailed test?

Ben has a coin which he claims is weighted in a way so that when he flips it, heads appears more often than 50% of the time. He tries to prove it to you by flipping the coin 100 times, which ...
1
vote
1answer
25 views

How to evaluate a statistical test for fairness of a coin?

I suspect that a given coin is not fair, i.e that the probability of heads is not $\frac{1}{2}$. My question is not how we can prove the unfairness, but if we derive a test to check the fairness, How ...
2
votes
0answers
55 views

In confusion with a Bayesian statistical problem

I was learning some probability basics. I am stuck with a problem, that I need your help with in solving. An $e$-fair coin is a coin with probability of head $(\theta)$ in interval ...
1
vote
0answers
68 views

Basic problem in Bayesian inference

I have questions with the following Bayesian inference problem I found in the book by Bertsekas & Tsitsiklis (Introduction to Probability 2nd ed.). Problem is as follows (P.445, Problem 2): ...
3
votes
1answer
63 views

sum and product rules of probability

I am reading Bishop's Pattern Recognition and Machine Learning. In page 73, chapter 2.1. I can't understand the formula 2.19 : $$p(x=1|\mathcal{D})=\int_0^1 p(x=1|\mu)p(\mu|\mathcal{D})\text{d}\mu ...
-1
votes
0answers
26 views

Hyperplane data points

Would a single data point in the hyperplane (see below) correspond to a single cell in the data matrix or an entire row?
2
votes
1answer
64 views

Optimal Allocation

A campus population of size N=9000 is to be surveyed by a stratified sample for the prevalence of a certain disease based upon three strata of respective sizes $N_h$ = 1000, 3000, and 5000 for h = 1, ...
1
vote
2answers
95 views

Hat matrix,$H=X(X^{\prime}X )^{-1}X^{\prime}$

What is the importance of hat matrix, $H=X(X^{\prime}X )^{-1}X^{\prime}$ in regression analysis? Is it only for easier calculation ?
0
votes
1answer
38 views

Getting all zero correlations,$\rho_{ij}=\frac{\mathbb cov(e_i,e_j)}{(V(e_i)V(e_j))^{1/2}}$

Consider the general regression model $$Y=X\beta+\epsilon$$ where, $Y$ is an $(n\times 1)$ vector of observations, $X$ is an $(n\times p)$ matrix of known form, $\beta$ is a $(p\times 1)$ vector ...
1
vote
1answer
28 views

Uncertainty consistency?

The problem statement, all variables and given/known data I am given a set of x and y values x: (1,2,3,etc.) y: (1.2,2.2,3.1,etc.) with a given uncertainty and am asked a) find the best fit b) ...
0
votes
1answer
45 views

How to do multivariate regression in R?

I need to preform a multivariate normal regression in R. The question is: Let $Y_1$, $Y_2$, and $Y_3$ follows multivariate normal distribution. What is the conditional of $Y_3$ given ...
2
votes
1answer
52 views

Most efficient way to check answers to exercises when learning from a statistics textbook?

There's a community wiki at: Free statistical textbooks that has a nice list of freely available textbooks on statistics. Many of the textbooks that people suggest have exercises at the end of each ...
0
votes
1answer
17 views

Caculate Type II error for Binomial distribution

Basically this is a question if I got the general idea behind the Type II Error right. I’ll set up a little reproducible example: Given $p_0=0.6$ with an $\alpha$-level of $\alpha=0.1$. As Binomial ...
0
votes
0answers
24 views

Exponential distribution qq plot homework question

For an exponential qq plot, we fix the theoretical distribution to have λ=1. In order to compare the plotted points with the line y=x, what kind of rescaling should be applied to the data and why? ...
1
vote
1answer
26 views

Confidence Interval and Signifcance test Question

I have done the first part of the question already I just need help on the second part. You read in a U.S Census Bureau that a 99% confidence interval for the mean income in 2005 of American ...
1
vote
0answers
17 views

Statistics:Power Question Update [duplicate]

I have already asked this question but I did not initially give out all the details on the question, like the question being a multiple choice question. You manufacture and sell a iron rod whose ...
1
vote
1answer
103 views

Statistics: Power question

I have already answered this question I just like some feedback on am I right or wrong? You manufacture and sell a iron rod whose electrical conductivity is supposed to be 10.1. You plan to make ...
0
votes
0answers
27 views

Determining which t-test is right?

I have already solved this question, but I need some feedback. A new method for measuring blood pressure in laboratory mice using radiotelemetry has been proposed. How does this compare with the ...
4
votes
2answers
90 views

Distribution function of maximum of n iid standard uniform random variables where n is poisson distributed

I am studying probability theory on my own and am trying to work the following problem in the book - Let $X_1, X_2, . . .$ be independent, $U(0, 1)$-distributed random variables, and let $Nm \in ...
2
votes
1answer
108 views

Question with MLE

I'm having some problems with this question, and was hoping someone here could help. Let $X_1,\ldots,X_2$ be $n$ determinations of a physical constant $\theta$. Consider the model $X_i = ...
1
vote
1answer
104 views

What does it mean “being normally distributed”

There is an exercise which is used to illustrate how normal distribution works. The exercise starts by saying "Suppose scores on an IQ test are normally distributed..."; What does it mean for the ...
7
votes
1answer
145 views

What is the two-sample CDF of of $D^{+}$ and $D^{-}$ from the one-sided Kolmogorov-Smirnov Test?

I am trying to understand how to obtain $p$-values for the one-sided Kolmogorov-Smirnov test, and am struggling to find CDFs for $D^{+}_{n_{1},n_{2}}$ and $D^{-}_{n_{1},n_{2}}$ in the two-sample case. ...
2
votes
1answer
93 views

Plain english explanation of the Rayleigh distribution?

I need to understand the Rayleigh distribution for a homework assignment in computer networks. Unfortunately, I lack the background knowledge in the field of statistics and probability theory to ...
3
votes
1answer
43 views

Number of distinct bootstrap samples

For $n$ distinct observations, there are ${2n - 1 \choose n-1}$ distinct bootstrap (re)samples. Could someone please provide a simple explanation? I found ...
0
votes
1answer
41 views

How to show linear model corresponds to exponential family

I am confronted with the exercise below. I have no given solution, so I hope someone can tell me whether my solution is right or wrong. I want to show the deterministic linear model $\quad ...
1
vote
1answer
137 views

What subject is more useful for statistics students [closed]

I am deciding which of the following two subjects to take as one elective in the coming term. Complex Analysis Theory of Partial Differential Equations Ideally I'd like to take both. However, I ...
1
vote
1answer
26 views

PDF of a sum using convolution

Let $X$ and $Y$ be independent, continuous random variables. The PDF of a sum $W=X+Y$ is given by the convolution formula $$ f_{X+Y} (w) = \int_{-\infty}^{\infty} f_X(x) f_Y(w-x)\,\,dx$$ In this ...
4
votes
1answer
85 views

Tricky question about MLE

$X_1, \ldots, X_n$ iid ~ Pois($\lambda$). Suppose, you don't know the value of each $X_i$, but you know if $X_i = 0$ or not for every i. Find MLE for $\lambda$. Does MLE always exist? I ...
1
vote
0answers
21 views

Unable to understand fuzzy logic example

I shall be grateful for an explanation of how to apply fuzzy logic based reasoning for the following example: I have 3 crisp sets of features = color, shape and texture. The objects are red ball, red ...
4
votes
1answer
46 views

Which of these points in this plot has the highest leverage and why?

I am studying the definition of leverage, and I understand it in terms of formulas. However, if I would have a plot like this for instance, how could I see which of these points has the highest ...
2
votes
0answers
25 views

Law of iterated expectations - an small exercise

From edX MIT probability course - Widgets and Crates: Let $X_i$ be the number of widgets in a particular box $i$. Let $N$ be the number of boxes in a crate. Assume $X$ and $N$ are independent, ...
0
votes
0answers
31 views

Maximum likelihood estimator for variance in two linear models

I am learning MLE's at my inference class and this is a problem I came accross. Consider two simple linear models. $y_{1j}=\alpha _1+\beta_{1}x_{1j}+\epsilon_{1j}$ and $y_{2j}=\alpha ...
2
votes
1answer
95 views

Asymptotically unbiased estimator using MLE

I am learning Maximum likelihood estimators for a inference class. And this is a problem I came across. Let $X_1,X_2,X_3,\ldots, X_n$ be a random sample with p.m.f $$p(X)=\theta(1-\theta)^x; ...