Questions tagged [statistical-confidence]
The statistical-confidence tag has no usage guidance.
21
questions
0
votes
1
answer
26
views
How many values should one validate to achieve a desired confidence?
If I have a set of 100 values which have been programmatically calculated and I would like to validate those calculations by performing them manually, how many manual calculations would I need to do ...
- 3
1
vote
0
answers
17
views
Confirming that the failure rate of a new component is less than or equal to the failure rate of the old component with 95% confidence
I have a new component that is meant to replace an old component that has a well-documented failure rate. Both components are buttons, and the failure rate corresponds to the mean number of button ...
- 11
2
votes
1
answer
28
views
Why have predictions for neural network regression wider error margin for edge values?
I am doing a simple neural network regression and I notice my predictions always have high variation at the edges (values 0 and 1, in a normalized case). An image of the true value versus predicted is ...
- 21
0
votes
0
answers
9
views
Sum of Confidence Factors in expert systems
I have an expert system for a classification task that contains several rules with associated confidence factors (CF)
...
- 1,119
1
vote
0
answers
27
views
Compare two confidence intervals calculated from same sample
Problem: We have distance between user and a static device(in meters). We have lab tested data where user is actually standing away from device(actual values). Based on these we try to determine what ...
- 11
0
votes
0
answers
51
views
statistical confidence level based on a sample size
I have 974 samples in front of me. I want to test these samples and ideally I should test all 974 samples. However, testing the sample will break the sample and I cannot afford to break all of them. ...
- 1
0
votes
0
answers
41
views
What is the meaning of " Confidence interval of less than 1% of the average value"?
I want to find confidence intervals for my scenario and I see this sentence in many research papers related to my work. " Confidence interval of less than 1% of the average value"? What does ...
0
votes
1
answer
55
views
Occurrence certainty
I think the best way to ask this question is with a hypothetical situation. Let's say I have a sensor that measures on average one occurrence every 3 days with a standard deviation of about 4. I want ...
- 41
0
votes
0
answers
19
views
Getting the confidence level of a model score given previous model accuracy
For practical reasons, I want to implement a standard confidence level which represents the probability that a particular instance is in a particular class given a model and the accuracy of that model ...
- 101
0
votes
0
answers
28
views
How to categorise data bumps/valleys into actual features or noise?
Here's some data$^1$ denoting the variation of the mean of samples (y-axis) with the no. of samples (x-axis). The uncertainties are $1\sigma$ standard deviation of those samples.
Fig1. Graph of the ...
- 101
1
vote
0
answers
36
views
Measuring the confidence of a probability prediction from a binary classifier
I've trained a binary classifier for a language identification problem. The training data is $n$ sentences from language A and $n$ sentences from language B. Such that $n$ sentences are selected ...
- 217
0
votes
1
answer
22
views
How to treat proportions with different sample sizes as response variable in GLM / GLMM?
For an ecological research project, I am trying to model the effect of different factors on the prevalence of a specific pathogen in ticks.
Ticks were collected from around 80 different plots and ...
1
vote
0
answers
29
views
How to find confidence in output result given a histogram? [closed]
I have this algorithm that spits out a value between two objects. The smaller the value the more similar those objects are in euclidean space.
I ran it on hundreds of examples that are true positives, ...
- 11
5
votes
3
answers
130
views
What is the history of $p < 0.05$ or 95% confidence?
I'm wondering what the history of $p < 0.05$ or using a 95% confidence interval is. I know that more nuanced reasoning would argue that there is nothing special about 0.05 or 95% (I think decision ...
- 1,023
1
vote
0
answers
25
views
repeated measurements needed for certainty [closed]
A bit of a silly question.
We have a model, which can be described as y = M(x) + some significant levels of noise.
We see that if we repeat the measurements of y N times, we can see a clear ...
- 207
2
votes
3
answers
78
views
Given a regression model, is there a way to evaluate confidence of a prediction?
What are methods for evaluating the predictive probability or something equivalent in a regression problem? In classification problems a predictive probability will be outputted given an input. For ...
- 640
0
votes
0
answers
11
views
Algorithm to determine ability to distinguish phonemes in a foreign language
I am a language teacher and web developer. I took an advanced course in statistics in my last year of high school, but that is many many years ago.
I am developing a web app to help learners of a ...
- 101
0
votes
1
answer
34
views
Does the confidence level plus the significance level add to 1?
From reading it seems to me that the significance level is referred to as $\alpha$ and the confidence level is referred to as $1-\alpha$
However I haven't found statements defining each in terms of ...
- 461
2
votes
2
answers
33
views
How would you interpret this p-value in relation to page traffic due to page features?
I'm exploring some manual approaches to understand whether specific changes on a site can be deemed conclusive and statistically significant.
I appreciate that any A/B testing platform has a reporting ...
- 173
0
votes
1
answer
27
views
Sample size of a vote transfer poll
A vote transfer poll asks the electorate about how they voted in the last election and how they would vote if the next election was now. With the result from both questions one could build a matrix of ...
- 196
0
votes
1
answer
501
views
How comparing two confidence intervals
Let's assume I have to point estimates with 95%-CI. The source can be from a simple computation of two samples or from a complex regression analysis. For example: odds ratio
(1) 2.0 (95%-CI: 1.4-2.9)
...
- 879