Questions tagged [statistical-confidence]

The tag has no usage guidance.

Filter by
Sorted by
Tagged with
0 votes
1 answer
26 views

How many values should one validate to achieve a desired confidence?

If I have a set of 100 values which have been programmatically calculated and I would like to validate those calculations by performing them manually, how many manual calculations would I need to do ...
user avatar
  • 3
1 vote
0 answers
17 views

Confirming that the failure rate of a new component is less than or equal to the failure rate of the old component with 95% confidence

I have a new component that is meant to replace an old component that has a well-documented failure rate. Both components are buttons, and the failure rate corresponds to the mean number of button ...
user avatar
2 votes
1 answer
28 views

Why have predictions for neural network regression wider error margin for edge values?

I am doing a simple neural network regression and I notice my predictions always have high variation at the edges (values 0 and 1, in a normalized case). An image of the true value versus predicted is ...
user avatar
  • 21
0 votes
0 answers
9 views

Sum of Confidence Factors in expert systems

I have an expert system for a classification task that contains several rules with associated confidence factors (CF) ...
user avatar
  • 1,119
1 vote
0 answers
27 views

Compare two confidence intervals calculated from same sample

Problem: We have distance between user and a static device(in meters). We have lab tested data where user is actually standing away from device(actual values). Based on these we try to determine what ...
user avatar
0 votes
0 answers
51 views

statistical confidence level based on a sample size

I have 974 samples in front of me. I want to test these samples and ideally I should test all 974 samples. However, testing the sample will break the sample and I cannot afford to break all of them. ...
user avatar
0 votes
0 answers
41 views

What is the meaning of " Confidence interval of less than 1% of the average value"?

I want to find confidence intervals for my scenario and I see this sentence in many research papers related to my work. " Confidence interval of less than 1% of the average value"? What does ...
user avatar
0 votes
1 answer
55 views

Occurrence certainty

I think the best way to ask this question is with a hypothetical situation. Let's say I have a sensor that measures on average one occurrence every 3 days with a standard deviation of about 4. I want ...
user avatar
  • 41
0 votes
0 answers
19 views

Getting the confidence level of a model score given previous model accuracy

For practical reasons, I want to implement a standard confidence level which represents the probability that a particular instance is in a particular class given a model and the accuracy of that model ...
user avatar
  • 101
0 votes
0 answers
28 views

How to categorise data bumps/valleys into actual features or noise?

Here's some data$^1$ denoting the variation of the mean of samples (y-axis) with the no. of samples (x-axis). The uncertainties are $1\sigma$ standard deviation of those samples. Fig1. Graph of the ...
user avatar
  • 101
1 vote
0 answers
36 views

Measuring the confidence of a probability prediction from a binary classifier

I've trained a binary classifier for a language identification problem. The training data is $n$ sentences from language A and $n$ sentences from language B. Such that $n$ sentences are selected ...
user avatar
  • 217
0 votes
1 answer
22 views

How to treat proportions with different sample sizes as response variable in GLM / GLMM?

For an ecological research project, I am trying to model the effect of different factors on the prevalence of a specific pathogen in ticks. Ticks were collected from around 80 different plots and ...
user avatar
1 vote
0 answers
29 views

How to find confidence in output result given a histogram? [closed]

I have this algorithm that spits out a value between two objects. The smaller the value the more similar those objects are in euclidean space. I ran it on hundreds of examples that are true positives, ...
user avatar
5 votes
3 answers
130 views

What is the history of $p < 0.05$ or 95% confidence?

I'm wondering what the history of $p < 0.05$ or using a 95% confidence interval is. I know that more nuanced reasoning would argue that there is nothing special about 0.05 or 95% (I think decision ...
user avatar
  • 1,023
1 vote
0 answers
25 views

repeated measurements needed for certainty [closed]

A bit of a silly question. We have a model, which can be described as y = M(x) + some significant levels of noise. We see that if we repeat the measurements of y N times, we can see a clear ...
user avatar
2 votes
3 answers
78 views

Given a regression model, is there a way to evaluate confidence of a prediction?

What are methods for evaluating the predictive probability or something equivalent in a regression problem? In classification problems a predictive probability will be outputted given an input. For ...
user avatar
0 votes
0 answers
11 views

Algorithm to determine ability to distinguish phonemes in a foreign language

I am a language teacher and web developer. I took an advanced course in statistics in my last year of high school, but that is many many years ago. I am developing a web app to help learners of a ...
user avatar
0 votes
1 answer
34 views

Does the confidence level plus the significance level add to 1?

From reading it seems to me that the significance level is referred to as $\alpha$ and the confidence level is referred to as $1-\alpha$ However I haven't found statements defining each in terms of ...
user avatar
  • 461
2 votes
2 answers
33 views

How would you interpret this p-value in relation to page traffic due to page features?

I'm exploring some manual approaches to understand whether specific changes on a site can be deemed conclusive and statistically significant. I appreciate that any A/B testing platform has a reporting ...
user avatar
0 votes
1 answer
27 views

Sample size of a vote transfer poll

A vote transfer poll asks the electorate about how they voted in the last election and how they would vote if the next election was now. With the result from both questions one could build a matrix of ...
user avatar
0 votes
1 answer
501 views

How comparing two confidence intervals

Let's assume I have to point estimates with 95%-CI. The source can be from a simple computation of two samples or from a complex regression analysis. For example: odds ratio (1) 2.0 (95%-CI: 1.4-2.9) ...
user avatar
  • 879