Questions tagged [statistical-confidence]

The tag has no usage guidance.

21 questions
Filter by
Sorted by
Tagged with
26 views

How many values should one validate to achieve a desired confidence?

If I have a set of 100 values which have been programmatically calculated and I would like to validate those calculations by performing them manually, how many manual calculations would I need to do ...
1 vote
17 views

Confirming that the failure rate of a new component is less than or equal to the failure rate of the old component with 95% confidence

I have a new component that is meant to replace an old component that has a well-documented failure rate. Both components are buttons, and the failure rate corresponds to the mean number of button ...
28 views

Why have predictions for neural network regression wider error margin for edge values?

I am doing a simple neural network regression and I notice my predictions always have high variation at the edges (values 0 and 1, in a normalized case). An image of the true value versus predicted is ...
• 21
9 views

Sum of Confidence Factors in expert systems

I have an expert system for a classification task that contains several rules with associated confidence factors (CF) ...
• 1,119
1 vote
27 views

Compare two confidence intervals calculated from same sample

Problem: We have distance between user and a static device(in meters). We have lab tested data where user is actually standing away from device(actual values). Based on these we try to determine what ...
51 views

statistical confidence level based on a sample size

I have 974 samples in front of me. I want to test these samples and ideally I should test all 974 samples. However, testing the sample will break the sample and I cannot afford to break all of them. ...
41 views

What is the meaning of " Confidence interval of less than 1% of the average value"?

I want to find confidence intervals for my scenario and I see this sentence in many research papers related to my work. " Confidence interval of less than 1% of the average value"? What does ...
55 views

Occurrence certainty

I think the best way to ask this question is with a hypothetical situation. Let's say I have a sensor that measures on average one occurrence every 3 days with a standard deviation of about 4. I want ...
• 41
19 views

Getting the confidence level of a model score given previous model accuracy

For practical reasons, I want to implement a standard confidence level which represents the probability that a particular instance is in a particular class given a model and the accuracy of that model ...
• 101
28 views

How to categorise data bumps/valleys into actual features or noise?

Here's some data$^1$ denoting the variation of the mean of samples (y-axis) with the no. of samples (x-axis). The uncertainties are $1\sigma$ standard deviation of those samples. Fig1. Graph of the ...
• 101
1 vote
36 views

Measuring the confidence of a probability prediction from a binary classifier

I've trained a binary classifier for a language identification problem. The training data is $n$ sentences from language A and $n$ sentences from language B. Such that $n$ sentences are selected ...
• 217
22 views

How to treat proportions with different sample sizes as response variable in GLM / GLMM?

For an ecological research project, I am trying to model the effect of different factors on the prevalence of a specific pathogen in ticks. Ticks were collected from around 80 different plots and ...
1 vote
29 views

How to find confidence in output result given a histogram? [closed]

I have this algorithm that spits out a value between two objects. The smaller the value the more similar those objects are in euclidean space. I ran it on hundreds of examples that are true positives, ...
130 views

What is the history of $p < 0.05$ or 95% confidence?

I'm wondering what the history of $p < 0.05$ or using a 95% confidence interval is. I know that more nuanced reasoning would argue that there is nothing special about 0.05 or 95% (I think decision ...
• 1,023
1 vote
25 views

repeated measurements needed for certainty [closed]

A bit of a silly question. We have a model, which can be described as y = M(x) + some significant levels of noise. We see that if we repeat the measurements of y N times, we can see a clear ...
• 207
78 views

Given a regression model, is there a way to evaluate confidence of a prediction?

What are methods for evaluating the predictive probability or something equivalent in a regression problem? In classification problems a predictive probability will be outputted given an input. For ...
• 640
11 views

Algorithm to determine ability to distinguish phonemes in a foreign language

I am a language teacher and web developer. I took an advanced course in statistics in my last year of high school, but that is many many years ago. I am developing a web app to help learners of a ...
• 101
34 views

Does the confidence level plus the significance level add to 1?

From reading it seems to me that the significance level is referred to as $\alpha$ and the confidence level is referred to as $1-\alpha$ However I haven't found statements defining each in terms of ...
• 461
33 views

How would you interpret this p-value in relation to page traffic due to page features?

I'm exploring some manual approaches to understand whether specific changes on a site can be deemed conclusive and statistically significant. I appreciate that any A/B testing platform has a reporting ...
• 173