# Questions tagged [statistical-confidence]

The tag has no usage guidance.

21 questions
Filter by
Sorted by
Tagged with
26 views

### How many values should one validate to achieve a desired confidence?

If I have a set of 100 values which have been programmatically calculated and I would like to validate those calculations by performing them manually, how many manual calculations would I need to do ...
1 vote
17 views

### Confirming that the failure rate of a new component is less than or equal to the failure rate of the old component with 95% confidence

I have a new component that is meant to replace an old component that has a well-documented failure rate. Both components are buttons, and the failure rate corresponds to the mean number of button ...
28 views

### Why have predictions for neural network regression wider error margin for edge values?

I am doing a simple neural network regression and I notice my predictions always have high variation at the edges (values 0 and 1, in a normalized case). An image of the true value versus predicted is ...
9 views

### Sum of Confidence Factors in expert systems

I have an expert system for a classification task that contains several rules with associated confidence factors (CF) ...
1 vote
27 views

### Compare two confidence intervals calculated from same sample

Problem: We have distance between user and a static device(in meters). We have lab tested data where user is actually standing away from device(actual values). Based on these we try to determine what ...
51 views

### statistical confidence level based on a sample size

I have 974 samples in front of me. I want to test these samples and ideally I should test all 974 samples. However, testing the sample will break the sample and I cannot afford to break all of them. ...
41 views

### What is the meaning of " Confidence interval of less than 1% of the average value"?

I want to find confidence intervals for my scenario and I see this sentence in many research papers related to my work. " Confidence interval of less than 1% of the average value"? What does ...
55 views

### Occurrence certainty

I think the best way to ask this question is with a hypothetical situation. Let's say I have a sensor that measures on average one occurrence every 3 days with a standard deviation of about 4. I want ...
19 views

### Getting the confidence level of a model score given previous model accuracy

For practical reasons, I want to implement a standard confidence level which represents the probability that a particular instance is in a particular class given a model and the accuracy of that model ...
28 views

### How to categorise data bumps/valleys into actual features or noise?

Here's some data$^1$ denoting the variation of the mean of samples (y-axis) with the no. of samples (x-axis). The uncertainties are $1\sigma$ standard deviation of those samples. Fig1. Graph of the ...
1 vote
36 views

### Measuring the confidence of a probability prediction from a binary classifier

I've trained a binary classifier for a language identification problem. The training data is $n$ sentences from language A and $n$ sentences from language B. Such that $n$ sentences are selected ...
22 views

### How to treat proportions with different sample sizes as response variable in GLM / GLMM?

For an ecological research project, I am trying to model the effect of different factors on the prevalence of a specific pathogen in ticks. Ticks were collected from around 80 different plots and ...
1 vote
29 views

### How to find confidence in output result given a histogram? [closed]

I have this algorithm that spits out a value between two objects. The smaller the value the more similar those objects are in euclidean space. I ran it on hundreds of examples that are true positives, ...
130 views

### What is the history of $p < 0.05$ or 95% confidence?

I'm wondering what the history of $p < 0.05$ or using a 95% confidence interval is. I know that more nuanced reasoning would argue that there is nothing special about 0.05 or 95% (I think decision ...
1 vote
25 views

### repeated measurements needed for certainty [closed]

A bit of a silly question. We have a model, which can be described as y = M(x) + some significant levels of noise. We see that if we repeat the measurements of y N times, we can see a clear ...
78 views

### Given a regression model, is there a way to evaluate confidence of a prediction?

What are methods for evaluating the predictive probability or something equivalent in a regression problem? In classification problems a predictive probability will be outputted given an input. For ...
11 views

### Algorithm to determine ability to distinguish phonemes in a foreign language

I am a language teacher and web developer. I took an advanced course in statistics in my last year of high school, but that is many many years ago. I am developing a web app to help learners of a ...
34 views

### Does the confidence level plus the significance level add to 1?

From reading it seems to me that the significance level is referred to as $\alpha$ and the confidence level is referred to as $1-\alpha$ However I haven't found statements defining each in terms of ...
33 views

### How would you interpret this p-value in relation to page traffic due to page features?

I'm exploring some manual approaches to understand whether specific changes on a site can be deemed conclusive and statistically significant. I appreciate that any A/B testing platform has a reporting ...