Questions tagged [application]
applications of statistics and statistical modeling
83
questions
0
votes
0answers
16 views
Calculate probability density by function application
let's assume we have a probability density function which is $$f(X) = \frac{a}{x^a+1}$$
how can we calculate something like this: $$Y = ln(X)$$
0
votes
0answers
10 views
Real applications using estimation of parameters
In the first classes of statistical inference we learn about parameter estimation of some classical statistical distributions (Bernoulli, Binomial, Poisson, Geometric, Normal, etc). I would like to ...
0
votes
0answers
8 views
how to decide for the final model on a prediction task
hope you are fine. I have a question in the field of model selection for the prediction task based on several influencing factors on the target variable:
I have a data set where I train, validate, and ...
0
votes
0answers
25 views
Which field of science applies the log-normal sample median distribution?
Which field of science applies the log-normal sample median distribution (i.e. the sample median distribution with samples from a log-normal parent)? I noticed that incubation periods are assumed log-...
1
vote
0answers
27 views
How to use a p-value sampling distribution?
As part of my research I have been looking into the sampling distribution of p-values. Even though p-values are on their way out, they are still used ubiquitously with the normal $\alpha$ =.05 cutoff (...
2
votes
1answer
33 views
Example of “alternating” mass function for discrete distribution
My question is related to this question on Math.SE where it was shown that there exist discrete distributions with probability mass functions that "oscillate" in a non-monotonic way over an ...
3
votes
1answer
74 views
Potential applications of a result (by Beyer et al) on distance concentration and meaningless nearest neighbors in high dimensions
My question is motivated by this question, and self-study of the paper "When is nearest neighbor meaningful?", where the authors show the following
Theorem 1: Let $X^{(d)} \in \mathbb{R}^d$ ...
2
votes
1answer
50 views
Psychology books FOR Statistics students
I can find a lot of book recommendations on Statistics for Psychology students. But can anyone suggest some good books for a Statistics student who wants to learn about applications of Statistics in ...
1
vote
1answer
68 views
What is “LASSO aggression”?
I found a paper that stated in the methods section that they ran "LASSO aggression". At first, I thought it was a funny typo but then I did a Google Search:
Google search
and found 187 sources ...
1
vote
1answer
18 views
Independence of censoring time $C$ and event time $T$ for randomised entry to a study
While reading through the textbook 'Modern Applied Statistics With S' by Venables and Ripley, I came across the following paragraph detailing the different types of censoring possible when dealing ...
0
votes
0answers
87 views
When can we get sales data which is normally distributed?
I understood that the poisson data distribution is mostly used for sales data. However, I just wonder under which scenarios can one assume that data is instead normally distributed?
Maybe there was ...
4
votes
0answers
32 views
Productionize (applied) PCA to detect outlier etc. long term with new data?
I was wondering how one could use PCA in e.g. a dashboard for non Subject Matter Expert.
For example, you are quite certain that 2 PCs are sufficient based on the current data. It also makes sense for ...
1
vote
0answers
21 views
Web application with model results for use in healthcare?
Often in medicine we use scores, so the patient gets 1 point for this symptom, another for this etc. and a final a score determines their risk/treatment strategy.
If we have reliable data and build a ...
0
votes
0answers
19 views
How biased is a statistical study in which sampling was purposely made without repeats? [duplicate]
[Cross posted on Math.SE]
It is understood in mathematical statistics that a sample (as in sampling distribution) may very well contain repeatedly the same item/subject.
In practice though, it would ...
0
votes
1answer
56 views
Are sampling distributions of any statistic used in real life statistical analyses?
I feel I am pretty good on the mathematical basis of CLT and sampling distributions.
HOWEVER:
While sources like OpenIntro Statistics (Diez et al, 2019) are fairly straighforward with their actual ...
5
votes
2answers
138 views
What apples do worms prefer? [closed]
I'm confused with some practical statistical problem, for which I have limited data and don't understand how to start with the problem. If anybody can point how such problems are (traditionally) ...
1
vote
1answer
766 views
Can someone provide a brief explanation as to why reproducing kernel Hilbert space is so popular in machine learning?
I thought functional analysis was long thought to be old fashioned and generally a dead research area.
It seems that all of a sudden there is a huge fascination with so-called reproducing kernel ...
0
votes
0answers
18 views
Interpreting ANOVA results in the educational context
I have run an experiment in a six-week course to measure the effect of my educational treatment on student engagement. The treatment happens on weeks 4 and 6 of the course (for all of the students) ...
1
vote
1answer
78 views
Why should we study copulas? [closed]
I am new to the study of copulas and I would like that someone could provide some examples where they are applied, their usefulness and so on. Any help is appreciated. Thanks in advance.
0
votes
0answers
32 views
Summarize regression results on different datasets
I have 20 datasets (extracted from 20 different software systems) and fit a logistic regression model on each of them. On every dataset, the model was the same (same dependent variable and the same ...
39
votes
2answers
1k views
Evidence for man-made global warming hits 'gold standard': how did they do this?
This message in a Reuter's article from 25.02.2019 is currently all over the news:
Evidence for man-made global warming hits 'gold standard'
[Scientists] said confidence that human activities ...
2
votes
0answers
27 views
How do I measure effects over years in longitudinal panel data with individuals?
I'm working with a longitudinal panel dataset that surveys the same few thousand individuals biennially and I have six years of this data. My dependent variable would be how much individuals spend on ...
3
votes
1answer
72 views
How do I learn when to apply which statistical distributions? [closed]
I am learning Bayesian modeling and having trouble keeping straight when it is most appropriate to apply the various statistical distributions beyond the basic ones like the beta, binomial, and ...
4
votes
1answer
55 views
What does this paper mean by mean square error?
I'm reading a paper about estimating fetal weight by ultrasound and other techniques. In Table 2 they give descriptive statistics, to wit: of all the examiners, the one with the highest mean square ...
1
vote
1answer
72 views
Do you know of business applications of Reinforcement Learning?
I'm looking for literature on the application of Reinforcement Learning (RL) algorithms in a business context. Most articles and examples in books on RL are about the application of RL to games (...
2
votes
0answers
47 views
Variables common to all individuals in a panel
I have been tasked with evaluating the efficiency of different marketing tools for a microfinance bank.
I have a panel of seven individuals (seven districts of Tajikistan) over 17 months.
Dependent ...
2
votes
1answer
225 views
What modeling problem does ridge regression solve?
If your modeling problem is that you have too many features, a solution to this problem is LASSO regularization. By forcing some feature coefficients to be zero, you remove them, thus reducing the ...
1
vote
1answer
145 views
Testing the scope of application of a logistic regression model
My aim is to assess whether I can apply a logistic regression that was fitted on a sample A (where I have explanatory variables and the outcomes) to a different sample B where I don't know the ...
4
votes
0answers
328 views
Difference between Stochastic Approximation (SA) and Stochastic Gradient Descent (SGD)
I understand the intended use cases for both stochastic approximation algorithms like SPSA or FDSA, and for SGD algorithms like Adam.
SPSA is intended for noisy objective functions, and Adam for ...
1
vote
0answers
120 views
Mixture of power-law distribution
I have two large sets A and B of (integer) numbers, both obtained with two different (and unknown) probability distributions $\rho_A$ and $\rho_B$.
A (also large) set C contains a proportion $p$ of ...
8
votes
1answer
3k views
How Do You Choose The Number of Bins To Use For A Chi-Squared GOF Test?
I'm working on developing a physics lab about radioactive decay, and in analyzing sample data I've taken, I ran into a statistics issue that surprised me.
It is well known that the number of decays ...
1
vote
1answer
137 views
Population proportion inference: what statistical error am I committing here?
I am struggling to understand the following paradox.
Suppose we have a large population of people who exhibit different values of a trait, e.g. they are sick with different strains of a virus. ...
0
votes
2answers
323 views
Compare the slopes of categorical data
Hello I want to compare the slopes of the linear regression lines for the following distributions of sales figures over the years 2009 to 2017.
I want to compare the slopes of the regression lines - ...
2
votes
1answer
230 views
Real world applications of regressing complex numbers?
I recently extended a linear regression software I developed to include complex variables. It works very well but I am not familiar with how this can be used in the real world. I scoured the web to ...
5
votes
2answers
4k views
(Practical) Applications or RNN
I have been googling for a list of practical applications of Recurrent Neural Networks for some time, but did not find a reasonable reference list.
Most of the things are about text generation which ...
1
vote
2answers
207 views
Android Recommendation App Algorithm
I have this project proposal entitled "Android Based Program Recommendation App". (This application is for those college students who wants to shift to other programs).
The app will find a program ...
1
vote
1answer
71 views
Infering relative importance of features in driving a dependent variable
In an auctions website I maintain, auctions are listed most-recent-first. There are 20 auctions per page. A user can click next in the footer to view older auctions....
2
votes
0answers
100 views
Applying machine learning to dynamic complex systems (e.g. weather prediction)
Would it be correct to say that:
Physics-based, domain specific models are more widely used and are more practical in (longer term) weather forecasts than pure machine learning approaches
The reason ...
2
votes
0answers
68 views
Practical application for theoretical sampling process
Does the following sampling process model any particular real life scenario ? If so, could you point me to some relevant scientific papers.
Consider an arbitrary probability distribution $\mathcal{D}$...
3
votes
0answers
2k views
Finding correlations in a large dataset
My main objective is to find correlations between process parameters and their impact (more specifically: the amount of wear measured) on specific sections of equipment used in the process.
I've ...
2
votes
1answer
63 views
What statistic is appropriate to test if measured data points from untrusted sources are accurate enough?
Suppose I'm retrieving the price of asset from 3 different independent sources.
What statistic can I use to test whether data points are close enough that I can be confident they're correct?
I have ...
2
votes
0answers
304 views
Can the exponential distribution actually be used to model light bulbs lifetime?
In my textbook they use the lifetimes of lightbulbs (or other mechanical failures) as an example for an application of the exponential distribution.
Can/is this actually done in real life? The reason ...
1
vote
1answer
552 views
Gamma distribution and applications
I'm looking for references to read about gamma distribution and applications in industry or in quality control.
I had a look at statistical methods for reliability data (Meeker and Escobar). It has ...
11
votes
5answers
2k views
Good examples/books/resources to learn about applied machine learning (not just ML itself)
I've taken an ML course previously, but now that I am working with ML related projects at my job, I am struggling quite a bit to actually apply it. I'm sure the stuff I'm doing has been researched/...
2
votes
0answers
983 views
1
vote
0answers
39 views
Statistical assessment of people skills via PCA
I would like to assess the skills of a lot of persons on a few main axis.
Let me explain my proposal.
For each skills axes, I propose several questions. Each question gives a score from 0 to 10.
Once ...
0
votes
0answers
42 views
Bayesian inference and a logistic weight control problem
Currently I have a lot of problems to select which I want to work on. For some I already got ideas on how to solve it. However, I haven't dived deep into Bayesian inference so far but, from what I ...
1
vote
0answers
146 views
Hierarchical Bayesian Regression with an Indicator Variable, one group has all zeros for the IV Variable
I'm attempting to form a Bayesian Hierarchical Regression Model and one of my regressors is for an indicator variable. My hierarchy structure has separate group-level regressors related across-groups ...
4
votes
0answers
134 views
An example of delta method performing poorly
Q: Is there an example of the delta method being used in applied statistics where the sample size needed for a good approximation is practically unfeasible?
I am looking for an example from applied ...
0
votes
1answer
38 views
How to compare the means of two populations that were subject to five treatments?
I have two populations that were each subject to 5 different treatments and I want to compare their means.
This sounds like a great problem for multiple confidence intervals, but I don't want to make ...