Questions tagged [application]
applications of statistics and statistical modeling
92
questions
1
vote
0
answers
24
views
Quote on too good to be true model performance
I seem to recall that there is a nice quote by some (well known?) machine learning expert about too good to be true model performance. The quote is something like "If your model performance looks ...
- 22.3k
0
votes
1
answer
40
views
Is there a certain order of steps to be taken when conducting regression analysis?
This is an extremely dumb question probably, but I took an applied regression analysis course recently and, while I feel competent enough to do regression analyses on a basic level for future projects,...
- 11
14
votes
3
answers
370
views
Proper regression for determining correlations between derivatives of functions
Say we have a permanent-magnet DC motor that roughly obeys the system equation $\ddot{x}(t) = \alpha \dot{x}(t) + \beta u(t) + \gamma$, where $x(t)$ is the displacement of the rotor, and $u(t)$ the ...
- 624
0
votes
1
answer
26
views
Application of transformations of lognormal distributed random variables
I'm answering questions from a book and I have to do a simple transformation Y=g(X) of a lognormal distribution:
$X \sim \mathcal{LN}(\mu,\,\sigma^{2})$ with $Y=ln(X)$
Then $Y \sim \mathcal{N}(\mu,\,\...
0
votes
1
answer
45
views
How to apply Lyapunov CLT to data
I have a situation where I have around 30 classes of variables with different means and variances (though the means aren't too far from eachother; think 4-7) and that the distributions are right ...
0
votes
0
answers
26
views
Book recommendations for Applied Statistics [duplicate]
Any good books focussed on applied statistics for self-study? If the book works with Python it'll be better for me.
I'm a Physicst with a Master in Science degree, but I don't want a rigurous book on ...
1
vote
0
answers
24
views
Practical use for heritability value at sub-population level?
For me as a layperson, heritability is something that much smarter people than me calculate, and there are several questions already on the forum about how to do that (eg, this and this). I ...
- 111
0
votes
0
answers
15
views
Common applications of prediction regions
I have written a paper in which I derive a prediction region for a certain statistical model. In order to illustrate it, I seek an example.
What are common applications of prediction regions? I can ...
0
votes
0
answers
14
views
Regressing one Impulse response coefficients on another impulse response coefficients
I have estimated the impulse responses of several variables to a shock. Now I would like to know to whether interest rates affect the responses of some of the variables, say GDP. I have an idea of ...
- 1
0
votes
1
answer
56
views
Optical flow models (FlowNet) training/finetuning process
I'm reading about optical flow models, particularly FlowNet and PWC-Net. I thought I understood how training and finetuning are being done, but I don't believe so anymore after trying to understand ...
- 1
1
vote
0
answers
17
views
2 boxes of money, unknown money inside, one is twice the amount of the other [duplicate]
Suppose, I have two boxes. A host is telling me to pick one. I see the money inside of this one - say 100 \$. Now, I need to decide if I want to swap, given the information that the other box has ...
- 11
2
votes
1
answer
213
views
Clarifying the applications of Bayesian networks
I have been looking at Bayesian networks, using the book by Koller, Probabilistic Graphical Models. The book is very large, so I might have missed the answer to my question ;). But I was trying to ...
- 1,118
0
votes
0
answers
32
views
Calculate probability density by function application
let's assume we have a probability density function which is $$f(X) = \frac{a}{x^a+1}$$
how can we calculate something like this: $$Y = ln(X)$$
0
votes
0
answers
29
views
Which field of science applies the log-normal sample median distribution?
Which field of science applies the log-normal sample median distribution (i.e. the sample median distribution with samples from a log-normal parent)? I noticed that incubation periods are assumed log-...
- 1
1
vote
0
answers
38
views
How to use a p-value sampling distribution?
As part of my research I have been looking into the sampling distribution of p-values. Even though p-values are on their way out, they are still used ubiquitously with the normal $\alpha$ =.05 cutoff (...
2
votes
1
answer
40
views
Example of "alternating" mass function for discrete distribution
My question is related to this question on Math.SE where it was shown that there exist discrete distributions with probability mass functions that "oscillate" in a non-monotonic way over an ...
- 23
3
votes
1
answer
101
views
Potential applications of a result (by Beyer et al) on distance concentration and meaningless nearest neighbors in high dimensions
My question is motivated by this question, and self-study of the paper "When is nearest neighbor meaningful?", where the authors show the following
Theorem 1: Let $X^{(d)} \in \mathbb{R}^d$ ...
- 151
2
votes
1
answer
67
views
Psychology books FOR Statistics students
I can find a lot of book recommendations on Statistics for Psychology students. But can anyone suggest some good books for a Statistics student who wants to learn about applications of Statistics in ...
- 146
1
vote
1
answer
78
views
What is "LASSO aggression"?
I found a paper that stated in the methods section that they ran "LASSO aggression". At first, I thought it was a funny typo but then I did a Google Search:
Google search
and found 187 sources ...
1
vote
1
answer
41
views
Independence of censoring time $C$ and event time $T$ for randomised entry to a study
While reading through the textbook 'Modern Applied Statistics With S' by Venables and Ripley, I came across the following paragraph detailing the different types of censoring possible when dealing ...
- 259
4
votes
0
answers
35
views
Productionize (applied) PCA to detect outlier etc. long term with new data?
I was wondering how one could use PCA in e.g. a dashboard for non Subject Matter Expert.
For example, you are quite certain that 2 PCs are sufficient based on the current data. It also makes sense for ...
1
vote
0
answers
21
views
Web application with model results for use in healthcare?
Often in medicine we use scores, so the patient gets 1 point for this symptom, another for this etc. and a final a score determines their risk/treatment strategy.
If we have reliable data and build a ...
- 1,751
0
votes
0
answers
19
views
How biased is a statistical study in which sampling was purposely made without repeats? [duplicate]
[Cross posted on Math.SE]
It is understood in mathematical statistics that a sample (as in sampling distribution) may very well contain repeatedly the same item/subject.
In practice though, it would ...
- 604
0
votes
1
answer
114
views
Are sampling distributions of any statistic used in real life statistical analyses?
I feel I am pretty good on the mathematical basis of CLT and sampling distributions.
HOWEVER:
While sources like OpenIntro Statistics (Diez et al, 2019) are fairly straighforward with their actual ...
- 13
5
votes
2
answers
163
views
What apples do worms prefer? [closed]
I'm confused with some practical statistical problem, for which I have limited data and don't understand how to start with the problem. If anybody can point how such problems are (traditionally) ...
- 151
1
vote
1
answer
2k
views
Can someone provide a brief explanation as to why reproducing kernel Hilbert space is so popular in machine learning?
I thought functional analysis was long thought to be old fashioned and generally a dead research area.
It seems that all of a sudden there is a huge fascination with so-called reproducing kernel ...
- 1,071
0
votes
0
answers
18
views
Interpreting ANOVA results in the educational context
I have run an experiment in a six-week course to measure the effect of my educational treatment on student engagement. The treatment happens on weeks 4 and 6 of the course (for all of the students) ...
- 207
1
vote
1
answer
89
views
Why should we study copulas? [closed]
I am new to the study of copulas and I would like that someone could provide some examples where they are applied, their usefulness and so on. Any help is appreciated. Thanks in advance.
user242554
0
votes
0
answers
37
views
Summarize regression results on different datasets
I have 20 datasets (extracted from 20 different software systems) and fit a logistic regression model on each of them. On every dataset, the model was the same (same dependent variable and the same ...
- 1
41
votes
2
answers
1k
views
Evidence for man-made global warming hits 'gold standard': how did they do this?
This message in a Reuter's article from 25.02.2019 is currently all over the news:
Evidence for man-made global warming hits 'gold standard'
[Scientists] said confidence that human activities ...
- 46.5k
2
votes
0
answers
34
views
How do I measure effects over years in longitudinal panel data with individuals?
I'm working with a longitudinal panel dataset that surveys the same few thousand individuals biennially and I have six years of this data. My dependent variable would be how much individuals spend on ...
- 21
3
votes
1
answer
74
views
How do I learn when to apply which statistical distributions? [closed]
I am learning Bayesian modeling and having trouble keeping straight when it is most appropriate to apply the various statistical distributions beyond the basic ones like the beta, binomial, and ...
- 389
4
votes
1
answer
58
views
What does this paper mean by mean square error?
I'm reading a paper about estimating fetal weight by ultrasound and other techniques. In Table 2 they give descriptive statistics, to wit: of all the examiners, the one with the highest mean square ...
- 1,068
1
vote
1
answer
77
views
Do you know of business applications of Reinforcement Learning?
I'm looking for literature on the application of Reinforcement Learning (RL) algorithms in a business context. Most articles and examples in books on RL are about the application of RL to games (...
- 23
2
votes
0
answers
98
views
Variables common to all individuals in a panel
I have been tasked with evaluating the efficiency of different marketing tools for a microfinance bank.
I have a panel of seven individuals (seven districts of Tajikistan) over 17 months.
Dependent ...
- 21
3
votes
1
answer
429
views
What modeling problem does ridge regression solve?
If your modeling problem is that you have too many features, a solution to this problem is LASSO regularization. By forcing some feature coefficients to be zero, you remove them, thus reducing the ...
- 751
1
vote
1
answer
176
views
Testing the scope of application of a logistic regression model
My aim is to assess whether I can apply a logistic regression that was fitted on a sample A (where I have explanatory variables and the outcomes) to a different sample B where I don't know the ...
- 3,236
4
votes
0
answers
438
views
Difference between Stochastic Approximation (SA) and Stochastic Gradient Descent (SGD)
I understand the intended use cases for both stochastic approximation algorithms like SPSA or FDSA, and for SGD algorithms like Adam.
SPSA is intended for noisy objective functions, and Adam for ...
- 217
1
vote
0
answers
157
views
Mixture of power-law distribution
I have two large sets A and B of (integer) numbers, both obtained with two different (and unknown) probability distributions $\rho_A$ and $\rho_B$.
A (also large) set C contains a proportion $p$ of ...
- 111
8
votes
1
answer
4k
views
How Do You Choose The Number of Bins To Use For A Chi-Squared GOF Test?
I'm working on developing a physics lab about radioactive decay, and in analyzing sample data I've taken, I ran into a statistics issue that surprised me.
It is well known that the number of decays ...
- 145
1
vote
1
answer
141
views
Population proportion inference: what statistical error am I committing here?
I am struggling to understand the following paradox.
Suppose we have a large population of people who exhibit different values of a trait, e.g. they are sick with different strains of a virus. ...
- 221
0
votes
2
answers
578
views
Compare the slopes of categorical data
Hello I want to compare the slopes of the linear regression lines for the following distributions of sales figures over the years 2009 to 2017.
I want to compare the slopes of the regression lines - ...
- 305
2
votes
1
answer
268
views
Real world applications of regressing complex numbers?
I recently extended a linear regression software I developed to include complex variables. It works very well but I am not familiar with how this can be used in the real world. I scoured the web to ...
- 133
5
votes
2
answers
4k
views
(Practical) Applications or RNN
I have been googling for a list of practical applications of Recurrent Neural Networks for some time, but did not find a reasonable reference list.
Most of the things are about text generation which ...
- 2,483
1
vote
2
answers
227
views
Android Recommendation App Algorithm [closed]
I have this project proposal entitled "Android Based Program Recommendation App". (This application is for those college students who wants to shift to other programs).
The app will find a program ...
- 11
1
vote
1
answer
81
views
Infering relative importance of features in driving a dependent variable
In an auctions website I maintain, auctions are listed most-recent-first. There are 20 auctions per page. A user can click next in the footer to view older auctions....
- 149
2
votes
0
answers
104
views
Applying machine learning to dynamic complex systems (e.g. weather prediction)
Would it be correct to say that:
Physics-based, domain specific models are more widely used and are more practical in (longer term) weather forecasts than pure machine learning approaches
The reason ...
- 3,198
2
votes
0
answers
77
views
Practical application for theoretical sampling process
Does the following sampling process model any particular real life scenario ? If so, could you point me to some relevant scientific papers.
Consider an arbitrary probability distribution $\mathcal{D}$...
- 29
3
votes
0
answers
2k
views
Finding correlations in a large dataset
My main objective is to find correlations between process parameters and their impact (more specifically: the amount of wear measured) on specific sections of equipment used in the process.
I've ...
- 31
2
votes
1
answer
64
views
What statistic is appropriate to test if measured data points from untrusted sources are accurate enough?
Suppose I'm retrieving the price of asset from 3 different independent sources.
What statistic can I use to test whether data points are close enough that I can be confident they're correct?
I have ...
- 121