Questions tagged [software]
Make sure your question is related to STATISTICS, MACHINE LEARNING, or DATA ANALYSIS and is not solely about programming, support, or bugs. Include additional tags referring to the statistical issues involved.
213 questions
1
vote
0answers
34 views
software for one class classification with a Bayesian Network
I'm looking for a software package that would allow to do a one class classification with a Bayesian Network (anomaly detection).
I was planning to use bnlearn but so far I'm unable to find out if ...
2
votes
1answer
37 views
What SPSS test should I use for blood pressure pre- and post-intervention for comparison?
I have 10 participants who consumed an intervention for 3 weeks.
I would like to look at any significance between pre-intervention and post-intervention readings.
What SPSS test should I use?
I ...
2
votes
0answers
55 views
SAS and R gives different standard error when fitting Tweedie model
I would like to fit a Tweedie GLM to the data. However, even though PROC GENMOD from SAS and glm() from R gives the same coefficient estimates, they give quite different standard error. What it the ...
7
votes
1answer
586 views
Why is the intercept typed in as a 1 in stats packages (R, python)
When using statistics software, When defining your linear models, why is the intercept typed in as a 1, rather than "const" or "intercept" or something. What significance does 1 have?
Is there some ...
0
votes
0answers
8 views
Software that finds correlations between loosely dependent time-series?
I'm not sure if this is the right kind of question for this site, so please let me know :)
I'm looking for a time series data analysis platform, so I can take a collection of time series at 15-...
1
vote
1answer
35 views
Statistical Analysis Software [closed]
I am a psychology student at UCF. I intend to pursue a master's degree in industrial and organizational psychology. We use SPSS in the psychology department. How prevalent is SPSS used in offices? ...
0
votes
0answers
25 views
combine samples of supersets to get a reservoir sample of the subset
Here's some background before my question (Bear with me! :D)
I am working on a data pipeline that deals with a massive input log dataset; instead of saving the full input log, current version of this ...
0
votes
0answers
22 views
Latent Point Process Inference
I need to perform inference on a point process, by which I mean I need a statistical model from which I can (at least) estimate likelihoods. The underlying process appears to have a latent structure, ...
5
votes
1answer
187 views
Alternatives to Journal of Statistical Software?
I have developed an R package for a general class of regression models with applications in survival analysis. I have prepared a paper describing the package and the methods, and the applications. One ...
0
votes
0answers
30 views
R: icenReg: How do I fit a Bayesian model without any groups?
I've encountered a rather strange problem with the icenReg package. I'm trying to fit a Bayesian model to some interval-censored data. I'll illustrate this using ...
0
votes
0answers
49 views
How to determine optimal “threshold” for taking in averages of data?
Sorry in advance if this isn't the right place for this question. I'm working on a project to try to determine whether a particular object is is producing sound or not. I'm using a piece of hardware ...
2
votes
0answers
103 views
Implementation of time-varying coefficients model for Cox regression
I would like to implement the time-varying coefficients model (cf. Fan and Zhang, 1999) for a Cox proportional hazards model, as proposed by Cai and Sun (2003), and studied by Tian, Zucker and Wei (...
0
votes
0answers
53 views
Implementation of regularized competing risk models with random effects
Are there any existing software implementations of regularized competing risk cox models with that also allow for random effects (i.e., competing risk frailty models)? That is, models that allow for ...
0
votes
0answers
18 views
Data Correlation for computing software metrics
I have the below sets of data per application, you can call them as software metrics. These metrics vary depending on the size of an application.
...
1
vote
0answers
36 views
Whatever happened to COMPUMINE software? [closed]
There's still many references to Compumine "association rule discovery" on the 'net, but they all point to the compumine website, which doesn't exist any more (site for sale!).
Were they bought out by ...
2
votes
0answers
17 views
Design of Experiments through Algebraic Statistics [closed]
I would like to ask you about how to compute a circuit basis of a design matrix in software R.
Let me explain you. I have found a software, named Macaulay2, that calculates some algebraic tools, and ...
0
votes
2answers
66 views
Automating a search for correlation
Note: I am not a statistician, though I do have a mathematics background. I know what I would like to do, but I don't have deep subject knowledge. If you use any special jargon, please try to use ...
1
vote
1answer
319 views
How to normalize text when computing the word error rate of a speech recognition system?
I am looking for a library, script or program that can normalize the transcribed and gold texts when computing the word error rate (WER) of an automated speech recognition system.
For example, if:
...
1
vote
0answers
27 views
How to design a complex machine learning system where individual classifiers can be retrained without modifying rest of the system?
I am designing a machine learning system which consists a bunch of classifiers (each output a confidence score between 0 to 1). Some classifiers consume output from other classifiers as features. Now ...
0
votes
0answers
39 views
How many different statistics packages use GPL (Graphical Programming Language)?
QUESTION: How many different statistics packages use GPL?
BACKGROUND: Most of what I am finding regarding GPL (Graphical Programming Language) is in relation to SPSS. While the literature I've seen ...
7
votes
1answer
790 views
What is probabilistic programming?
For the past year, I've been hearing a lot about Probabilistic Programming (PP) frameworks like PyMC3 and Stan, and how great PP is. And today, someone shared this link with me:
Pyro: a Deep ...
0
votes
0answers
48 views
How do I analyze “unit test” results as part of a software project?
Many software projects have "unit tests", which vary in definition and implementation, but are generally agreed to specific tests of a small "unit" of software. For example, an "addition" function
<...
0
votes
0answers
2k views
CRF (TensorFlow) log-likelihood becomes positive
I am currently doing a multiclass classification task on sequence data and am using tf.contrib.crf.crf_log_likelihood to compute sentence level log-likelihood values.
In particular it implements a ...
2
votes
2answers
151 views
How to fit to sum of observations?
From a practical point of view, how does one go about fitting a model to training data that consists of sums of a dependent variable over multiple conditions? For example, fitting a model to predict ...
3
votes
0answers
150 views
Program to evaluate the output of a speech recognition system
I am looking for a library, script or program that can evaluate the output of a speech recognition system. The output of the speech recognition system is a simple text file, and I have the gold output ...
3
votes
1answer
491 views
Combine crude events and Hazard Ratio in Meta-analysis
I'm running a meta-analysis on several studies; most of them have crude event numbers that I can put in my software, but other ones have hazard ratios with 95% C.I. reported and no crude number ...
1
vote
1answer
311 views
Latent Dirichlet Allocation (LDA) package that allows specifying asymmetric prior? [closed]
Are there any packages there any LDA packages out there that allow you to specify the full asymmetric prior? I know Mallet uses asymmetric priors, but I don't believe it allows you to specify them.
5
votes
2answers
421 views
Python package that allows to train a CRF on two datasets
I am looking for a Python package that allows to train a conditional random field (CRF) on two datasets.
For example: I have two datasets, dataset A and dataset B. I want to train a conditional ...
0
votes
1answer
959 views
Calculation of IV Standard Errors using R
One thing that I cannot find very clear, perhaps because I am still new in using R, is the derivation of the standard errors in instrumental variable packages using R (e.g., ivreg, sem, plm). I am ...
1
vote
2answers
260 views
software for genome wide associations studies (GWAS) [closed]
I have just started learning about genome wide associations studies (GWAS) as I will have to run some of them in the near future, and I am pretty confused about which are the best computational tools ...
1
vote
0answers
44 views
Software for cluster analysis of dichotomous data
can anybody recommend software for cluster analysis of dichotomous data (using appropriate coefficients, e.g. from Finch, 2005 1)? I have access to Statistica but it seems to me that it is not ...
1
vote
0answers
37 views
Re-running randomly seeded analyses produces unreplicable results, so why don't packages use a deterministic seed by default?
Analyses based on iterative model fitting or simulations are typically seeded with an unpredictable random value based on a PRNG function plus the program / computer state. This causes analyses to ...
2
votes
1answer
261 views
Is Maximum Likelihood implemented differently in different supervised classification systems?
Some functions are identical between systems, for example nearest neighbour analysis. It would be unusual to have nearest neighbour implemented differently as appears in academic papers.
Is it the ...
1
vote
1answer
88 views
Are there alternatives to MCR-ALS for determining pure response profiles of a mixture?
MCR-ALS says it is a tool for "the recovery of the pure response profiles of the chemical constituents or species of an unresolved mixture when no prior information is available about the nature and ...
1
vote
1answer
2k views
Choosing statistical software based on the size of dataset
The statistical software that I am familiar with, like Stata, is no longer capable for processing 3GB dataset with more than 1 million records, or bigger. Now I am working with JMP pro and a little ...
-1
votes
1answer
1k views
How to draw a map of a cluster analysis results
I have performed k-mean clustering on a demographic data set. Now I wish to show the results on a (geographical) map, i.e. I want to show the clusters that I got after the analysis in a map. Can ...
7
votes
4answers
1k views
What exactly is a “solver” in optimization?
I am really confused by the usage of solver in computational optimization. I have looked around for a month on and off in order to see if I can get a good sense of what this term means yet I still do ...
55
votes
9answers
12k views
How do R and Python complement each other in data science?
In many tutorials or manuals the narrative seems to imply that R and python coexist as complementary components of the analysis process. To my untrained eye, however, it seems that both languages sort ...
1
vote
1answer
64 views
How to organize lots of data and extract information
I am working in a project where I need to extract data from lots of files provided to me in different formats (.exe, .doc, .txt, .dbf, and even .pdf). The data I am interested in are water quality and ...
1
vote
0answers
41 views
Importance of workflow visualization in a statistical software package?
From a blog post
... The important thing is why they’re missing. Gartner excluded them this year, “…due to not satisfying the [new] visual composition framework [VCF] inclusion criteria.” VCF is ...
1
vote
0answers
322 views
NVivo IRR Test of Content Analysis Data: How do I interpret each row of Kappas?
I am currently working on a research project that involves content analysis of secondary published data (corporate sustainability reports) by U.S. companies. In order to capture the data, I and two ...
1
vote
0answers
334 views
Stacked Conditional Random Field (CRF) implementation
I am looking for a library that can train a stacked conditional random field (CRF). I plan to use it for natural language processing purposes. Ideally, Python interface, works on Linux, and multi-...
2
votes
1answer
1k views
Fastest LSTM training in CPU-only (no-GPU) setting [closed]
Training more or less sophisticated RNNs (e.g. LSTM) takes ages in CPU-only setting.
I've tried Lasagne-over-Theano, Keras-over-TF and torch-rnn implementations of character-level language models (...
1
vote
1answer
78 views
Best way to check implementation of density, distribution function and random generation
What is the best way to check if implementation of density, distribution function, quantile function and random generation for some distribution are correct? For example, base R lacks Laplace ...
2
votes
1answer
1k views
Which hardware for Machine Learning software? [closed]
I would like to build a desktop PC with Linux and use it mainly for machine learning research and related stuff. I am aware that there are software packages that use GPU "magic stuff" to train ...
2
votes
1answer
433 views
CRF implementation with Python API that allows a CRF model to be trained multithreadedly
I am looking for a conditional random field (CRF) implementation with a Python API that allows a CRF model to be trained multithreadedly.
I currently use pyCRFsuite, which works great except that CRF ...
3
votes
3answers
156 views
Statistics Software Survey?
Does anyone know of research showing the different types of statistical software used? I'm looking to find out things like what percentage of people use SAS vs. Stata, R, or other packages. I'm be ...
1
vote
0answers
606 views
Convert latex mathematics equations directly to Python/Matlab Code? [closed]
I am wondering if there is any technique to convert latex mathematics equations directly to code, like Python(numpy,scipy), Matlab? Thanks!
I have this problem since I find I sometimes make mistakes ...
3
votes
1answer
70 views
Where can I find tests that validate the output of popular statistical software? (e.g. R, SPSS, SAS)
This has been difficult to search on Google. I've looked on R's website as well. I assume there are test suites that validate that R, SPSS, SAS, et al are giving the right output for a given analysis? ...
0
votes
0answers
616 views
Adaptive Group Lasso
Is there any code/algorithm (preferrably for MatLab, but R is fine) where I can easily implement the Adapative Group Lasso as in here.
I have found algorithms to implement the group lasso with a ...
