**Requests for datasets are off-topic on this site.** Use this tag for questions concerning creating, processing, or maintaining datasets.

learn more… | top users | synonyms (1)

0
votes
0answers
9 views

How does one call external datasets into scikit-learn? [migrated]

For example consider this dataset : (1) https://archive.ics.uci.edu/ml/machine-learning-databases/annealing/anneal.data or (2) http://data.worldbank.org/topic How does one call such external ...
0
votes
0answers
26 views

Where is the original data set for the “German tank problem”? [migrated]

I am looking for the original data set for: the "https://en.wikipedia.org/wiki/German_tank_problem" , but can't seem to find it. Any suggestions on where it might be available from? Thanks.
0
votes
0answers
31 views

Data Analysis in psychiatric

A 30 item questionnaire in accept or decline form consisting of commonly encountered dysfunctional beliefs about psychiatric issues was administered to medical students. The questionnaire is in the ...
0
votes
1answer
22 views

compare multiple algorithms in the same dataset

I want to do a comparison between multiple algorithms when they applied to the same dataset. For example, I have a set of texts in Arabic and another version translated to English. I did a sentiment ...
1
vote
0answers
15 views

advice about the suitable ARIMA model

I am trying to do seasonal ARIMA(0,1,1) model using matlab But I am a little confused about the results. The drawing of standard normal quantils and the standardized residuals are shown below: my ...
2
votes
2answers
44 views

Average of a financial ratio: which average

A financial ratio, like e.g., return on equity (ROE) is a division of two numbers ROE=return/equity. If I analyse a whole sector then one can compute the ROE for each company in that sector and thus ...
0
votes
0answers
8 views

What are word components in IAM db3 for xml

I'm using the IAM handwritten database and for the answer keys I get the hierarchy, however I'm confused about word components in the the handwritten section. Specifically seeing something like this ...
0
votes
1answer
40 views

Creating a test set with imbalanced data

I am working on a binary random forest using R. mu data set consists of 300 cases classes 1 and 2100 cases class 0. I am planning to evaluate my model using the model prediction and the AUC and for ...
0
votes
0answers
8 views

Trimming, Winsorising and manipulating biological data

So I have an experiment with multiple groups (groups 1-6), individuals in each group (n=10), and read outs per individual. Eg. below Group 1: 28.1, 28.6, 29, 30.3,30.4,30.6,30.7,31.1.34 Group ...
0
votes
0answers
12 views

Problem with data on Matlab Neural Network Toolbox

I am currently working on a NARX network for a time-series prediction problem. I am using a 3*4644 array as inputs and a 1*4644 array as my targets. I do not have any delay on the input and the ...
0
votes
0answers
21 views

Type one right censored data [duplicate]

Does anyone have any idea about how to simulate censored data in R? For example, generate a sample of 200 with 30% of that Type 1 right censored, based on Weibull distribution. (30% of 200 = 60).
2
votes
2answers
26 views

Continue the predictions beyond the current data using time series neural network

I have a single time series variable and I want to train a neural network in a sort of auto-regressive fashion. specifically, I have data for water consumption that is changing with time In the ...
0
votes
0answers
24 views

Comparison of 2 data sets with different sample sizes

I have two data sets that have different sample sizes and I am unsure on how to compare them. Dataset 1 has 51 participants but dataset 2 has only 20 participants. The answers to the questions are ...
0
votes
0answers
14 views

Matching data in excel based on certain words [migrated]

I am compiling a data base on Tennis players for a college project. I have two spreadsheets with lots of relevant information, one with performance related statistics for every ATP match played over ...
0
votes
0answers
9 views

Large scale hierarchical text classification - real world data [closed]

I have recently found website dealing with large scale text classification competitions http://lshtc.iit.demokritos.gr/LSHTC4_CALL. I can see that the data provided there are quiet obfuscated. I ...
2
votes
0answers
28 views

When is a single data point enough to be considered a trend in the data?

In the general case, when collecting data points at disparate points in time (such as once per day or two), under what conditions can a single low data point be considered a downwards trend in the ...
0
votes
0answers
12 views

how do I split my data for EM?

I'm going to use EM to replace my missing values, as my missing data is MCAR and less than 1% of the total. My variables are from several measures, taken at two time points, and from both a parent and ...
0
votes
1answer
23 views

Dependent questions in SPSS [closed]

I have questions in a survey that are dependent on other questions, i.e. nested questions. How do I enter those into SPSS? Example: ...
0
votes
0answers
12 views

Determining fit for potentially periodic non-timeseries data?

I am working with genetic data that has 100,000 wide regions with given diversity values attached to them, as below: ...
1
vote
1answer
43 views

PCA dataset to test my implementation

I'm trying to find a dataset with examples of data matrices and their principal components. I know that I could construct my own dataset using standard implementations found in python, or octave ...
0
votes
0answers
41 views

Obfuscating sensitive data keeping data-properties intact

I am preparing a dataset for my academic interests. The original dataset contains sensitive information from transactions, like Credit card no, ...
0
votes
0answers
7 views

Unique combinations of 7 items (repetition allowed, order doesn't matter) [migrated]

I am trying to calculate the number of unique combinations for a 7 element set with repetition allowed where order doesn't matter. For example: ...
1
vote
1answer
10 views

sklearn estimate_bandwidth in MeanShift algorithm with small dataset

How should I approach the estimate_bandwidth function with only very small datasets? My problem is that I am analyzing datasets that range from 500 entries to 2. ...
3
votes
1answer
63 views

Does Hashing data affect linear separability

What would be a good way to obfuscate sensitive information and store e-commerce transaction data, to later perform fraud analysis on it. One idea that crossed my mind, was to hash each sensitive ...
0
votes
1answer
27 views

Comparison of longitudinal data in a same group of participants but using two entirely different tests

I have a dataset of participants who were longitudinally followed up at two different time points. They went through a series of measurements at both points. Even though the overall domain of the ...
1
vote
1answer
24 views

How to choose sampling method for imbalanced data?

I have an imbalanced dataset with 4995:5 ratio as well as other datasets with less imbalanced ratios. I split this 4995:5 ratio into training and testing for about 2/3 training and 1/3 testing. I also ...
0
votes
0answers
21 views

How are the ARIMA forecasted values calculated?

If I have data for 10 days and want to predict the data for the next day based on the previous ones, how does ARIMA find the predicted value? Is it just the average of the last 10 days, or are other ...
0
votes
0answers
27 views

Data forecasting; which method should I use?

I am interested in predicting the data for a day, based on the data given from the 14 previous days. The data I am working with is the number of subscriptions to a website per day. Each day, the ...
0
votes
1answer
30 views

Fit gamma distribution to dataset with R [closed]

I have this dataframe below: ...
0
votes
1answer
32 views

Right statistical test for my problem

I have a bunch of data like these: ...
3
votes
3answers
174 views

Is nominal, ordinal, & binary for quantitative data, qualitative data, or both?

I'm getting wrapped around data types and I need some help: If you look at the picture above (taken from here), it has the data types like this: Quantitative (Discrete, Continuous) Qualitative ...
0
votes
1answer
22 views

Correlation or dependence between NDVI and pollution data sets

Is there any statistical test or measure to evaluation the degree of correlation or dependence between two sets of data-points ? First set is represented by NDVI values in each pixel and second set is ...
2
votes
1answer
55 views

Generating 2D different shapes with same mean and covariance matrix

Im trying to reproduce the synthetic data used in this article. The authors claim the data was generated from densities with the same mean and covariance matrix. Is there any principled way I to ...
1
vote
0answers
12 views

Which is the dependent variable in the UCI Liver dataset?

https://archive.ics.uci.edu/ml/datasets/Liver+Disorders lists some papers which have used this dataset. I went to one, Turney, and it says: The target concept was defined using the sixth column: ...
1
vote
0answers
15 views

Simple Path to Route Algorithm [closed]

I'm currently conducting research into subway paths, but stand in front of a problem, with no programming knowledge and an extremely short time-limit. Probably the question I am asking is trivial, ...
2
votes
3answers
48 views

Data set for document topic discovery

I have a bunch of documents and would like to to assign one (or more) topics to each document. The topics can be quite wide ranging from political topics to sports, etc. I think the best way is to ...
4
votes
1answer
32 views

Comparison of groups with low N

Recently, I have seen a study that was comparing three groups of subjects. Each of these groups had N=3 participants. The author was claiming very strong conclusions from the mean-differences of ...
0
votes
0answers
83 views

Data Preparation for Cluster Analysis

Updated answer to "Data Preparation for Cluster Analysis": Based on the discussions, data normalization and removing correlation among data are often recommended. References posts: 1) Are mean ...
1
vote
0answers
33 views

Finding patterns within inconsistent data

If I have a database full of data sets that I collected from a material sample going through light sensors. Each sample is similar but the data can be inconsistent depending on many factors. I ...
0
votes
0answers
9 views

Combining groups for data analysis

I have a sample of 8 participants randomly allocated to two groups. Each group has a different treatment. Initial analysis using non parametric tests shows no significant difference bewtween the ...
1
vote
0answers
24 views

Which test(s) to use?

I’m having a dataset that needs to be analyzed but I’m a bit worried about picking the appropriate test(s). It’s been a while since I last really used statistics and SPSS. Therefore I would kindly ...
1
vote
0answers
17 views

what possile balancing method can I apply on a imbalanced data set? [duplicate]

Im trying to solve one classification problem from de UCI database repository. https://archive.ics.uci.edu/ml/datasets/Student+Performance Unfortunately (or fortunately) I've noticed that my dataset ...
0
votes
2answers
35 views

US Population Hypothesis Test

I’m hoping someone can give me some tips on the test I have in mind for my data. I have data which is samples of Americans from various zip codes throughout the US. In my data I assume if someone has ...
0
votes
1answer
23 views

What is the problem with statistical outlier detection approaches if we have distribution of attributes?

A group of outlier discovery methods are statistical approaches. Two drawbacks mentioned for statistical methods in many books and papers: They can apply just on a single attribute We need to know ...
0
votes
0answers
31 views

Determine if huge data sets come from the same distribution (R or Excel help)

I am doing a work assignment where I need to determine if three data sets come from the same distribution. After plotting the histogram they seem to be some rendition of a lognormal. I currently ...
0
votes
1answer
19 views

Normalising extreme items within datasets

I have a a dataset where each item is a % above or below 100% (taking an individual item, dividing by the mean). In order to produce a rank I weighted each item by a % (summing to 100%) to provide a ...
0
votes
0answers
19 views

Equivalent of (sic) for data

When quoting some text containing some surprising assertion or spelling, one can use the latin adverb sic (sic erat scriptum) to indicate that the written text is exact and not an error of ...
0
votes
1answer
35 views

Statistical Significance

I have two datasets consisted of 4 columns. I have to measure if the differences among the data (each column represent another data) are statistically significant. The problem is that: in the first ...
0
votes
1answer
274 views

SVD interpretation of Climate data

I was going through my homework. I have a question to interpret the plot which i obtain from first and second left singular vectors after computing SVD. What can i exactly interpret, is it specific to ...
0
votes
0answers
17 views

Bagging Improvement for classification problems

Breiman proved that bagging improves the accuracy of regression. How could this be proven for a classifier model?