Structured data files in any format, collected together with the documentation that explains their production or use.

learn more… | top users | synonyms (1)

0
votes
0answers
11 views

Use of MICE to derive imputed values [on hold]

Anyone have a moment to assist with determining why I have an error with my sample data set up to run MICE? I keep getting an error in D.F. when I run this command line with my data. I am using this ...
0
votes
0answers
15 views

Where can I find a data set of US Individuals? [on hold]

I'm looking for a data set of US citizens/residents, etc. With data on things such as age, geographic location, gender, income, marital status, etc. The more the better. Where can I find an ...
0
votes
1answer
45 views

Daily data, different dates

I have downloaded two different daily data sets, both for the same period. Together I want to use them to construct data for another variable. However, the problem is that the dates do not exactly ...
0
votes
0answers
7 views

How to collect data with latitude and longitude values incrementing at 0.01 degree? [on hold]

(sorry, I don't even know for sure if this question goes here, but I have to ask this:) I'm having to collecta the data of latiutudes and longitudes (of US) incrementing at 0.01 degree into Excel. I ...
0
votes
0answers
9 views

Difference between Data step and PROC IML in SAS for parallel computing [on hold]

I am using SAS in parallel computing through a HPC cluster, and every time that I run my code I get the following error in my log file: ERROR: A lock is not available for libname.mydata.DATA. ERROR: ...
0
votes
0answers
19 views

Data set sample

I'm willing to make a comparative study, to examine culture dimensions effect on countries with the highest GDP and countries with the lowest GDP countries, but there is no enough observation to make ...
0
votes
0answers
25 views

Data augmentation techniques for general datasets?

In many machine learning applications, the so called data augmentation methods have allowed building better models. For example, assume a training set of $100$ images of cats and dogs. By rotating, ...
2
votes
0answers
29 views

Is it possible to explain the performance of a classifier by the specific properties of a data set?

I receive the following comment from a reviewer : "I think that the authors could explain in more details the results. For instance, there is no discussion linking the specific properties of the ...
0
votes
1answer
40 views

Is building training data set from unlabeled data considered as a scientific contribution? [closed]

Is building a training data set, from unlabeled data, for a machine learning classifier considered as a scientific contribution?
5
votes
2answers
105 views

What is bucketization?

I've been going around to find a clear explanation of "bucketization" in machine learning with no luck. What I understand so far is that bucketization is similar to quantization in digital signal ...
0
votes
0answers
7 views

How compare aggregate data before and after policy?

I have aggregate data on the number of tests performed at the laboratories of two hospitals and two departments each, before and after insertion of an information system (data refer to costs and ...
0
votes
0answers
23 views

What does Boston housing data be projected? [closed]

Boston housing data is very famous spatial data. When, however, we would like to visualize the data mapping, we always are suffered from lacking projection file (.prj) in the files providing GeoDa ...
2
votes
1answer
23 views

How to process Binomial-Binomial data on SPSS for hypothesis testing?

There are 2 groups of 100 pregnant women: the first are malnourished and the second are well-nourished. A COHORT research is being done on them to determine if malnutrition is a risk factor for low ...
0
votes
0answers
10 views

Analysis over an unbalanced data set of independent variablees

I have a collection of 40 books publication of an author within different years(2005-2015). The number of publication is not even for different years. (the most is in 2014 and the least is for 2009) ...
1
vote
2answers
59 views

How to Balance my Dataset?

I have 90% negative examples and 10% positive examples,(13,000 observations, 90 Variables). my model shows me that the miss classifications error is 0.1 but my confusion matrix shows me that the TP ...
0
votes
0answers
39 views

What test to use? Splitting up dataset -> increase performance value

I am working on my thesis and I have collected some data. Now I need to know what kind of test I should use. I have an algorithm with which I produce a bunch of data over a dataset. Then I calculate ...
0
votes
0answers
10 views

Minimizing information loss when aggregating transaction data

I have rich data set of transaction data as follow: ...
2
votes
1answer
85 views

What should be my training set for a word-spotting program?

I wanted to create a simple voice recognition program. It should be able to distinguish my voice from other sounds. Aside from my voice, what should I add to my training set? Also, I want to extend my ...
1
vote
0answers
14 views

Standard deviation comparison for splitting clusters in ISODATA

I am currently implementing the ISODATA algorithm and I am new to cluster analysis as I just learnt about it. I got stuck at the step which I need to compute the standard deviation of each cluster, ...
0
votes
0answers
13 views

Should I deflate capital stock with price index?

I am working on productivity growth and y(value added) is my dependent variable and k(capital stock or fixed asset in CMI) and L(labor) are independent variables.I have deflated y and L with whole ...
0
votes
0answers
6 views

Loops of count command in Stata [migrated]

Software: STATA I have two datasets: one of company CEOs (dataset 1) and one of business agreements signed (dataset 2). Dataset 1 is the following format, sorted by company: ...
0
votes
0answers
18 views

How to determine the number of employees in a business when sources are inconsistent?

I am analyzing a business survey data. I am interested in the total number of employees of each firm. Specifically, I am interested in: The total number of employees in a specific city, and The ...
1
vote
0answers
25 views

Should I use A/B testing to find evidence that click-through rate has changed over four months?

I am working with a toy data set. I have some data for a website over the last four months. This data includes how many times (and when) an ad was shown and how many times an ad (and when) was ...
1
vote
0answers
27 views

Research question about single-group interventions and data analysis

We are working with a community organization that had collected data on their own and want us to do data analysis. The data they sent us showed they gave everyone their (anti-smoking) intervention and ...
0
votes
0answers
8 views

Usual way of measuring a set's deviation from another set

I have a set of reference daily prices. I also use an algorithm to estimate daily prices. I want to measure the difference between my estimations and the reference. I am quite unfamiliar with ...
0
votes
0answers
38 views

Which algorithm fits best to a transactional data classification problem?

I have transactional database - the data looks as follows: ID - COLUMN1 - COLUMN2 - COLUMN3 0 - A - B - C 0 - A - D - C 0 - E - B - C 1 - A - B - C 1 - A - B - C 2 - ...
0
votes
0answers
16 views

Structuring my Survival Model Dataset - Dealing with variables that change

I am working on a survival model where I am interested in how many hours a patient will stay in a hospital. Therefore, the event is Discharge from Hospital. One of the variables I would like to ...
3
votes
1answer
73 views

What's the meaning of dimensionality and what is it for this data?

I'm doing my assignment for my "Modeling and Optimization" course, and now I have doubts on the first question: What is the dimensionality of the data? What are the min, median, max, mean, ...
0
votes
1answer
11 views

Sample size log linear analysis?

Is there a rule of thumb for the sample size for a log linear analysis? For example, would it be inappropriate to use this analysis for a sample size of 50 with 3 predictors?
0
votes
0answers
32 views

Use Word2Vec to generate a synthetic text dataset

I'm trying to create a realistic set of document like text datasets. Is there any known way to implement the word2vec representation of words in order to manipulate such text?
0
votes
1answer
33 views

Comparing interest rate and yearly stock return

I would like to compare the interest rate with the yearly return of a stock A and plot the 2 lines into 1 graph. The interest rate, which is also a yearly return, is on any given date determined by ...
0
votes
1answer
24 views

Forecasting model - Scale mismatch

I have the following data: As you can see I want to create a regression model, which forecasts a variable, which I have also on a quartely basis. However, my volume is only on yearly basis. Is ...
2
votes
1answer
23 views

Testing data for regular oscillations

This is a little hard to explain, but I would like to test data for periodic oscillations, but not necessarily oscillations of the same amplitude. for example (crudely!): So basically I want to ...
1
vote
0answers
18 views

Normalised data

I am trying to understand if it is possible to run analysis on normalised data. I have 4 times points and I have normalised all data to the first 30sec time point at 100% (i.e. the first set of data ...
0
votes
0answers
1 view

Trying to replicate data analyses on AM software

I have downloaded a dataset from data.gov and need to run some correlations. It runs on AM software, and I have not been able to either export or tag any dependent variables. Please help.
2
votes
1answer
54 views

Optimal Binning with respect to a given response variable

I'm looking for optimal binning method (discretization) of a continuous variable with respect to a given response (target) binary variable and with maximum number of intervals as a parameter. ...
0
votes
0answers
13 views

MLE for panel data

I am a beginner in statistics, so please don't mind if this question sounds elementary. I am trying to analyze monthly panel data with number of hospital admits in a town. I have data for ~5000 ...
0
votes
1answer
28 views

De-normalizing Google Trends data?

Does anybody have suggestions on how to de-normalize Google Trends data? The site says that their trends are made with the following metric: The numbers on the graph reflect how many searches ...
1
vote
0answers
25 views

how to perform divisive hierarchical clustering

I've been trying for a long time to figure out how to perform (on paper) the divisive hierarchical clustering algorithem, however I'm not able to understand how to do it exactly. example: I need to ...
2
votes
1answer
32 views

How verify if a dataset is IID

I have a dataset of 100000 samples. The samples represent the failure time of an electronic component that fails after a given number of "shocks", whatever shock means. We know that these systems fail ...
0
votes
0answers
10 views

Categorical data and different analyses

Why does categorical data have different tests? I know there are many tests for categorical data such as a crosstabs or Chi-Square but why does the data use different tests?
0
votes
0answers
16 views

modelling a data-set using copula

I have a data set and I transform the data set in to matrix within range [0,1]. https://drive.google.com/file/d/0B6wp1DiHTjBBOXJoc1JhRG5VSHM/view?usp=sharing Can anyone explain the steps in ...
1
vote
0answers
105 views

Mesure the impact of two variables

...
1
vote
1answer
29 views

Most appropriate test for my data?

I am strugling with my current science project on how to determine statistical significance among my tested groups. I have however a very basic understanding of statistics and would like to understand ...
1
vote
0answers
21 views

What is the best method for collecting up to date information regarding world-wide birth rates? [closed]

I am attempting to find the current birth rate data for Germany. I am comparing birth rates 40 weeks after World Cup victories to see if there's a correlation between World Cup victories and a ...
1
vote
0answers
18 views

How could these two simple Bayesian algorithms be explained, simply? [closed]

count(this token in class) + 1 / count(all tokens in class) + count( all tokens ) and ...
1
vote
1answer
24 views

Implication of peculiar data set

I've got a dataset which has exactly the same values for the regressors for two of the eight geographical regions but different values for the response variable. What implication does it have on a ...
0
votes
1answer
48 views

How to interpret this normal qq-plot?

I have tried to fit a glm to some weather data and I got this weird qq-plot. What could this possibly mean? I am aware of how various skewed error distribution qq-plots should look like, but what I ...
0
votes
0answers
30 views

Where can I find time-to-event/survival analysis datasets? [on hold]

I have a problem finding datasets that could be used for time-to-event/survival analysis. Could you recommend any good sites? I'd be grateful. Dan
0
votes
1answer
24 views

How to divide dataset into training and test set in Recommender Systems?

I am working on two simple recommender systems - Collaborative (item-item a user-user) and Content Based. I would like to evaluate prediction accuracy of these systems. I am used to divide dataset ...