Structured data files in any format, collected together with the documentation that explains their production or use.

learn more… | top users | synonyms (1)

0
votes
0answers
10 views

MLE for panel data

I am a beginner in statistics, so please don't mind if this question sounds elementary. I am trying to analyze monthly panel data with number of hospital admits in a town. I have data for ~5000 ...
0
votes
0answers
8 views

Datasets with a specific decision structure [on hold]

I'm looking for classification datasets where the prediction variable has a certain structure, i.e. if the possible prediction outcomes are natural numbers between 1 and 10, the user is more preferred ...
0
votes
0answers
51 views

Understand data scientist's responsibilities [on hold]

Is there anyone who can help me to understand more in depth the data scientist's responsibilities: Responsibilities (use data and build models to): Discover the customer, rediscover the ...
0
votes
1answer
21 views

De-normalizing Google Trends data?

Does anybody have suggestions on how to de-normalize Google Trends data? The site says that their trends are made with the following metric: The numbers on the graph reflect how many searches ...
0
votes
0answers
7 views

how to perform divisive hierarchical clustering

I've been trying for a long time to figure out how to perform (on paper) the divisive hierarchical clustering algorithem, however I'm not able to understand how to do it exactly. example: I need to ...
2
votes
1answer
29 views

How verify if a dataset is IID

I have a dataset of 100000 samples. The samples represent the failure time of an electronic component that fails after a given number of "shocks", whatever shock means. We know that these systems fail ...
0
votes
0answers
4 views

how to generate data stream from a flat file (.arff). [on hold]

I have a data set in arff format. Hope anyone can guide me on how to generate stream from this flat file.
0
votes
0answers
9 views

Categorical data and different analyses

Why does categorical data have different tests? I know there are many tests for categorical data such as a crosstabs or Chi-Square but why does the data use different tests?
0
votes
0answers
11 views

modelling a data-set using copula

I have a data set and I transform the data set in to matrix within range [0,1]. https://drive.google.com/file/d/0B6wp1DiHTjBBOXJoc1JhRG5VSHM/view?usp=sharing Can anyone explain the steps in ...
1
vote
0answers
80 views

Mesure the impact of two variables

...
1
vote
1answer
25 views

Most appropriate test for my data?

I am strugling with my current science project on how to determine statistical significance among my tested groups. I have however a very basic understanding of statistics and would like to understand ...
1
vote
0answers
17 views

What is the best method for collecting up to date information regarding world-wide birth rates? [on hold]

I am attempting to find the current birth rate data for Germany. I am comparing birth rates 40 weeks after World Cup victories to see if there's a correlation between World Cup victories and a ...
1
vote
0answers
16 views

How could these two simple Bayesian algorithms be explained, simply? [closed]

count(this token in class) + 1 / count(all tokens in class) + count( all tokens ) and ...
1
vote
1answer
23 views

Implication of peculiar data set

I've got a dataset which has exactly the same values for the regressors for two of the eight geographical regions but different values for the response variable. What implication does it have on a ...
1
vote
0answers
7 views

Data frame manoeuvre [migrated]

Suppose I have the following dataframe: ...
0
votes
0answers
8 views

How to merge two datasets in R? [migrated]

Okai, so i'm a pretty decent R- programmer, working in it like 3/5 days a week and for the last week I ran into a rather unique problem. I work in R-studio, where I was unable to merge the datasets ...
-1
votes
0answers
22 views

How to analyze association when records have repeated identifiers?

I have the following database (with English translations of field names at the top): ...
0
votes
1answer
38 views

How to interpret this normal qq-plot?

I have tried to fit a glm to some weather data and I got this weird qq-plot. What could this possibly mean? I am aware of how various skewed error distribution qq-plots should look like, but what I ...
0
votes
0answers
19 views

Where can I find time-to-event/survival analysis datasets?

I have a problem finding datasets that could be used for time-to-event/survival analysis. Could you recommend any good sites? I'd be grateful. Dan
0
votes
0answers
8 views

How to divide dataset into training and test set in Recommender Systems?

I am working on two simple recommender systems - Collaborative (item-item a user-user) and Content Based. I would like to evaluate prediction accuracy of these systems. I am used to divide dataset ...
1
vote
2answers
37 views

Regression analysis or Structural Equation Modelling

I have a 26 items questionnaire refined by running Common Factor Analysis. As a result, I got 4 factors (f1, f2, f3, f4). Each factor is measured by 6-7 items in the questionnaire. These four ...
0
votes
0answers
17 views

The difference between a referenced & an experimental data set (both 20 data). Application: protein quality (PDCAAS / AAS) in Nutritional Science

I'll start with the actual statistical question, which is rather short. Then, I will expand a bit by showing the context from which the question is coming (which is nutritionology). The more abstract ...
1
vote
1answer
21 views

When there is difference between component variables and the sum, which should be chosen?

Assume a simple example: A survey asks people how much they spent in the last week in total amount and in individual days. As a hypothetical response, one may answered that the Total amount = 10 and ...
0
votes
0answers
7 views

Mathematica: issues storing nested list on disk [migrated]

having trouble with mathematica using nested lists. I want to save a list like this: l1={{a1,{a,b,c,d,e}},{a2,{f,g,h,i}}} So, the nested components do not have ...
3
votes
1answer
31 views

Statistics test to check for a correlation between two groups

I have The number of dispensed items per year and the cost per item - the graphs look as if when the number of dispensed items increase the cost comes down per item (red = cost, blue = number ...
-1
votes
0answers
13 views

misclassification rate in clusters [duplicate]

Hi I am trying to group 40 column vectors into 4 clusters using k-means. how do I compute the misclassification rate of these clusters
0
votes
0answers
10 views

Filling in “gaps” in Sample data from universal data

Quick background - I have a BS in mathematics, and have just recently started a position related to data science (nothing heavy, but requires enough simple statistical analysis that I find myself ...
1
vote
1answer
23 views

Independence of Data in Regression Analysis

Let’s say we will investigate if there is a relationship between the minimum wage and unemployment. For this, we will use the data that belong to all the states over last four years. Should we take ...
2
votes
2answers
26 views

How best to communicate uncertainty due to data quality and measurement issues

This question is coming from a business background. I want to focus here on issues that occur within a business (or perhaps academic) background which are usually difficult to quantify but it is ...
1
vote
1answer
54 views

Setting up dataset for Cox regression with time-dependent variables

I posed a question about how to set up the code for this question here (SAS/proc phreg code) and @Fomite suggested that I pose a separate question about whether my data are set up correctly. ...
0
votes
1answer
44 views

What is the benefit of using Manhattan distance for K-medoid than using Euclidean distance?

Please give me the reasons. I didn't find any k-medoid example that's calculation is done using Euclidean distance. All examples are made of Manhattan distance for k-medoid.
2
votes
0answers
18 views

GradientBoostClassifier(sklearn) takes very long time to train

I'm using dataset with 61879 datapoints and 102 features. On this dataset Randomforest(sklearn) takes less than 90s to train for 100 estimators while GradientBoostClassifier(sklearn) is taking forever ...
1
vote
0answers
24 views

Shapiro-Wilk Output [duplicate]

I have data comprised into different variables (between females and males, measurements of body fat through 3 different methods) and after running a shapiro-wilk test, the output tells me parts of the ...
2
votes
0answers
18 views

Calculate the Hamming Distance between the two same datasets

How to Calculate the Hamming Distance between two datasets of same points?Both the data sets look exactly the same. http://postimg.org/image/u11qnsolh/ There are two datasets of same number of ...
-1
votes
1answer
34 views

convert categorical data into numerical data? [closed]

I am doing project for post graduation....project is document clustering.in the project raise the problem is the text data convert into the numerical data?
3
votes
1answer
38 views

Getting an Excel file with many sheets into R [closed]

I am importing data from an Excel file that contains 15 sheets. Each sheets represent a year in which there are observations on the same variables. Here is what I would like to do (elgantly) from R: ...
1
vote
0answers
27 views

Using single line chart with multiple, unrelated, data sets?

I would like to visualize two unrelated sets of data using a single line chart to check for any "correlation" (it's just for fun - nothing that claims to be statistically accurate). Just as an ...
1
vote
0answers
38 views

Slope analysis where one group is not normally distributed

I am currently doing analysis of five separate drug groups and their changes in levels of prescription over time. Having done linear regression on excel I am comparing the 'steepness' (m) of the ...
0
votes
0answers
5 views

trying to figure out how to make a suggestion given some input

I want to be able to express as a value (say 1-10 as an example), the strength of a suggestion that a person should do X tommorow. The rules are they should only do X in any 6 consecutive days out of ...
0
votes
0answers
20 views

Sparsity of the matrix

We got a matrix of 500 users and 30 tracks. This matrix is complete full (it means every user rated explicit all 30 tracks). Every row is a combination of user id, music id and rating. Every user + ...
0
votes
0answers
12 views

Is there any program that can simulate streams of hash-tags sets?

More specifically I need a stream of fictional hash-tag sets more like the one that twitter emits. I am aware that twitter lets you use 1% of its data. However, that won't be useful for testing ...
0
votes
0answers
20 views

Multiple time points, relation between quantified change in environment and sample population

For a current research, I'm trying to view a relation between a country-level variable index and the financial structure of companies in that country over time. I have annual data for four years, ...
2
votes
1answer
47 views

Validation of machine learning algorithms implementation

What are some techniques by which we can verify that a current implementation of a machine learning algorithm is correct? Is using the results of a benchmark dataset is enough?
0
votes
0answers
22 views

combining samples from different gamma distributions normalized by means

I'm trying to figure out what to do with some experimental data from a psychoacoustic experiment. The data come from multiple subjects and are approximately gamma distributed; I am treating them as ...
0
votes
1answer
26 views

Designing an experiment for a marketing campaign using Incremental Response Modelling

I have the following hypothetical question, can anyone provide some clarification? I'm looking at designing an experiment or modelling what steps can be taken to maximise the Net Incremental Revenue ...
0
votes
0answers
16 views

Statistically adjust data

I am wondering if there are any existing techniques to support adjusting a data variable (e.g., price) using another data variable (e.g., market price). As we know that price for a product is usually ...
0
votes
0answers
13 views

scoring/predicting for new observations

I have two data sets of variables where one of them - the new observations - has no dependent variable. The data set without a dependent variable has around 20 times the number of records. ...
1
vote
2answers
53 views

Constructing a data set for visualization

I am enrolled in a data analysis course and part of a course, I need to find a time series data set and generate visualizations and predictions based on my understanding of the findings. Instead of ...
4
votes
1answer
45 views

How to make an effective sampling from a database of text documents?

Problem: I want to know methods to perform an effective sampling from a database. The size of the database is about 250K text documents and in this case each text ...
0
votes
0answers
31 views

Prove or disprove hypotheses [duplicate]

[removed, apparently its duplicated question..]