Structured data files in any format, collected together with the documentation that explains their production or use.

learn more… | top users | synonyms (1)

0
votes
0answers
19 views

How to standardize text data for training Neural Networks?

I want to train neural network with text data(natural language) as input for classification purpose. One way for standardizing text data for neural network is to use N-GRAM/SKIP-GRAM representation ...
0
votes
0answers
13 views

How can I download Daum dataset for testing Collaborative Filtering techniques? [on hold]

As you, researchers, know for testing the recommending algorithms (especially those about collaborative filtering). But, newly, I have seen this paper (and after I searched, some more researches), in ...
0
votes
0answers
13 views

Analysing multiple response question

Suppose I have a survey data set, where sample size is n=50. There is a variable on " What do you like about this product? " Answers: a. Less time consuming b. Low weight c. User ...
1
vote
0answers
23 views

Multiple imputation in SPSS: merge datasets?

I have two sets of data, measured from the same persons. The variables in the two sets are very different. There are some extreme values (occurring at random) in both sets I would like to handle using ...
4
votes
2answers
22 views

Do any statistical tests compare distributions when one has significantly fewer samples?

I've been researching different methods to compare two distributions for equality, or inequality rather. I want to compare actual user performance against projected performance, after a particular ...
0
votes
0answers
15 views

dataset for multiple regression? [closed]

I'm looking for a dataset to perform a multiple regression and possibly a PCA. It should have a dependent variable and more than 10 independent variables and possibly interval variable. I have already ...
0
votes
0answers
27 views

I am doing PhD in Finance on the topic “international comovement of stock returns” and want to use panel data Cointegration technique. [closed]

But faces the problem that how will I analyze different countries in panel. For example if I want to find cointegration between European and Asian countries, how can I take these countries in panel to ...
2
votes
0answers
133 views

Linear mixed models or not?

We did a study with a course participants where we have one outcome variable and several metrics calculated for each message they posted on a discussion forum. Basically, the data are structure in the ...
0
votes
0answers
7 views

Is there any repository with interval censored time-to-event datasets?

I'm looking for this particular structure of data for working on my thesis. In particular, I need interval censored with a cure fraction data. This kind is actually popular in medicine and clinical ...
0
votes
0answers
7 views

Good mean shift clustering datasets

I am working on a modification of the Mean Shift algorithm and would like to validate my clustering results. I am struggling to find suitable clustering datasets to compare performance with. I'm ...
0
votes
0answers
14 views

What can I possibly get from my data to find what I need?

I am an end-user of a program. This program returns an output based on an input (a file + a database). I have made a few tests with differents files and databases, then constructed a CSV file of the ...
3
votes
3answers
347 views

How to think about correlation

I have data that looks like this (I am using R): ...
1
vote
0answers
10 views

Variable selection multiple data types

I'm working on a data set containing 45 predictors that cover metric, ordinal and nominal variables. Aiming to finally build a model, which explains the interacting effect of a set of predictor ...
0
votes
2answers
56 views

If the model fits well, nothing can be done?

I am playing a data without any background information. First, I try multiple linear regression. The model fits well, since the $r^2$ is larger than 90%. I deleted several variables by AIC. The fits ...
2
votes
0answers
34 views

Finding the median distribution of many distributions?

I have many customers. Each generates his own distribution of shopping times. Each customer thus has their own empirical distribution of shopping times. If I want to get a sense of the average ...
1
vote
0answers
40 views

Data normalization for a recommender

this question is a copy from DataScience forum. I do hope I will get much more information and help here. At the moment I am doing some data experiments with the Graphlab toolkit. First of all, I ...
2
votes
1answer
44 views

How to interpret a status other than alive or dead in data for survival analysis?

I am working on a famous data set from this book. The data set consists of measurements on 418 patients. I am interested on modelling the variable; futime: number of days between registration ...
1
vote
0answers
22 views

What is robust data?

This is the rather confusing go-to internet definition for robust data: Robust data is data that is constructed to survive and function in multiple settings. It's reusable. It can be updated. Anyone ...
1
vote
0answers
11 views

Find out whether the answer to a question depends on a group

I've distributed a questionnaire to four different groups of people. An example of a question in the questionnaire is: Do you want to be informed about financial topics through social media? Yes/no. ...
1
vote
1answer
35 views

Potatoes in space! - Correlating sets of unordered 4d data

(I asked this question some time back but got no answers or comments. It's a pretty big question so therefore I thought dividing it into several questions might make it easier to answer. The original ...
1
vote
0answers
8 views

Adding exogenous input to data (to expand ARMAX)

I am facing the following problems: 1) I am trying to add an exogenous input to an existing ARMAX model. I already identified a good fitting model with small MSE for my system. ...
1
vote
1answer
29 views

Splines and clinical dataset query

Perhaps off topic or not directly suitable for crossvalidated but does anyone know of a good dataset with a clinical aspect I could use to teach myself how to use regression splines (in R)? I always ...
-1
votes
0answers
5 views

Using googleVis api in java [migrated]

I have used googleVis api in R for dynamic map.Now i am trying to make a small webapp in which servlet access this api and the result is displayed in jsp.But i am not able to access googleVis api from ...
0
votes
1answer
29 views

Fitting a mixture model to spatially correlated data

When the data are spatially correlated, is the usual GMM likelihood function overweighted? The data. Scattering experiment, sensor is like a CCD. Can't see individual events, only density estimate ...
0
votes
1answer
29 views

Similarity datasets

Given two (or maybe more) datasets with the same samples/members, but with different variables. Is there a general way to compare the information available in the two datasets without looking into the ...
0
votes
0answers
5 views

making for making dataset for spam classifier

I'm trying to make a dataset for spam detection, what is the best automatic selection that I can use for picking up the word that should i count for my spam base ? Thank you
0
votes
0answers
18 views

Missing Values in Dependent Variable and the Question on Tobit model (Panel Data)

I would appreciate some help and guidance on this issue. I have a panel data that looks like this. What I want to do is use the FDIflow variable as a dependent ...
0
votes
0answers
12 views

How to merge dating correctly [migrated]

I'm trying to merge 7 complete data frames into one great wide data frame. I figured i have to do this stepwise and merge 2 frames into 1 and then that frame into another so forth until all 7 original ...
1
vote
0answers
23 views

Adding real zeros to a dataset vs. presence-only modeling?

I have a fisheries dataset for which I have calculated the number of fishing sets in each grid cell (100 km x 100 km) for each month of every year. Fishermen in this fishery are legally required to ...
2
votes
1answer
32 views

Publicly available data [closed]

I have some research data (around 300 GB) I want to make publicly available for other researchers. Do you know where can I upload these data?
0
votes
0answers
9 views

Training set wireless forensics tool

I'm working on a wireless forensics tool, starting with simple Dos attack ( de-authentication, disassociation, etc... ) before I start the very exhausting task of making my own training set, I thought ...
1
vote
1answer
33 views

Choosing the correct statistical test

I have two datasets that describe reports of caregivers and parents from 8 daycares. The two data sets are matched by daycare's name. We want to merge the data into a single dataset that will contain ...
2
votes
1answer
76 views

How can I quantify the difference between two categorizations/distributions?

I have a sample of survey data comparing two populations, non-addicts (sample size about 50000) and addicts (sample size about 500). The differences between mental health evaluations of the two ...
0
votes
0answers
23 views

Dataset with mixed structured/unstructured data

I am looking for some mixed-type dataset with free-form textual features along with some structural features (preferably continuous) - labeled, for supervised setting (classification or prediction). ...
0
votes
1answer
30 views

Temporal linkage between two lists of data

I have 2 lists, representing a time series: list_a = [23,43,29,45,6,12,240] list_b = [13,23,11,35,60,52,40] i.e. list_a[0] is ...
0
votes
0answers
21 views

Sufficient data volume for inference

This question was probably discussed before but I failed to find it here. Let's say I have a medical data which contain some biomarker measurements for cases (patients with disease) and controls ...
1
vote
1answer
41 views

Benchmark datasets for testing multiple regression or multivariate regression model?

I have a question as a newbie. I'm working on a tool using regression analysis( linear, multiple, multivariate) to derive a regression model. To verify the correctness of the tool, I'm trying to find ...
1
vote
0answers
15 views

Is data fusion suitable for this application?

I have a situation where the delay vehicles experience at an intersection can be obtained through 3 or 4 types of sensors. Each sensor provides its own type of data with their own unique ...
0
votes
0answers
27 views

What is my chart type called?

I have my main data feed which only collects a new value if it is different from the last (it checks every 13 seconds) and from this I build a line chart. Is there a name for this type of chart? ...
0
votes
0answers
16 views

Null Values in Survey Data

What is the recommended approach for cleaning/preprocessing survey data that contains null values for some responses? An example of some responses are as follows: "Were you treated with respect?" ...
0
votes
0answers
19 views

algorithm to predict cost function

The goal of problem is to predict the weight for missing data . I have a dataset of categorical type as shown below ...
0
votes
0answers
20 views

How to merge overlapping discontinued data time series?

I have two datasets consisting of the US Federal debt held by Federal banks with a timespan covering the period 1953Q1 to 1988Q4 and 1970Q1 to 2014Q2. (series FDHBFRB and FDHBFRBN from the FRED ...
1
vote
1answer
48 views

Can you identify what the sharp spikes in our data could be?

Scenario: There was an online competition to win a prize. The competitors are technology start-up companies and the prize is worth around 5,000 USD. There was a public, online vote to decide the ...
1
vote
1answer
34 views

Publications in the social sciences or psychology based on freely available datasets?

There are a lot of datasets freely available across the web (see CV questions here, here, or here). Yet, I want the reverse: I am looking for a list of publications in the social sciences or ...
6
votes
2answers
98 views

How do I cite the iris dataset in a paper?

I want to use the iris dataset provided by scikit-learn for a paper. But I don't know what the standard for referencing datasets is. What citation should I use for this dataset in my paper? Should I ...
0
votes
0answers
25 views

Have a data set for 3 consecutive days. What are my options?

Let's say I have a set regarding the transportation methods(Eg: car, bus, train) used for three consecutive days b y $n$ number of people. For simplicity let us assume that everyone use only one type ...
0
votes
1answer
32 views

Why does my repeated measures ANOVA analysis vary when I organize my data differently?

In my study there were 63 types of stimuli (63 levels of the IV) and all types had 8 different examples (8 trials per level of IV) which were all categorized by each participant. Accuracy of ...
0
votes
0answers
10 views

Multiple combinations (ex drug-ADR) with the same unique case ID.

I am quite new to R statistics, and I one you can help me. I have tried finding the answer to my question by searching the forum and so on, and I apologize in advance if my question is trivial or ...
0
votes
0answers
44 views

Data structure for Inverse Cumulative Distribution when columns are *NOT* separate variables

I am trying to structure data to conduct a Frequency analysis and output an Inverse Cumulative Distribution histogram for a biomechanics study. The goal is to compare 4 devices with respect to their ...
0
votes
0answers
52 views

What are some of the image classification datasets other than MNIST on which Deep Belief Network (DBN) has produced good results?

What are some of the image classification datasets other than MNIST on which Deep Belief Network (DBN) has produced state-of-the-art results? Even if its not state-of-the-art, but, I am looking for ...