Structured data files in any format, collected together with the documentation that explains their production or use.

learn more… | top users | synonyms (1)

-1
votes
0answers
8 views

less frequent words [on hold]

In my Master project , my target subjects are university students at their first and second year of their teritiary level! i didnt find the plausible set of sentences (and target words) to work on ...
0
votes
0answers
9 views

Animating circle to increase and decrease in size over a period of time - matlab [migrated]

I would like to create a simple visualization whereby the circle (country) will increase/decrease in size(Base on the variables) with respect to time. How can it be done on matlab with my current ...
1
vote
1answer
44 views

How to produce the minimum forecast error using R?

Considering that we want to use optimize() on the interval [0,1] how can I write an R code for finding the value of β that produces the minimum forecast error without using external packages like ...
0
votes
0answers
9 views

Normalization for pattern classification?

I'm working off my first independent project for some pattern classification. I'm utilizing some datasets from UCI machine learning, but am not sure on how to start with data normalization. The data ...
0
votes
0answers
11 views

Relationship between number of Principal components and Exploratory factors.

Would like to know is there any heuristic relationship between the number of components identified from PCA analysis and the number of hidden factors provided by EFA analysis on the same data set?
5
votes
2answers
89 views

Fitting data sample to a distribution

I'm trying to fit a data sample to a distribution. So far I have created a histogram and fitted the data with a lognormal distribution in R and made a Q-Q plot in excel (of log(benefits paid) against ...
-1
votes
1answer
20 views

What will be the process of statistical analysis with Survey data?

I have the survey data of sales force satisfaction and dis-satisfaction . In this data set,there are three to five sub-questions inside to one question. I want to know how can i start the statistical ...
1
vote
1answer
26 views

Statistical Practices Using Sparse Data: Methods for Approximating Standard Deviation

Suppose I know that for a discrete, non-negative r.v. $X$ that $X | X \geq 1$ has $\mu = 3.3$ while when $X \geq 0$ has $\mu = 2.1$. That is, the subset of the population that already has a value ...
1
vote
0answers
13 views

Datasets for some popular books

I'm looking for electronic versions of datasets used in examples and exercises from the following books: Aczel "Complete business statistics" Milliken & Johnson "Analysis of Messy Data" vol.1 ...
5
votes
1answer
85 views
0
votes
1answer
41 views

PCA and exploratory Factor analysis on the same data set

I would like to know if it makes any logical sense to perform principal component analysis (PCA) and exploratory factor analysis (EFA) on the same data set. I have heard professionals expressly ...
1
vote
1answer
28 views

SVM data normalization… what about classifying new (training) data?

I've got a big doubt about SVM classification task (and more in general classification task), about data normalization. Let's suppose I've a SVM trained with normalized data, and new data to classify. ...
2
votes
1answer
38 views

How to extend PDF of normalized sample to original sample?

To calculate the PDF function using Shannon entropy I have scaled my original sample by simply doing $x'=(x-a)/(b-a)$; where $b=\text{max}(x)$, and $a=\text{min}(x)$ and then I found the ...
1
vote
0answers
13 views

Transforming / Evaluating (Probably) Normal Data from Sample with Linear Probability Distribution

I have a sample of data for which the count of a given value increases roughly in proportion to the actual value. For example, the value 22 will occur around 22 times and the value 30 will occur ...
0
votes
0answers
26 views

Generate data based on existing data and their distribution

Consider the following dataset: patient id, gender, age, systolic blood pressure, diastolic blood pressure 1, male, 66, 120, 80 1, male, 66, 119, 83 2, female, 45, 119, 90 3, female, 55, 120, 19 ...
0
votes
0answers
17 views

How to avoid writing the same line several times in R? [migrated]

I'm writing a program in R and I need to select variables based in a particular value of one of the variable. The program is the next: ...
0
votes
1answer
53 views

Why does fitdistr does not work with gamma?

I am tring to find a probability density for some waiting time, but I am having a hard time. Fitdistr does not work with Gamma. Am I missing something? Is there ...
0
votes
1answer
20 views

how to compute minimum required vc dimension for a classifer to classify a specific data

Suppose we're given an N dimensional data to classify. To cope with this task we may choose a classifier that suits our desires more. However obviously not every classifier is capable of classifying ...
0
votes
1answer
29 views

What are the proper ways how to add noise to a dataset? (algorithm data sensitivity analysis)

Consider: dataset defined as n datapoints x_i in m-dimensional space. And there is a label ...
0
votes
1answer
35 views

How to perform text mining on an online news article?

I am new to data mining and currently working on an online news article from TOI. My aim is to get some useful information out of this text which is not clear when you read the article and the most ...
0
votes
0answers
17 views

What is data augmented by the additive inverse?

I am reading Biclustering of expression data (Cheng and Church, 2000) The paper is about the Cheng and Church biclustering algorithm and its main metric, the mean squared residue (MSR). It is said ...
1
vote
0answers
11 views

What sort of feedback button should I implement to measure the difficulty of a task

---background info--- My company has built a Search Engine Optimisation product that can suggest monthly prioritised SEO activities (task suggestions), that will have the most benefit to the end user. ...
1
vote
0answers
22 views

How to handle Missing Data [closed]

Am conducting a study where I teach my participants 10 lessons. After each lesson they have to answer questions to check understanding of the lesson. Some participants missed between 2-4 lessons. How ...
0
votes
0answers
28 views

Extract knowledge from the (possible unrelated) combination of multiple data sets

I am a beginner in this area so please bear with me. I have 2 data sets: information about the cars which were sold in particular area (cost, model, number of seats, manufacturer, etc.) information ...
0
votes
1answer
40 views

reshape data from wide to long in R [duplicate]

I know there are a lot of similiar questions about this topic. But nevertheless I am not able to solve my problem. I want to reshape a dataset of this structure: ...
0
votes
0answers
12 views

Error message using plm in R: Variable length differ [migrated]

I have a problem using the plm-package in R: assuming that data1 is my dataset, I treid to estimate pooled OLS model: ...
0
votes
0answers
12 views

Decision Trees - Test & Training Data Difference

In decision tree modelling what is the difference between Training & Test Data ? i am having some difficulty in locating the meaning of these two words and i hope you guys can help me out. Could ...
2
votes
0answers
16 views

Establishing a strategy to log data processing steps

I am building a database schema for a web application that will collect user feedback on restaurants. As the collection of user feedback grows for each restaurant, I will be analyzing it to assign ...
1
vote
0answers
34 views

How to assess whether IQ predicts emotional experiment more at time 1 or time 2 controlling for covariates?

I have the following data set of a two-wave longitudinal study in educational psychology. A group of 400 people did some questionnaire on IQ, personality and two different emotional states (sadness ...
3
votes
1answer
72 views

How to deal with invalid data values such as with age (e.g., -99, 0, F1)?

I have a data set that consists of 15 age values. I want to clean the data before doing anything further. I have a few questions about data cleaning and data integrity. What is the best treatment if ...
1
vote
0answers
20 views

What do I call a set of datasets

For training a Machine learning model, I have 3 datasets: Training Validation Testing Normally I obtain there by dividing up the full dataset into pieces. I've created a function in my code to ...
0
votes
0answers
27 views

How to reduce the dimension of a test data and make it uncorrelated?

I am working on classification of 16000 cell images. Each of them consists of 706 features related to intensity, morphology, colocalisation and texture of the cell. The train set consists of 11 ...
4
votes
1answer
61 views

What algorithm should I use to cluster a huge binary dataset into few categories?

I have a large (650K rows * 62 columns) matrix of binary data (0-1 entries only). The matrix is mostly sparse: about 8% is filled. I would like to cluster it into 5 groups - say named from 1 to 5. I ...
2
votes
1answer
81 views

Advantages of bootstrapping when calculating mean

I'm a statistically incompetent social scientist who is very much out of my depth... I'm using R to analyse a data set, which is a 1% sample of a population showing cancer rates across 20 regions. ...
2
votes
0answers
33 views

Need some advice on data analysis

I collected data from 500 participants. Here's an example of the data: Response 1: Age: 25 Gender: Male Choice 1: 1 Choice 2: 1 Choice 3: 0 Choice 4: 1 Choice 5: 1 ... Up to choice 30 Response 2: ...
3
votes
1answer
131 views

Statistical analysis on several data sources - possible?

I have a formulation of a statistical problem in mind and haven't been able to find any literature/references about it. As professors that I asked also couldn't help, I thought I'd ask here. Consider ...
0
votes
1answer
19 views

data analysis about data clustering by vector correlation distance

I am working on data analysis. Given a group of data vectors, each of them has the same dimension. Each element in a vector is a floating point number. ...
0
votes
0answers
20 views

Datasets representing image collections

Ive been researched Information Visualization techniques application to image collections. I need some image datasets with features. Ideally, would be good find a dataset in a file representing each ...
2
votes
1answer
30 views

Require some help with biological replications with one extreme outlier

My problem is i have 3 biological replications (reps) withe each having 4-5 technical reps with two of the biological reps having comparable results for the treatment and control. These values ...
0
votes
0answers
37 views

Ordered logistic regression in JAGS

I am estimating a simple ordered logistic regression -- in fact, I am expanding this to a multilevel model, but I cannot get the simple ordinal model to converge. The data are three wave panel data, ...
0
votes
0answers
29 views

How do I report my ranked ordinal data?

I passed out a survey to the community and I am unsure how to properly report the data. The question is: "Rate from 1-5: one being the most important and five being the least important. I will attend ...
0
votes
0answers
16 views

What is grid decomposition?

I'm reading a paper about DBSCAN implementation on Map-Reduce. In preprocessing step, it wants to divide dataset and it says: We consider two strategies in this paper for different scenarios. The ...
1
vote
0answers
42 views

Finding the maximum of unparameterized 2D data

I have a set "Z" of values, one for each combination of (X,Y), given on a grid. I would like to estimate the location of the maximum of Z (expected to lie near the center of the dark blue pixels). ...
0
votes
0answers
32 views

Not Obtaining Expected Correlations with the IBM Synthetic Data Generator

I`m using IBM synthetic data generator to produce a transactional dataset, but i have some problems with the support of the item. Example: C:\ >"IBM Quest Data Generator.exe" lit -ascii -ntrans 10 ...
0
votes
1answer
36 views

Any suggestions for storing diverse data sets for on-line visualization?

We are trying to design a data repository for storing datasets, from many different sources, in such a way that they can easily be used in online data presentations. This data repository will be part ...
1
vote
0answers
42 views

Best data series to teach time series econometrics?

I will be teaching a short course on time-series econometrics to third-year undergraduates. It will be part theoretical, part applied (students using econometrics software). I am looking for great ...
1
vote
1answer
49 views

Difference in meaning of these terms: Dataset vs Corpus

I have a question pertaining to definition of terms that I couldn't find answer for. What's the difference between Dataset and Corpus? I've seen them being used almost interchangeably. My ...
0
votes
0answers
18 views

How to capture a dataset characteristic?

I am working on microaggregation problem, where all records are clustered in groups of a minimum size. We must optimize the sum of the squared error (SSE). As I run my algorithm on forest and ...
1
vote
1answer
43 views

Create a function from a data set when there is one independent variable and 3 dependent

I have a data set which consists of 1.Number of users, 2.Cpu usage, 3.Ram Usage, 4.Response time, The way I understand it Number of users is my independent variable. Is there a way, a method, or a ...
1
vote
0answers
22 views

How can I simulate runtime data containing workflows in R?

I am a PhD student, and I am trying to construct a data set to use for proof of concept for my research. However, I am not sure how to construct the model to simulate the data in R. I want to ...