EDA stands for "Exploratory data analysis". Developed by Tukey to contrast w/ *confirmatory* DA (the formal testing of hypotheses), EDA is typically concerned w/ describing data numerically & graphically to make the data easier to understand & to yield new insights.
0
votes
2answers
62 views
Unexpected factor structure in different samples
I have administered a questionnaire to respondents asking about customers' adoption of technology. I want to do an exploratory principal components factor analysis in Stata to form constructs from a ...
0
votes
1answer
30 views
EFA on R: Classifying Observations
I am newbie for R and Stats. I am using EFA in R [psych library] to identify the latent factors underlying my data. I got a reasonable amount of factors matching my purpose.
My question is once I ...
2
votes
2answers
67 views
Can I do parallel analysis with any type of exploratory factor analysis/principal component analysis?
I wish to perform parallel analysis to determine how many factors I should extract from my maximum likelihood exploratory factor analysis. I have been referred to a program that calculates the ...
1
vote
0answers
42 views
Designing genomic search strategies for non-coding RNAs using BLAST
I am interested in developing a computational search of some types of non-coding RNAs (ncRNAs) on a new genome. I have some questions related to the nature of my experiment, because it is an ...
0
votes
1answer
67 views
Normal probability plot systematically underestimates the mean?
A normal probability plot is defined as a plot of $n$ pairs:
($[100(i-0.5)/n]$ th $z$ percentile, $i$th observation).
Theoretically the points should fall close to a straight line with slope ...
0
votes
0answers
24 views
Finding kind of dependency
I have an interesting (to me) real-life problem but only a very basic understanding of statistics.
I would appreciate a pointer to literature as I understand actually solving the problem is my ...
1
vote
1answer
123 views
Exploratory data analysis for discrete data
I am using a probit and a logit model for obtaining the choice probabilities of some data. What kind of plots can be useful to conduct a exploratory data analysis for these data?
Here is the ...
0
votes
0answers
22 views
Determine relationship of habitat features to classification on an already classified dataset
I have a dataset of habitat classifications that were classified using canopy trees ratios. I have the associated understory characteristics (leafy forest floor plants, short shrubs, mosses, etc) that ...
4
votes
1answer
83 views
Analysis of binary variables
I have a data set consisting of about a quarter-million objects, each of which may have any of 30 particular features. So I might have
Object 1: feature 3, feature 7
Object 2: feature 3, feature 29, ...
0
votes
0answers
81 views
Removing noise and distortion from data
I have hundreds of data with peaks which look like this:
My question
On the left and right there is noise which you can see doesn't look anything like the usual peaks. My question is, how I would ...
3
votes
2answers
70 views
Whether to exclude a case from two analyses when the case is only an outlier in one?
I have a question regarding the elimination of participant data for two statistical analyses on the same sample.
Here is a bit of background information:
I collected data from one sample (n = 181 ...
1
vote
0answers
67 views
Sample size for EFA
Looked but could not find so I apologize if this is a repeat of a question already asked -
Can I conduct an EFA with an N of 180 and 70 variables? I say NO but my advisor still wants me to do it.
...
1
vote
2answers
418 views
Do data transformations before factor analysis need to be consistent across different variables?
(This question continues the previous one)
I am creating a questionnaire, and I have identified 3 questions which are skewed (2 positively skewed & 1 negatively skewed). I successfully ...
4
votes
1answer
753 views
Are data transformations on non-normal data necessary for an exploratory factor analysis when using the principal axis factoring extraction method?
I am developing a questionnaire to measure four factors which constitute spirituality, and I would like to ask the following question:
Are data transformations on non-normal data necessary for an ...
1
vote
1answer
1k views
Exploratory factor analysis - promax & factor cross-loadings
I have a question regarding the best practice for dealing with cross-loadings on factors after conducting an exploratory factor analysis using a promax rotation. Just to give a bit of background ...
8
votes
2answers
207 views
What are some good exploratory analysis and diagnostic plots for count data?
Does anyone know of good reference material on exploratory analysis and diagnostic plots for count data?
3
votes
1answer
134 views
When do I need a model?
Considering the scenarios of exploring data, predicting (in the range of predictors), extrapolating and explaining- for which would one need a model? When can one do without one?
[Edit] By "model" I ...
6
votes
2answers
847 views
Difference between exploratory and confirmatory factor analysis in determining construct independence
Researchers often use two measures that have very similar items and argue that they measure different things (e.g., "I always worry when I am around cars"; "I am fearful of cars"). Lets call the ...
4
votes
1answer
64 views
Can complex sampling be ignored for exploratory patient-centered analyses?
Hello fellow StackExchange users,
Preamble: I have been tasked with performing a cluster analysis (or possibly a latent class analysis, as I am pondering) to find non-overlapping groups of like ...
3
votes
1answer
339 views
OLS vs. logistic for exploratory analysis with a binary outcome
In the idealized logistic model, we obtain an S-shaped curve linking each continuous IV to the DV. But in practice this infrequently happens, making the logistic approach seem a little less superior ...
3
votes
2answers
229 views
Panel-data exploratory data analysis
I have a dataset for around 40k firms over fiscal years 1950-2011 with about 430k firm-years. If I'm not mistaken I have panel-data. In addition, the firms are nested within 9 industries.
I created a ...
1
vote
2answers
587 views
R package for visualizing and exploring large datasets
I recently read about a package, which I believe had a name like "tabstat" or "tablestats" which produced a really useful plot of univariate distributions of multiple variables for large datasets. I ...
1
vote
1answer
266 views
How to draw a side-by-side plot mentioned in “Graphical Display as an Aid to Analysis”
Emerson, J. D. (1991) Graphical Display as an Aid to Analysis, in Fundamentals of Exploratory Analysis of Variance (eds D. C. Hoaglin, F. Mosteller and J. W. Tukey), John Wiley & Sons, Inc., ...
3
votes
1answer
1k views
Panel data descriptives, plots and 'feel for the data'
Allright, so I have a dataset for around 40k firms over fiscal years 1950-2011 with about 430k firm-years. If I'm not mistaken I have panel data.
I created a unique identifier ...
19
votes
4answers
927 views
Modern successor to Exploratory Data Analysis by Tukey?
I've been reading Tukey's book "Exploratory Data Analysis". Being written in 1977, the book emphasizes paper/pencil methods. Is there a more 'modern' successor which takes into account that we can ...
8
votes
3answers
391 views
First quick glance at a dataset
Please pardon my ignorance, but...
I keep finding myself in a situation, where I'm faced with a bunch of new data I managed to find. This data usually looks something like this:
...
0
votes
2answers
327 views
Which type of regression analysis should I use for consumption pattern data?
I conducted a survey asking people of various income groups about their annual expenditure under various consumption brackets such as food, clothing, housing etc. I then calculated the amount spent by ...
11
votes
2answers
295 views
Are there differences in Bayesian and frequentist approaches to EDA?
Very simply put: Are there any differences in Bayesian and Frequentist approaches to Exploratory Data Analysis?
I know of no inherent biases in EDA methods as a histogram is a histogram, a ...
7
votes
6answers
841 views
R package for identifying relationships between variables
Is there an R package that I can use to explore whether there exist relationships between variables?
Typically when I am looking for patterns I look at correlations, and then a facet plot. Then I ...
2
votes
1answer
1k views
Tukey's Hinges: Grouping Data
I am having trouble figuring out how to group data using the inter-quartile ranges calculated with a box and whiskers plot as well as looking at Tukey's Hinges. I understand the IQR and Tukey's hinges ...
4
votes
2answers
278 views
What to do with a small (27) medical dataset?
I'm working with a lot of data that was collected by obstetricians regarding the health of infants (birth weight, gestational age at delivery, mother's BMI), and I am trying to connect this data with ...
8
votes
4answers
638 views
Tips and tricks to get started with statistical modeling?
I work in the field of data mining and have had very little formal schooling in statistics. Lately I have been reading a lot of work that focuses on Bayesian paradigms for learning and mining, which ...
4
votes
1answer
510 views
Data mining algorithm suggestion
I would like to use data mining to try to find a good workout schemes. The input dataset will contain the parameters of a set of workouts with dates and different performance and medical measures. The ...
15
votes
2answers
863 views
How to cope with exploratory data analysis and data dredging in small-sample studies?
Exploratory data analysis (EDA) often leads to explore other "tracks" that do not necessarily belong to the initial set of hypotheses. I face such a situation in the case of studies with a limited ...
13
votes
5answers
1k views
A good way to show lots of data graphically
I'm working on a project that involves 14 variables and 345,000 observations for housing data (things like year built, square footage, price sold, county of residence, etc). I'm concerned with trying ...
3
votes
1answer
69 views
How can I adjust classifier to the scale of the other
I have 2 classifiers with different scales. How can I adjust one classifier to the scale of the other without loss of quality?
On the scatter plot we have 2 solutions plotted (x1, x2) against each ...
42
votes
14answers
2k views
Rules of thumb for “modern” statistics
I like G van Belle's book on Statistical Rules of Thumb, and to a lesser extent Common Errors in Statistics (and How to Avoid Them) from Philipp I Good. They address common pitfalls when interpreting ...
