EDA stands for "Exploratory data analysis". Developed by Tukey to contrast w/ *confirmatory* DA (the formal testing of hypotheses), EDA is typically concerned w/ describing data numerically & graphically to make the data easier to understand & to yield new insights.

learn more… | top users | synonyms (1)

0
votes
2answers
54 views

should i take this variable which consist only 1 question in factor analysis? (all other variables are based on multiple questions)

I'm conducting a study on internet shopping adoption. I'm using a structural model from a research paper. My supervisor has asked me to conduct a factor analysis using SPSS. I'm quite weak in stats ...
2
votes
0answers
61 views

The (statistically unsound) exploratory study (no particular hypothesis)

It seems like a proposed study gets penalised if it doesn't also predict the direction of an effect. For instance, if I want to see the effect of a certain medication on happiness ratings, but do not ...
1
vote
0answers
41 views

Exploratory Analysis - finding the most important factor

I have a dataset of 113 variables. In exploratory analysis the first thing I want to know is what are the most important factors on a single variable (revenue). I learned that naive Bayes would ...
14
votes
5answers
214 views

How to keep exploratory analyses of large datasets in check?

When I start an exploratory analysis on a large data set (many samples, many variables), I often find myself with hundreds of derived variables, and tonnes of different plots, and no real way to keep ...
2
votes
2answers
31 views

What are some differences between confirmatory analysis and exploratory analysis?

In confirmatory analysis do you basically just test hypotheses? Then in exploratory analysis you try to generate hypotheses? In general, I know that you can first do exploratory analysis to form ...
1
vote
1answer
49 views

Exploratory factor analysis

I am running exploratory factor analysis and have extracted 3 factors, with items clearly loading on each one. However, it appears to me that the items that have loaded onto the first factor could be ...
0
votes
0answers
44 views

Does confirmatory = inferential, and exploratory = descriptive analysis / statistics?

Reading this webpage, I wonder: Are confirmatory analysis / statistics and inferential analysis / statistics the same concept? Are exploratory analysis / statistics and descriptive analysis / ...
6
votes
2answers
257 views

Is confirmatory vs exploratory statistics “induction vs deduction”?

This webpage says: Inferential Statistics - Deductive Approach Descriptive Statistics - Inductive Approach But I doubt it. If I understand correctly, Inferential Statistics is "given ...
5
votes
1answer
83 views

Is there a branch of statistics that tries to explain “why” the dataset has certain statistical properties?

Suppose I have a big dataset and I compute some statistical summary of it - e.g., the correlation of one dimension with another. I think a reasonable question to ask would be "what data points ...
3
votes
2answers
114 views

Exploratory data analysis vs null hypothesis testing

Why would exploratory data analysis be important to undertake before null-hypothesis tests?
6
votes
1answer
290 views

Variables lack correlation, but have pattern

Below is the graph of two variables, X and Y, each representing count data. N=348. Note the scales of the axes: Y is very approximately lognormal, but X has no decent fit (including Poisson, ...
0
votes
0answers
34 views

Multilevel exploratory factor analysis

We are creating a scale to measure the 'strength of tie' between two people. We conducted a survey where each person was asked to name a number of other people they know. They were then asked to ...
25
votes
5answers
714 views

Data “exploration” vs data “snooping”/“torturing”?

Many times I have come across informal warnings against "data snooping" (here's one amusing example), and I think I have an intuitive idea of roughly what that means, and why it may be a problem. On ...
2
votes
1answer
141 views

Combining Exploratory Factor Analysis with Random Forest for Binary Logistic Regression Feature Selection

For those of you familiar with Exploratory Factor Analysis (EFA) and Random Forest (RF), I have recently had an idea of combining these two methods to reduce the number of potential predictor ...
4
votes
2answers
111 views

Is analysis of existing data always exploratory, or can it be used for hypothesis testing?

This is a question about the rhetoric of describing analysis done using a public data set or any other pre-existing data set. Here is the hypothetical situation: A researcher reports that they have a ...
1
vote
2answers
85 views

How do I perform a multi-state decomposition with interaction effects?

I am trying to perform a decomposition with interaction effects. This paper provides a solution for n-factors where each factor has a binary state (see section 2). I have a problem with 2 factors, ...
1
vote
2answers
99 views

Implications of trying multiple tests for an analysis

Let's say I have a fixed set of data containing one variable. I'm interested in whether the variable shows a difference between two conditions. Now I perform a test and determine a p-value somewhere ...
0
votes
2answers
103 views

Unexpected factor structure in different samples

I have administered a questionnaire to respondents asking about customers' adoption of technology. I want to do an exploratory principal components factor analysis in Stata to form constructs from a ...
0
votes
1answer
68 views

EFA on R: Classifying Observations

I am newbie for R and Stats. I am using EFA in R [psych library] to identify the latent factors underlying my data. I got a reasonable amount of factors matching my purpose. My question is once I ...
2
votes
2answers
330 views

Can I do parallel analysis with any type of exploratory factor analysis/principal component analysis?

I wish to perform parallel analysis to determine how many factors I should extract from my maximum likelihood exploratory factor analysis. I have been referred to a program that calculates the ...
1
vote
0answers
51 views

Designing genomic search strategies for non-coding RNAs using BLAST

I am interested in developing a computational search of some types of non-coding RNAs (ncRNAs) on a new genome. I have some questions related to the nature of my experiment, because it is an ...
1
vote
1answer
143 views

Does the normal probability plot systematically underestimate the mean?

A normal probability plot is defined as a plot of $n$ pairs: ($[100(i-0.5)/n]$ th $z$ percentile, $i$th observation). Theoretically the points should fall close to a straight line with slope ...
0
votes
0answers
26 views

Finding kind of dependency

I have an interesting (to me) real-life problem but only a very basic understanding of statistics. I would appreciate a pointer to literature as I understand actually solving the problem is my ...
1
vote
1answer
144 views

Exploratory data analysis for discrete data

I am using a probit and a logit model for obtaining the choice probabilities of some data. What kind of plots can be useful to conduct a exploratory data analysis for these data? Here is the ...
4
votes
1answer
94 views

Analysis of binary variables

I have a data set consisting of about a quarter-million objects, each of which may have any of 30 particular features. So I might have Object 1: feature 3, feature 7 Object 2: feature 3, feature 29, ...
3
votes
2answers
104 views

Whether to exclude a case from two analyses when the case is only an outlier in one?

I have a question regarding the elimination of participant data for two statistical analyses on the same sample. Here is a bit of background information: I collected data from one sample (n = 181 ...
1
vote
0answers
81 views

Sample size for EFA

Looked but could not find so I apologize if this is a repeat of a question already asked - Can I conduct an EFA with an N of 180 and 70 variables? I say NO but my advisor still wants me to do it. ...
1
vote
2answers
777 views

Do data transformations before factor analysis need to be consistent across different variables?

(This question continues the previous one) I am creating a questionnaire, and I have identified 3 questions which are skewed (2 positively skewed & 1 negatively skewed). I successfully ...
4
votes
1answer
1k views

Are data transformations on non-normal data necessary for an exploratory factor analysis when using the principal axis factoring extraction method?

I am developing a questionnaire to measure four factors which constitute spirituality, and I would like to ask the following question: Are data transformations on non-normal data necessary for an ...
1
vote
1answer
3k views

Exploratory factor analysis - promax & factor cross-loadings

I have a question regarding the best practice for dealing with cross-loadings on factors after conducting an exploratory factor analysis using a promax rotation. Just to give a bit of background ...
8
votes
2answers
262 views

What are some good exploratory analysis and diagnostic plots for count data?

Does anyone know of good reference material on exploratory analysis and diagnostic plots for count data?
3
votes
1answer
137 views

When do I need a model?

Considering the scenarios of exploring data, predicting (in the range of predictors), extrapolating and explaining- for which would one need a model? When can one do without one? [Edit] By "model" I ...
7
votes
2answers
3k views

Difference between exploratory and confirmatory factor analysis in determining construct independence

Researchers often use two measures that have very similar items and argue that they measure different things (e.g., "I always worry when I am around cars"; "I am fearful of cars"). Lets call the ...
4
votes
1answer
78 views

Can complex sampling be ignored for exploratory patient-centered analyses?

Hello fellow StackExchange users, Preamble: I have been tasked with performing a cluster analysis (or possibly a latent class analysis, as I am pondering) to find non-overlapping groups of like ...
6
votes
1answer
694 views

OLS vs. logistic regression for exploratory analysis with a binary outcome

In the idealized logistic model, we obtain an S-shaped curve linking each continuous IV to the DV. But in practice this infrequently happens, making the logistic approach seem a little less superior ...
3
votes
2answers
341 views

Panel-data exploratory data analysis

I have a dataset for around 40k firms over fiscal years 1950-2011 with about 430k firm-years. If I'm not mistaken I have panel-data. In addition, the firms are nested within 9 industries. I created a ...
1
vote
2answers
891 views

R package for visualizing and exploring large datasets

I recently read about a package, which I believe had a name like "tabstat" or "tablestats" which produced a really useful plot of univariate distributions of multiple variables for large datasets. I ...
1
vote
1answer
475 views

How to draw a side-by-side plot mentioned in “Graphical Display as an Aid to Analysis”

Emerson, J. D. (1991) Graphical Display as an Aid to Analysis, in Fundamentals of Exploratory Analysis of Variance (eds D. C. Hoaglin, F. Mosteller and J. W. Tukey), John Wiley & Sons, Inc., ...
3
votes
1answer
2k views

Panel data descriptives, plots and 'feel for the data'

Allright, so I have a dataset for around 40k firms over fiscal years 1950-2011 with about 430k firm-years. If I'm not mistaken I have panel data. I created a unique identifier ...
24
votes
4answers
2k views

Modern successor to Exploratory Data Analysis by Tukey?

I've been reading Tukey's book "Exploratory Data Analysis". Being written in 1977, the book emphasizes paper/pencil methods. Is there a more 'modern' successor which takes into account that we can ...
8
votes
3answers
476 views

First quick glance at a dataset

Please pardon my ignorance, but... I keep finding myself in a situation, where I'm faced with a bunch of new data I managed to find. This data usually looks something like this: ...
0
votes
2answers
383 views

Which type of regression analysis should I use for consumption pattern data?

I conducted a survey asking people of various income groups about their annual expenditure under various consumption brackets such as food, clothing, housing etc. I then calculated the amount spent by ...
12
votes
2answers
339 views

Are there differences in Bayesian and frequentist approaches to EDA?

Very simply put: Are there any differences in Bayesian and Frequentist approaches to Exploratory Data Analysis? I know of no inherent biases in EDA methods as a histogram is a histogram, a ...
8
votes
6answers
1k views

R package for identifying relationships between variables

Is there an R package that I can use to explore whether there exist relationships between variables? Typically when I am looking for patterns I look at correlations, and then a facet plot. Then I ...
2
votes
1answer
2k views

Tukey's Hinges: Grouping Data

I am having trouble figuring out how to group data using the inter-quartile ranges calculated with a box and whiskers plot as well as looking at Tukey's Hinges. I understand the IQR and Tukey's hinges ...
4
votes
2answers
305 views

What to do with a small (27) medical dataset?

I'm working with a lot of data that was collected by obstetricians regarding the health of infants (birth weight, gestational age at delivery, mother's BMI), and I am trying to connect this data with ...
8
votes
4answers
717 views

Tips and tricks to get started with statistical modeling?

I work in the field of data mining and have had very little formal schooling in statistics. Lately I have been reading a lot of work that focuses on Bayesian paradigms for learning and mining, which ...
4
votes
1answer
560 views

Data mining algorithm suggestion

I would like to use data mining to try to find a good workout schemes. The input dataset will contain the parameters of a set of workouts with dates and different performance and medical measures. The ...
31
votes
7answers
3k views

Graphical data overview (summary) function in R

I'm sure I've come across a function like this in an R package before, but after extensive Googling I can't seem to find it anywhere. The function I'm thinking of produced a graphical summary for a ...
19
votes
2answers
1k views

How to cope with exploratory data analysis and data dredging in small-sample studies?

Exploratory data analysis (EDA) often leads to explore other "tracks" that do not necessarily belong to the initial set of hypotheses. I face such a situation in the case of studies with a limited ...