Exploratory Data Analysis - EDA Development

EDA Development

Tukey held that too much emphasis in statistics was placed on statistical hypothesis testing (confirmatory data analysis); more emphasis needed to be placed on using data to suggest hypotheses to test. In particular, he held that confusing the two types of analyses and employing them on the same set of data can lead to systematic bias owing to the issues inherent in testing hypotheses suggested by the data.

The objectives of EDA are to:

  • Suggest hypotheses about the causes of observed phenomena
  • Assess assumptions on which statistical inference will be based
  • Support the selection of appropriate statistical tools and techniques
  • Provide a basis for further data collection through surveys or experiments

Many EDA techniques have been adopted into data mining and are being taught to young students as a way to introduce them to statistical thinking.

Read more about this topic:  Exploratory Data Analysis

Famous quotes containing the word development:

    ... work is only part of a man’s life; play, family, church, individual and group contacts, educational opportunities, the intelligent exercise of citizenship, all play a part in a well-rounded life. Workers are men and women with potentialities for mental and spiritual development as well as for physical health. We are paying the price today of having too long sidestepped all that this means to the mental, moral, and spiritual health of our nation.
    Mary Barnett Gilson (1877–?)