Exploratory Data Analysis - EDA Development

EDA Development

Tukey held that too much emphasis in statistics was placed on statistical hypothesis testing (confirmatory data analysis); more emphasis needed to be placed on using data to suggest hypotheses to test. In particular, he held that confusing the two types of analyses and employing them on the same set of data can lead to systematic bias owing to the issues inherent in testing hypotheses suggested by the data.

The objectives of EDA are to:

  • Suggest hypotheses about the causes of observed phenomena
  • Assess assumptions on which statistical inference will be based
  • Support the selection of appropriate statistical tools and techniques
  • Provide a basis for further data collection through surveys or experiments

Many EDA techniques have been adopted into data mining and are being taught to young students as a way to introduce them to statistical thinking.

Read more about this topic:  Exploratory Data Analysis

Famous quotes containing the word development:

    Understanding child development takes the emphasis away from the child’s character—looking at the child as good or bad. The emphasis is put on behavior as communication. Discipline is thus seen as problem-solving. The child is helped to learn a more acceptable manner of communication.
    Ellen Galinsky (20th century)