australiaen

Data mining

Data mining, also referred to as data dredging, data fishing, data fitting or data snooping, is the misuse of quantitative data analysis to report patterns that can be presented as statistically significant when, in fact, there is no real underlying phenomenon.

P-hacking is a form of data mining. This is usually done by performing large numbers of statistical tests of many different hypotheses on the data, and only reporting the results that can be considered significant in terms of p-value.

Data mining is typically found in medical studies, in fields such as epidemiology or psychology for example, where large datasets are used. But it also used in other scientific disciplines, in particular in finance. In recent years, many prominent academics have warned about the risk of data mining in financial research.

Quantitative investing: invisible layers surface to deliver attractive returns
Quantitative investing: invisible layers surface to deliver attractive returns
Read more
Podcast: Stick to your long-term investment beliefs
Podcast: Stick to your long-term investment beliefs
How tough will 2022 be for investors?
28-01-2022 | Podcast
Factoring carbon taxes into a Value strategy
Factoring carbon taxes into a Value strategy
Incorporating carbon taxes into a Value strategy at a stock level is equivalent to imposing carbon footprint constraints on the overall portfolio.
22-12-2021 | Research
Research on pre-1926 database reveals equity factors are ‘eternal’
Research on pre-1926 database reveals equity factors are ‘eternal’
New research reveals that equity factor styles have existed and persisted since the mid-19th century.
21-12-2021 | Research