australiaen

Data mining

Data mining, also referred to as data dredging, data fishing, data fitting or data snooping, is the misuse of quantitative data analysis to report patterns that can be presented as statistically significant when, in fact, there is no real underlying phenomenon.

P-hacking is a form of data mining. This is usually done by performing large numbers of statistical tests of many different hypotheses on the data, and only reporting the results that can be considered significant in terms of p-value.

Data mining is typically found in medical studies, in fields such as epidemiology or psychology for example, where large datasets are used. But it also used in other scientific disciplines, in particular in finance. In recent years, many prominent academics have warned about the risk of data mining in financial research.

Quantitative investing: invisible layers surface to deliver attractive returns
Quantitative investing: invisible layers surface to deliver attractive returns
Read more
Spring has to come simply because economic fundamentals require it
Spring has to come simply because economic fundamentals require it
How do you perceive the quant equity winter?
26-02-2021 | Interview
We will set five-year carbon footprint reduction goals
We will set five-year carbon footprint reduction goals
Decarbonization in the making.
22-02-2021 | Interview
The quant equity crisis of 2018-2020: Cornered by ‘big growth’
The quant equity crisis of 2018-2020: Cornered by ‘big growth’
The 2018-2020 quant equity crisis posed an exceptional challenge to quantitative managers due to a rare combination of circumstances.
16-02-2021 | Research