australiaen

Data mining

Data mining, also referred to as data dredging, data fishing, data fitting or data snooping, is the misuse of quantitative data analysis to report patterns that can be presented as statistically significant when, in fact, there is no real underlying phenomenon.

P-hacking is a form of data mining. This is usually done by performing large numbers of statistical tests of many different hypotheses on the data, and only reporting the results that can be considered significant in terms of p-value.

Data mining is typically found in medical studies, in fields such as epidemiology or psychology for example, where large datasets are used. But it also used in other scientific disciplines, in particular in finance. In recent years, many prominent academics have warned about the risk of data mining in financial research.

Quantitative investing: invisible layers surface to deliver attractive returns
Quantitative investing: invisible layers surface to deliver attractive returns
Read more
Guide to Conservative Investing
Guide to Conservative Investing
Defensive low-risk strategies are designed to exploit the low-risk premium and play an increasingly important role in equity portfolios: by lowering the overall portfolio risk, by further diversifying the equity portfolio, or by offering a defensive approach to dividend investing.
02-02-2023 | Insight
Podcast: The best is yet to come for factor investing
Podcast: The best is yet to come for factor investing
There were few places for investors to hide in 2022, as weakness spread across all asset classes.
01-02-2023 | Podcast
Is swapping a good alternative to divesting?
Is swapping a good alternative to divesting?
Similar to divestment, swapping is a way to establish zero economic exposure to excluded firms.
19-01-2023 | Insight