latamen
Most reported anomalies fail to hold up

Most reported anomalies fail to hold up

27-09-2018 | Interview
Empirical research should always be taken with a pinch of salt. Lu Zhang is Professor of Finance and The John W. Galbreath Chair at the Fisher College of Business of The Ohio State University. For several years, together with fellow researchers, Kewei Hou and Chen Xue, he has been digging deeper into the robustness of dozens of market anomalies reported in the academic literature. We asked him about this recent work and more generally about factor investing.
  • Yann Morell Y Alcover
    Yann
    Morell Y Alcover
    Investment Writer

Speed read

  • Most reported market anomalies fail to replicate 
  • This does not discredit factor investing
  • The challenge is to figure out which factors are the most relevant

Your recent research has focused on the replication of numerous academically-reported anomalies in equity markets. Could you explain how this idea came about?

“It took a long while. Kewei, Chen, and I first documented some of the evidence when we were working on our q-factor paper back in 2014.1 At the time, we coded up about 80 anomaly variables, but only 35 were significant. In particular, 12 out of 13 liquidity variables failed to hold up. The editor of our article, Professor Geert Bekaert, deserves a huge amount of credit for guiding our q-factor paper and letting it see the light of day. While editing our work, Geert told us that he found our evidence that so many well-known anomalies are insignificant very important, and wanted us to highlight it more. We did. But since the objective of that article was to establish a new workhorse factor model, we did not make the evidence the centerpiece of the article.”

“Back in 2015, Eugene Fama and Kenneth French responded to our q-factor paper by incorporating two factors that resemble our investment and return on equity factors in the q-factor model into their three-factor model to form a five-factor model.2 And the Factors War was on. We quickly fired back with the working paper ‘A comparison of new factor models’, which compares our q-factor model with their five-factor model on both conceptual and empirical grounds.3 Our key evidence is that the q-factors subsume their CMA and RMW factors, but their factors cannot subsume ours in factor spanning tests.”

“Alas, that paper met with considerable resistance in the editorial process. Knowing very well what it takes to debate with Fama and French on their home turf, we set out to clear a higher hurdle with respect to incremental contribution, by replicating virtually all of the published literature about anomalies. Our initial thought was to compile the largest set of testing portfolios to test factor models, and to hold up our work against the competitive pressure from Fama and French.

“The tremendous amount of respect we have for Fama and French is borne out in the massive effort we put into ‘Replicating anomalies.’ It is probably worthwhile pointing out that we did not set out to beat down the literature on anomalies. We were focusing on the right-hand, not the left-hand side of factor regressions. After three years of coding, it finally dawned on us that most anomalies fail to hold up, 64% to be precise. The evidence is undeniable.”

Stay informed on Quant investing with monthly mail updates
Stay informed on Quant investing with monthly mail updates
Subscribe

The resulting paper considers almost 450 anomalies. Such an extensive groundwork must have required a lot of effort. Can you tell us how you went about it? What were the main parameters you changed compared to the original studies and why?

“Professor Chen Xue at the University of Cincinnati is the real hero behind our ‘Replicating anomalies’.4 I went through the published anomalies literature, and wrote a first draft of our data appendix. I knew a lot of the classic anomalies, but needed a refresher course on those documented in the past ten years, so it was not time-consuming for me. It was Chen who painstakingly coded up all 447 anomalies, one-by-one, making sure that we followed the variable definitions in the original studies, and when our replication results differed from those originally reported, making sure we understood why. Professor Kewei Hou went through Chen’s SAS programs to ensure that our empirical execution was of the highest possible quality.”

“In our replication, we emphasized a reliable set of empirical procedures that use NYSE breakpoints and value-weighted portfolio returns. This set of procedures is more reliable because it better captures the economic importance of an anomaly. For comparison, in our June 2017 draft, we also reported results from NYSE-Amex-NASDAQ breakpoints and equal-weighted returns, a procedure that gives microcaps excessive weights. We are currently compiling results from a variety of additional procedures, including cross-sectional regressions.”

And what are the main conclusions you would highlight?

“The main conclusion is that most anomalies fail to replicate. To be precise, only 36% of the anomalies in our large universe withstood the replication tests. The survival rate is largely in line with those reported in other scientific disciplines such as psychology and oncology.”

The challenge is to figure out which factors are the most relevant to forecast returns

Does all this mean that mean investors should disregard factor investing altogether and simply go for passive strategies?

“Not at all. First, the line between active and passive strategies has blurred substantially in the past decade. In the old days, ‘passive’ literally meant holding the market portfolio, and ‘active’ meant everything else. Nowadays, ‘passive’ refers to predetermined algorithm-based strategies, and ‘active’ means there is more human involvement, I think. One may argue that factor investing built on the cross-sectional predictability in finance literature is passive in nature, according to the new definition.”

“Regardless of the passive-active dichotomy, our work does not discredit factor investing at all. On the contrary, we document reliable cross-sectional predictability in a universe in which frictions seem to play a negligible role. When you take 36% of 447, you still get 161 significant anomalies even in value-weighted returns. We show that our latest factor models still leave as many as 46 anomalies unexplained. In short, the future of factor investing is bright! The challenge is to figure out which factors are the most relevant to forecast returns, and that’s the essence of the new ‘active’.”

This article is an excerpt of a longer text published in our Robeco Quarterly magazine. Read the full ‘‘Most reported anomalies fail to hold up" article.

1K. Hou, C. Xue, and L. Zhang 2015, ‘Digesting anomalies: An investment approach’, Review of Financial Studies 28, 650-705.
2E. F. Fama, and K. R. French, 2015, ‘A five-factor asset pricing model’, Journal of Financial Economics 116, 1-22
3K. Hou, C. Xue, and L. Zhang, 2014, ‘A comparison of new factor models’, NBER Working Paper No. 20682, November 2014.
4K. Hou, C. Xue, and L. Zhang, ‘Replicating anomalies,’ NBER Working Paper No. 23394, May 2017.

Logo

Important information

The Robeco Capital Growth Funds have not been registered under the United States Investment Company Act of 1940, as amended, nor or the United States Securities Act of 1933, as amended. None of the shares may be offered or sold, directly or indirectly in the United States or to any U.S. Person (within the meaning of Regulation S promulgated under the Securities Act of 1933, as amended (the “Securities Act”)). Furthermore, Robeco Institutional Asset Management B.V. (Robeco) does not provide investment advisory services, or hold itself out as providing investment advisory services, in the United States or to any U.S. Person (within the meaning of Regulation S promulgated under the Securities Act).

This website is intended for use only by non-U.S. Persons outside of the United States (within the meaning of Regulation S promulgated under the Securities Act who are professional investors, or professional fiduciaries representing such non-U.S. Person investors. By clicking “I Agree” on our website disclaimer and accessing the information on this website, including any subdomain thereof, you are certifying and agreeing to the following: (i) you have read, understood and agree to this disclaimer, (ii) you have informed yourself of any applicable legal restrictions and represent that by accessing the information contained on this website, you are not in violation of, and will not be causing Robeco or any of its affiliated entities or issuers to violate, any applicable laws and, as a result, you are legally authorized to access such information on behalf of yourself and any underlying investment advisory client, (iii) you understand and acknowledge that certain information presented herein relates to securities that have not been registered under the Securities Act, and may be offered or sold only outside the United States and only to, or for the account or benefit of, non-U.S. Persons (within the meaning of Regulation S under the Securities Act), (iv) you are, or are a discretionary investment adviser representing, a non-U.S. Person (within the meaning of Regulation S under the Securities Act) located outside of the United States and (v) you are, or are a discretionary investment adviser representing, a professional non-retail investor. Access to this website has been limited so that it shall not constitute directed selling efforts (as defined in Regulation S under the Securities Act) in the United States and so that it shall not be deemed to constitute Robeco holding itself out generally to the public in the U.S. as an investment adviser. Nothing contained herein constitutes an offer to sell securities or solicitation of an offer to purchase any securities in any jurisdiction. We reserve the right to deny access to any visitor, including, but not limited to, those visitors with IP addresses residing in the United States.

This website has been carefully prepared by Robeco. The information contained in this publication is based upon sources of information believed to be reliable. Robeco is not answerable for the accuracy or completeness of the facts, opinions, expectations and results referred to therein. Whilst every care has been taken in the preparation of this website, we do not accept any responsibility for damage of any kind resulting from incorrect or incomplete information. This website is subject to change without notice. The value of the investments may fluctuate. Past performance is no guarantee of future results. If the currency in which the past performance is displayed differs from the currency of the country in which you reside, then you should be aware that due to exchange rate fluctuations the performance shown may increase or decrease if converted into your local currency. For investment professional use only. Not for use by the general public.

I Disagree