Most reported anomalies fail to hold up

Most reported anomalies fail to hold up

27-09-2018 | Entrevista
Empirical research should always be taken with a pinch of salt. Lu Zhang is Professor of Finance and The John W. Galbreath Chair at the Fisher College of Business of The Ohio State University. For several years, together with fellow researchers, Kewei Hou and Chen Xue, he has been digging deeper into the robustness of dozens of market anomalies reported in the academic literature. We asked him about this recent work and more generally about factor investing.
  • Yann Morell Y Alcover
    Morell Y Alcover
    Investment Writer

Speed read

  • Most reported market anomalies fail to replicate 
  • This does not discredit factor investing
  • The challenge is to figure out which factors are the most relevant

Your recent research has focused on the replication of numerous academically-reported anomalies in equity markets. Could you explain how this idea came about?

“It took a long while. Kewei, Chen, and I first documented some of the evidence when we were working on our q-factor paper back in 2014.1 At the time, we coded up about 80 anomaly variables, but only 35 were significant. In particular, 12 out of 13 liquidity variables failed to hold up. The editor of our article, Professor Geert Bekaert, deserves a huge amount of credit for guiding our q-factor paper and letting it see the light of day. While editing our work, Geert told us that he found our evidence that so many well-known anomalies are insignificant very important, and wanted us to highlight it more. We did. But since the objective of that article was to establish a new workhorse factor model, we did not make the evidence the centerpiece of the article.”

“Back in 2015, Eugene Fama and Kenneth French responded to our q-factor paper by incorporating two factors that resemble our investment and return on equity factors in the q-factor model into their three-factor model to form a five-factor model.2 And the Factors War was on. We quickly fired back with the working paper ‘A comparison of new factor models’, which compares our q-factor model with their five-factor model on both conceptual and empirical grounds.3 Our key evidence is that the q-factors subsume their CMA and RMW factors, but their factors cannot subsume ours in factor spanning tests.”

“Alas, that paper met with considerable resistance in the editorial process. Knowing very well what it takes to debate with Fama and French on their home turf, we set out to clear a higher hurdle with respect to incremental contribution, by replicating virtually all of the published literature about anomalies. Our initial thought was to compile the largest set of testing portfolios to test factor models, and to hold up our work against the competitive pressure from Fama and French.

“The tremendous amount of respect we have for Fama and French is borne out in the massive effort we put into ‘Replicating anomalies.’ It is probably worthwhile pointing out that we did not set out to beat down the literature on anomalies. We were focusing on the right-hand, not the left-hand side of factor regressions. After three years of coding, it finally dawned on us that most anomalies fail to hold up, 64% to be precise. The evidence is undeniable.”

Manténgase al día de las últimas perspectivas sobre inversión cuantitativa
Manténgase al día de las últimas perspectivas sobre inversión cuantitativa

The resulting paper considers almost 450 anomalies. Such an extensive groundwork must have required a lot of effort. Can you tell us how you went about it? What were the main parameters you changed compared to the original studies and why?

“Professor Chen Xue at the University of Cincinnati is the real hero behind our ‘Replicating anomalies’.4 I went through the published anomalies literature, and wrote a first draft of our data appendix. I knew a lot of the classic anomalies, but needed a refresher course on those documented in the past ten years, so it was not time-consuming for me. It was Chen who painstakingly coded up all 447 anomalies, one-by-one, making sure that we followed the variable definitions in the original studies, and when our replication results differed from those originally reported, making sure we understood why. Professor Kewei Hou went through Chen’s SAS programs to ensure that our empirical execution was of the highest possible quality.”

“In our replication, we emphasized a reliable set of empirical procedures that use NYSE breakpoints and value-weighted portfolio returns. This set of procedures is more reliable because it better captures the economic importance of an anomaly. For comparison, in our June 2017 draft, we also reported results from NYSE-Amex-NASDAQ breakpoints and equal-weighted returns, a procedure that gives microcaps excessive weights. We are currently compiling results from a variety of additional procedures, including cross-sectional regressions.”

And what are the main conclusions you would highlight?

“The main conclusion is that most anomalies fail to replicate. To be precise, only 36% of the anomalies in our large universe withstood the replication tests. The survival rate is largely in line with those reported in other scientific disciplines such as psychology and oncology.”

The challenge is to figure out which factors are the most relevant to forecast returns

Does all this mean that mean investors should disregard factor investing altogether and simply go for passive strategies?

“Not at all. First, the line between active and passive strategies has blurred substantially in the past decade. In the old days, ‘passive’ literally meant holding the market portfolio, and ‘active’ meant everything else. Nowadays, ‘passive’ refers to predetermined algorithm-based strategies, and ‘active’ means there is more human involvement, I think. One may argue that factor investing built on the cross-sectional predictability in finance literature is passive in nature, according to the new definition.”

“Regardless of the passive-active dichotomy, our work does not discredit factor investing at all. On the contrary, we document reliable cross-sectional predictability in a universe in which frictions seem to play a negligible role. When you take 36% of 447, you still get 161 significant anomalies even in value-weighted returns. We show that our latest factor models still leave as many as 46 anomalies unexplained. In short, the future of factor investing is bright! The challenge is to figure out which factors are the most relevant to forecast returns, and that’s the essence of the new ‘active’.”

This article is an excerpt of a longer text published in our Robeco Quarterly magazine. Read the full ‘‘Most reported anomalies fail to hold up" article.

1K. Hou, C. Xue, and L. Zhang 2015, ‘Digesting anomalies: An investment approach’, Review of Financial Studies 28, 650-705.
2E. F. Fama, and K. R. French, 2015, ‘A five-factor asset pricing model’, Journal of Financial Economics 116, 1-22
3K. Hou, C. Xue, and L. Zhang, 2014, ‘A comparison of new factor models’, NBER Working Paper No. 20682, November 2014.
4K. Hou, C. Xue, and L. Zhang, ‘Replicating anomalies,’ NBER Working Paper No. 23394, May 2017.

Los temas relacionados con este artículo son:

Información importante

Los Fondos Robeco Capital Growth no han sido inscritos conforme a la Ley de sociedades de inversión de Estados Unidos (United States Investment Company Act) de 1940, en su versión en vigor, ni conforme a la Ley de valores de Estados Unidos (United States Securities Act) de 1933, en su versión en vigor. Ninguna de las acciones puede ser ofrecida o vendida, directa o indirectamente, en los Estados Unidos ni a ninguna Persona estadounidense en el sentido de la Regulation S promulgada en virtud de la Ley de Valores de 1933, en su versión en vigor (en lo sucesivo, la “Ley de Valores”)). Asimismo, Robeco Institutional Asset Management B.V. (Robeco) no presta servicios de asesoramiento de inversión, ni da a entender que puede ofrecer este tipo de servicios, en los Estados Unidos ni a ninguna Persona estadounidense (en el sentido de la Regulation S promulgada en virtud de la Ley de Valores).

Este sitio Web está únicamente destinado a su uso por Personas no estadounidenses fuera de Estados Unidos (en el sentido de la Regulation S promulgada en virtud de la Ley de Valores) que sean inversores profesionales o fiduciarios profesionales que representen a dichos inversores que no sean Personas estadounidenses. Al hacer clic en el botón “Acepto” que se encuentra en el aviso sobre descargo de responsabilidad de nuestro sitio Web y acceder a la información que se encuentra en dicho sitio, incluidos sus subdominios, usted confirma y acepta lo siguiente: (i) que ha leído, comprendido y aceptado el presente aviso legal, (ii) que se ha informado de las restricciones legales aplicables y que, al acceder a la información contenida en este sitio Web, manifiesta que no infringe, ni provocará que Robeco o alguna de sus entidades o emisores vinculados infrinjan, ninguna ley aplicable, por lo que usted está legalmente autorizado a acceder a dicha información, en su propio nombre y en representación de sus clientes de asesoramiento de inversión, en su caso, (iii) que usted comprende y acepta que determinada información contenida en el presente documento se refiere a valores que no han sido inscritos en virtud de la Ley de Valores, y que solo pueden venderse u ofrecerse fuera de Estados Unidos y únicamente por cuenta o en beneficio de Personas no estadounidenses (en el sentido de la Regulation S promulgada en virtud de la Ley de Valores), (iv) que usted es, o actúa como asesor de inversión discrecional en representación de, una Persona no estadounidense (en el sentido de la Regulation S promulgada en virtud de la Ley de Valores) situada fuera de los Estados Unidos y (v) que usted es, o actúa como asesor de inversión discrecional en representación de, un inversión profesional no minorista. El acceso a este sitio Web ha sido limitado, de manera que no constituya intento de venta dirigida (según se define este concepto en la Regulation S promulgada en virtud de la Ley de Valores) en Estados Unidos, y que no pueda entenderse que a través del mismo Robeco dé a entender al público estadounidense en general que ofrece servicios de asesoramiento de inversión. Nada de lo aquí señalado constituye una oferta de venta de valores o la promoción de una oferta de compra de valores en ninguna jurisdicción. Nos reservamos el derecho a denegar acceso a cualquier visitante, incluidos, a título únicamente ilustrativo, aquellos visitantes con direcciones IP ubicadas en Estados Unidos.

Este sitio Web ha sido cuidadosamente elaborado por Robeco. La información de esta publicación proviene de fuentes que son consideradas fiables. Robeco no es responsable de la exactitud o de la exhaustividad de los hechos, opiniones, expectativas y resultados referidos en la misma. Aunque en la elaboración de este sitio Web se ha extremado la precaución, no aceptamos responsabilidad alguna por los daños de ningún tipo que se deriven de una información incorrecta o incompleta. El presente sitio Web podrá sufrir cambios sin previo aviso. El valor de las inversiones puede fluctuar. Rendimientos anteriores no son garantía de resultados futuros. Si la divisa en que se expresa el rendimiento pasado difiere de la divisa del país en que usted reside, tenga en cuenta que el rendimiento mostrado podría aumentar o disminuir al convertirlo a su divisa local debido a las fluctuaciones de los tipos de cambio. Para inversores profesionales únicamente. Prohibida su comunicación al público en general.

No estoy de acuerdo