Sun, Sep 24, 2017
A A A
Welcome Guest
Free Trial RSS
Get FREE trial access to our award winning publications
Alternative Market Briefing

Other Voices: The insidious threat of data mining bias

Wednesday, May 24, 2017

Guest article from Kris Longmore, Founder and Head of Quantitative Research at Quantify:

In the context of systematic trading research, data mining bias refers to the risk of attributing significance to a result that was in fact due to chance. I refer to it as an "insidious threat" because it creeps into the research process naturally and quietly and can have disastrous results if not accounted for. In the extreme, this leads to the decision to trade a losing strategy, but at the very least, neglecting data mining bias leads to inflated and unrealistic performance expectations.

Data mining bias arises due to two fundamental characteristics of trading system research and development. The first is randomness, and the second is sequential comparison, which is the search for the 'best' parameter set.

In any series of trades arising from a given system, the realised performance will have an element of randomness as well as an element due to the inherent edge of the system. If we examine only a single system variant, we have no way of knowing the ratio of the two components. The random component is equally likely to be positive or negative, and in some cases, may be extreme. In any event, this random component results in variation around the long-term expectation of the system.

Sequential comparison and selection leads to the system variant with the best performance in the historical simulation being selected. Consider this selection process in the c......................

To view our full article Click here

Today's Exclusives Today's Other Voices More Exclusives
Previous Opalesque Exclusives                                  
More Other Voices
Previous Other Voices                                               
Access Alternative Market Briefing

 



  • Top Forwarded
  • Top Tracked
  • Top Searched
  1. iCapital Network enters deal to acquire innovative U.S. private equity access fund platform from Deutsche Bank[more]

    Komfie Manalo, Opalesque Asia: Financial technology platform iCapital Network has entered into a definitive purchase agreement to acquire the US Private Equi

  2. Asia - Hedge funds used to love shorting China. Now, not so much, Fledgling China FoFs require careful use: NCSSF, Amac, Japanese banks turn to PE, hedge funds for returns[more]

    Hedge funds used to love shorting China. Now, not so much From Bloomberg.com: A sharp devaluation. A credit crisis. And an economic hard landing. That's what some of the biggest names in the hedge fund industry were predicting for China after the nation's stocks and currency tumbled in 2

  3. Launches - Orchard launches new credit platform, ETN based on hedge fund to launch on the LSE[more]

    Orchard launches new credit platform Orchard Platform has rolled out Deals as a part of its new platform launch. With the addition of Deals to their suite of technology solutions for loan originators and institutional investors, Orchard Platform takes the next step in their evolution. De

  4. Neuberger Berman closes $1.1bn Credit Opportunities Fund[more]

    Neuberger Berman, a private, independent, employee-owned investment manager, announced that NB Private Equity Credit Opportunities Fund LP closed on $1.1 billion of limited partner commitments. The Fund seeks to invest in the secured and unsecured debt of private equity-backed companies, primarily i

  5. Capital Dynamics launches mid-market private credit business[more]

    Capital Dynamics, a global private asset manager, has launched a dedicated Private Credit Asset Management business. Experienced industry executives Jens Ernberg and Thomas Hall have joined Capital Dynamics to co-lead the company's new private credit initiative. They are based in Capital Dynamics' N