Sat, Jul 29, 2017
A A A
Welcome Guest
Free Trial RSS
Get FREE trial access to our award winning publications
Alternative Market Briefing

Other Voices: The insidious threat of data mining bias

Wednesday, May 24, 2017

Guest article from Kris Longmore, Founder and Head of Quantitative Research at Quantify:

In the context of systematic trading research, data mining bias refers to the risk of attributing significance to a result that was in fact due to chance. I refer to it as an "insidious threat" because it creeps into the research process naturally and quietly and can have disastrous results if not accounted for. In the extreme, this leads to the decision to trade a losing strategy, but at the very least, neglecting data mining bias leads to inflated and unrealistic performance expectations.

Data mining bias arises due to two fundamental characteristics of trading system research and development. The first is randomness, and the second is sequential comparison, which is the search for the 'best' parameter set.

In any series of trades arising from a given system, the realised performance will have an element of randomness as well as an element due to the inherent edge of the system. If we examine only a single system variant, we have no way of knowing the ratio of the two components. The random component is equally likely to be positive or negative, and in some cases, may be extreme. In any event, this random component results in variation around the long-term expectation of the system.

Sequential comparison and selection leads to the system variant with the best performance in the historical simulation being selected. Consider this selection process in the c......................

To view our full article Click here

Today's Exclusives Today's Other Voices More Exclusives
Previous Opalesque Exclusives                                  
More Other Voices
Previous Other Voices                                               
Access Alternative Market Briefing

 



  • Top Forwarded
  • Top Tracked
  • Top Searched
  1. Oaktree's Howard Marks issues another cautionary tale[more]

    Benedicte Gravrand, Opalesque Geneva: Oaktree's co-chairman Howard Marks' latest memo is another cautionary one that advoca

  2. Months to minutes: Enigma launch aims to boost crypto hedge fund creation[more]

    From Coindesk.com: What if starting a hedge fund was as easy as downloading an API? A startup incubated at MIT Media Lab is today revealing a product designed with this ease-of-use in mind. Called Catalyst, the first product offering by blockchain startup Enigma aims to trigger nothing short of an e

  3. North America - Hedge funds disclose their Puerto Rico debt holdings, US dominates new money portion of Greece's debt sale[more]

    Hedge funds disclose their Puerto Rico debt holdings From Reuters.com: A group of hedge funds that hold about $3 billion of Puerto Rico sales-tax-backed debt released a court filing late on Tuesday that revealed how much of the total amount each fund manages. Decagon Holdings LLC,

  4. $25 million cryptocurrency fund launches to capitalize on the "internet of the future"[more]

    From Coindesk.com: General Crypto, a $25 million cryptocurrency hedge fund, has launched to provide high net worth investors with liquid exposure to the cryptocurrency market and digital assets that they believe could run the technological infrastructure of the future. Since the start of 2017, the t

  5. Other Voices: ICO hell is here (for U.S. investors)[more]

    Chris Kitze Technology Innovator and Investor ICO's surpassed VC funding for blockchain companies in the first half of 2017. Tezos raised $232m in two weeks and Bancor pocketed $153m in just three hours. New coin listings on exchanges have generated eye-popping returns for early investor