Tue, Mar 19, 2024
A A A
Welcome Guest
Free Trial RSS pod
Get FREE trial access to our award winning publications
Alternative Market Briefing

Other Voices: The insidious threat of data mining bias

Wednesday, May 24, 2017

Guest article from Kris Longmore, Founder and Head of Quantitative Research at Quantify:

In the context of systematic trading research, data mining bias refers to the risk of attributing significance to a result that was in fact due to chance. I refer to it as an "insidious threat" because it creeps into the research process naturally and quietly and can have disastrous results if not accounted for. In the extreme, this leads to the decision to trade a losing strategy, but at the very least, neglecting data mining bias leads to inflated and unrealistic performance expectations.

Data mining bias arises due to two fundamental characteristics of trading system research and development. The first is randomness, and the second is sequential comparison, which is the search for the 'best' parameter set.

In any series of trades arising from a given system, the realised performance will have an element of randomness as well as an element due to the inherent edge of the system. If we examine only a single system variant, we have no way of knowing the ratio of the two components. The random component is equally likely to be positive or negative, and in some cases, may be extreme. In any event, this random component results in variation around the long-term expectation of the system.

Sequential comparison and selection leads to the system variant with the best performance in the historical simulation being selected. Consider this selection process in the c......................

To view our full article Click here

Previous Opalesque Exclusives                                  
Previous Other Voices                                               
Access Alternative Market Briefing

 



  • Top Forwarded
  • Top Tracked
  • Top Searched
  1. KKR raises $6.4bn for the largest pan-Asia infrastructure fund[more]

    Laxman Pai, Opalesque Asia: The New York-based global investment firm KKR has raised a record $6.4bn for its second Asia-focused infrastructure fund, underlining investors' continued appetite for private markets. According to a media release from the alternative assets manager, the figure top

  2. Bucking the trend, top hedge fund makes plans for a second SPAC[more]

    From Institutional Investor: SPACs aren't dead. At least not to the folks at Cormorant Asset Management. The life sciences firm, whose hedge fund topped its peers in 2023, is confident it will match the success of its first blank-check company. Last week, the life sciences and biopharma speciali

  3. Benefit Street Partners closes fifth fund on $4.7 billion[more]

    Bailey McCann, Opalesque New York: Benefit Street Partners has closed its fifth flagship direct lending vehicle, BSP Debt Fund V, with $4.7 billion of investable capital across the strategy. Benefit Street invests primarily in privately originated, floating rate, senior secured loans. The fun

  4. 4 hedge fund themes that are working in 2024[more]

    From The Street: A poor earnings report from Tesla (TSLA) has not hurt the indexes on Thursday. The decline in Tesla stock, which is losing its position in the Magnificent Seven pantheon, is more than offset by strong earnings from IBM (IBM) and ServiceNow (NOW) . In addition, the much higher-t

  5. Opalesque Exclusive: A global macro fund eyes opportunities in bonds[more]

    Bailey McCann, Opalesque New York for New Managers: Munich-based ThirdYear Capital rebounded in 2023, following a tough year for global macro. The firm's flagship ART Global Macro strategy finished the year up 1