Tue, Jan 23, 2018
Welcome Guest
Free Trial RSS
Get FREE trial access to our award winning publications
Alternative Market Briefing

Other Voices: The insidious threat of data mining bias

Wednesday, May 24, 2017

Guest article from Kris Longmore, Founder and Head of Quantitative Research at Quantify:

In the context of systematic trading research, data mining bias refers to the risk of attributing significance to a result that was in fact due to chance. I refer to it as an "insidious threat" because it creeps into the research process naturally and quietly and can have disastrous results if not accounted for. In the extreme, this leads to the decision to trade a losing strategy, but at the very least, neglecting data mining bias leads to inflated and unrealistic performance expectations.

Data mining bias arises due to two fundamental characteristics of trading system research and development. The first is randomness, and the second is sequential comparison, which is the search for the 'best' parameter set.

In any series of trades arising from a given system, the realised performance will have an element of randomness as well as an element due to the inherent edge of the system. If we examine only a single system variant, we have no way of knowing the ratio of the two components. The random component is equally likely to be positive or negative, and in some cases, may be extreme. In any event, this random component results in variation around the long-term expectation of the system.

Sequential comparison and selection leads to the system variant with the best performance in the historical simulation being selected. Consider this selection process in the c......................

To view our full article Click here

Today's Exclusives Today's Other Voices More Exclusives
Previous Opalesque Exclusives                                  
More Other Voices
Previous Other Voices                                               
Access Alternative Market Briefing


  • Top Forwarded
  • Top Tracked
  • Top Searched
  1. Opalesque Exclusive: Statsure Financial launches captive insurer for hedge funds[more]

    Bailey McCann, Opalesque New York: Hedge fund managers have a new option for protecting their business. Launching this week at the annual MFA Conference, Statsure Financial is offering a captive insurance solution for hedge fund managers. Many large companies have captive insurers - insurance

  2. Legal - Former Och Ziff hedge fund executive indicted for fraud in Africa investment scheme, prosecutor says, Hedge fund blasts defense of Puerto Rico restructuring law[more]

    Former Och Ziff hedge fund executive indicted for fraud in Africa investment scheme, prosecutor says From CNBC.com: A former hedge fund executive faces federal charges for defrauding a UK-based charity over investments in Africa, according to a grand jury indictment made public Wednesday.

  3. U.S. economy, inflation and alternative investments to dominate 2018 markets, says family office Wilmington Trust[more]

    Komfie Manalo, Opalesque Asia: The emergence of a late-cycle economy in the U.S., the mystery of inflation and growth from a domestic and global perspective, and the potential for alternative investments to prosper against a backdrop of rich valuations, low yields, and higher volatility are the t

  4. Performance - Some hedge funds deliver double-digit gains for 2017, Brevan Howard's hedge fund suffers biggest annual loss in 2017, Crispin Odey's flagship hedge fund plummeted about 20% in 2017, Profits fall 90% at ex-Morgan Stanley banker's hedge fund, Fannie-Freddie overhaul might mint hedge fund riches, losses[more]

    Some hedge funds deliver double-digit gains for 2017 From Reuters/Investing.com: A handful of hedge funds ended 2017 with double digit returns, their investors said, at a time the $3 trillion industry took in fresh money and posted its best returns in years, industry data show. Act

  5. Investing - Hedge funds start 2018 with record $19 billion bet on the euro, Hedge fund Kora Management invests in Satin Creditcare[more]

    Hedge funds start 2018 with record $19 billion bet on the euro From Reuters.com: Hedge funds have kicked off 2018 with their biggest bet ever on the euro rising, a clear vote of confidence in the single currency but, with positioning so stretched, one which could backfire in the near ter