For Business

Backtesting & Statistics

How to Compare Two Strategies Fairly

A fair comparison of two rules needs the same bars, the same costs, per-trade numbers rather than totals, the gap read against the wobble of each average, and both rules written down before the bars were seen. This paper shows you the five conditions; the idea as two lanes of one running track; two hour-pair rules on the same 135 real days of the euro in 2026, 1.11 pips a trade against 2.18; the scorecard, on which the gap is inside the wobble and one rule was found by looking; and the two Settings tabs on your platform with every field but the Expert identical.

Difficulty
Intermediate
Reading time
5 min
Pages
8
Reviewed by
Saman Rahbar

This paper is locked

Read it in the browser and keep the PDF with Premium, or buy this one paper.

The five conditions

What makes a comparison of two rules fair comes to five conditions. The same bars: one symbol, one timeframe, one start and end, so both rules ran on one tape. The same costs: the same spread and slippage taken off every trade of each. Per-trade numbers rather than totals, because a total rewards the rule that simply trades more. The wobble: the gap between the two averages read against the wobble of each, which is the spread of a trade over the square root of the count. And both rules written down before the bars were seen, or the comparison is a snoop. The example is two hour-pairs on the euro over the same 135 days of 2026: 1.1 pips a trade against 2.2, where a pip is the fourth decimal place of the price, and a gap smaller than the wobble.

Two lanes of one track

Picture a running track with two lanes. Both runners start at the same line and finish at the same line, which is the same bars; both clear the same hurdles, which are the costs; and the dashed line round the outside is the wobble, the margin within which two times are the same time. Two runners timed on different days, on different tracks, over different distances have not raced, and their times cannot be read against each other, however precisely each was clocked. Most strategy comparisons are exactly that, and the five conditions are what turns them into a race.

This paper is locked