Backtesting Trading Strategies and Overfitting

A backtest replays a trading rule against historical prices or other market data to estimate how it might have behaved. It is useful for debugging, comparing hypotheses and examining drawdowns, but the researcher chooses the strategy and assumptions after seeing some of the same history. This creates opportunity for look-ahead bias, survivorship bias, data snooping, unrealistic execution and parameter tuning. A strong in-sample result can disappear when costs, delays or later market conditions are included. Bailey and coauthors analyze the probability of backtest overfitting and explain why ordinary holdout methods can be unreliable when many investment configurations are tested. Record all trials, reserve genuinely untouched evaluation periods where possible, use time-aware methods, and estimate performance after fees, slippage, liquidity limits and operational constraints. A later test is not fully independent if choices were repeatedly changed after inspecting it. Avoid using future information, and check whether the historical universe includes assets that later disappeared. Report the test window, data source, parameter-selection process, costs, comparison baseline and uncertainty. If results are advertised, U.S. SEC investment-adviser marketing rules impose conditions on hypothetical performance, including information about assumptions and the audience; applicability depends on the communication and adviser. Backtests are not proof of future returns and do not guarantee that a strategy can be implemented. This guide is educational, not investment advice. The estimate is conditional on the data and assumptions used.