# Learn backtesting and strategy validation

Guides to the methods that separate a trading edge from a backtest that fits the past.

## Research checks

Start with a backtest, then follow the checks that match your data, validation method and export target.

## Start with a backtest

Define the rules, the data and the split before reading a performance number.

### [How to backtest a trading strategy](https://stochastly.com/learn/how-to-backtest-a-trading-strategy)

A step-by-step method to backtest a trading strategy: data, costs, trade count, out-of-sample tests and the checks that separate an edge from a lucky fit.

Published October 18, 2026

### [In-sample vs out-of-sample testing](https://stochastly.com/learn/in-sample-vs-out-of-sample)

The difference between in-sample and out-of-sample testing in trading, how to split the data, and the mistakes that leak test data into the design.

Published October 18, 2026

### [Walk-forward analysis](https://stochastly.com/learn/walk-forward-analysis)

How walk-forward analysis and walk-forward optimization test a trading strategy on successive unseen windows, with rolling and anchored schemes compared.

Published October 18, 2026

### [Overfitting in trading](https://stochastly.com/learn/overfitting-in-trading)

What overfitting and curve fitting mean for a trading strategy, how to tell an overfit backtest from a robust one, and the tests that measure it.

Published October 18, 2026

## Record signal availability

Check when an observation became available, when a signal was formed and when an order could fill.

### [Look-ahead bias in backtesting](https://stochastly.com/learn/look-ahead-bias)

What look-ahead bias is, how it enters a backtest through data, indicators and Pine Script request.security, and how to detect it before you trade.

Published October 18, 2026

### [Point-in-time data and vintages](https://stochastly.com/learn/point-in-time-data-and-vintages)

How data revisions leak into backtests, how ALFRED vintages recover values as published on a past date, and a revised-signal example worked by hand.

Published October 6, 2026

### [Signal timestamps and execution delay](https://stochastly.com/learn/signal-timestamp-and-execution-delay)

Separate the time a signal is computed from the time its order can fill, with a one-bar shift worked through on daily prices and the latency it omits.

Published October 6, 2026

### [Survivorship bias in backtesting](https://stochastly.com/learn/survivorship-bias-in-backtesting)

How a current survivor list distorts historical backtests, a hand-calculated universe example, and checks for delistings and point-in-time membership.

Published October 6, 2026

### [Transaction costs and slippage](https://stochastly.com/learn/transaction-costs-and-slippage-in-backtesting)

Model commissions, spread and slippage on each fill, calculate net return from a round trip, and test how execution assumptions change results.

Published October 6, 2026

## Test selection and robustness

Separate a repeatable result from a lucky choice among configurations or samples.

### [Parameter robustness in backtesting](https://stochastly.com/learn/parameter-robustness-in-backtesting)

Compare a parameter plateau with an isolated peak, compute a neighborhood average by hand, and relate sensitivity checks to PBO and CSCV.

Published October 18, 2026

### [Purged k-fold and CPCV](https://stochastly.com/learn/purged-k-fold-and-cpcv)

How overlapping labels leak across cross-validation folds, how purging and embargo remove them, and how CPCV forms multiple test paths.

Published October 6, 2026

### [Probability of backtest overfitting (PBO)](https://stochastly.com/learn/probability-of-backtest-overfitting)

What the probability of backtest overfitting (PBO) measures, how combinatorially symmetric cross-validation computes it, and how to read a PBO score.

Published October 18, 2026

### [Multiple testing in trading](https://stochastly.com/learn/multiple-testing-in-trading)

Compare White's Reality Check, Hansen's SPA, Romano-Wolf StepM and the deflated Sharpe ratio with a hand-calculated false-positive example.

Published October 18, 2026

### [Regime change in backtesting](https://stochastly.com/learn/regime-change-in-backtesting)

Test whether a strategy survives changes in return distribution and parameter fit, with a calculated segment example and structural-break diagnostics.

Published October 6, 2026

## Read performance and risk

Select a statistic that fits the question and examine its sampling uncertainty.

### [Sharpe vs Sortino ratio](https://stochastly.com/learn/sharpe-vs-sortino-ratio)

Compare Sharpe and Sortino ratios, calculate each from a small return series, and see why the downside target and observation frequency matter.

Published October 6, 2026

### [Deflated Sharpe ratio](https://stochastly.com/learn/deflated-sharpe-ratio)

What the deflated Sharpe ratio corrects for, its formula from Bailey and López de Prado, and why a high Sharpe ratio after many trials can still be luck.

Published October 5, 2026

### [Minimum track record length](https://stochastly.com/learn/minimum-track-record-length)

Derive minimum track record length from a Sharpe estimate, skewness, kurtosis and confidence level, with the published monthly example reproduced.

Published October 18, 2026

### [Monte Carlo simulation for trading](https://stochastly.com/learn/monte-carlo-simulation-trading)

How Monte Carlo simulation stress-tests a trading strategy, what trade shuffling misses, and why block bootstrap keeps the losing streaks that matter.

Published October 18, 2026

### [Monte Carlo permutation test](https://stochastly.com/learn/monte-carlo-permutation-test)

Define a trading-signal permutation null, compute a finite-sample p-value from shuffled outcomes, and distinguish inference from path simulation.

Published October 18, 2026

### [Prop firm challenge pass probability](https://stochastly.com/learn/prop-firm-challenge-pass-probability)

How to estimate the probability of passing a prop firm challenge from a strategy's own trades, with daily loss limits, maximum drawdown and profit target.

Published October 5, 2026

## Check an export before use

Inspect the simulator and the translation limits of a strategy intended for another platform.

### [Pine Script backtest validation](https://stochastly.com/learn/pine-script-backtest-validation)

How TradingView simulates Pine strategy trades, where historical fills and repainting affect results, and how to test selection before export.

Published October 6, 2026

### [MQL5 Expert Advisor robustness testing](https://stochastly.com/learn/mql5-expert-advisor-robustness-test)

How MetaTrader 5 test modes, genetic optimization and forward periods affect Expert Advisor results, with checks before an MQL5 export.

Published October 18, 2026

### [Export a supported Python strategy to MQL5](https://stochastly.com/learn/python-strategy-to-mql5)

The actual path from a Stochastly strategy graph or supported custom Python signal to MQL5, including translation refusals and parity checks.

Published October 6, 2026

## Continue in Stochastly

[Documentation](https://stochastly.com/docs) explains how the app runs these checks. [Research library](https://stochastly.com/library) traces the methods and source material. [Interactive tools](https://stochastly.com/tools) let you inspect selected calculations.

---
Source: https://stochastly.com/learn
