SAMPLE CASE STUDY
Independent BTC
Strategy Audit
A demonstration of how I examine trading evidence beyond the headline backtest: identifying what appears promising, what remains uncertain, and what should be investigated next.
THE QUESTION
Did the Strategy Really Have an Edge?
The strategy showed positive aggregate out-of-sample performance. Rather than treating that as proof of a dependable edge, the audit examined the evidence for statistical reliability, chronological stability, profit concentration and sensitivity to realistic transaction costs.
22
Walk-Forward OOS Trades
+6.93%
Aggregate Net Return
1.49
Profit Factor
0.4%
Assumed Round-Trip Cost
WHAT THE AUDIT FOUND
Positive Results, But Important Questions Remained
The purpose of the audit was not to label the strategy simply profitable or unprofitable. It was to identify which conclusions were supported by the evidence and where further investigation was justified.
Train/Test Inconsistency
Performance differed substantially between development and test samples, raising questions about stability and regime dependence.
Limited Sample Size
Strong headline test performance was based on relatively few trades, meaning statistical confidence remained limited.
Profit Concentration
A small number of exceptional trades contributed a large proportion of observed profitability.
Chronological Instability
Aggregate walk-forward results were positive, but performance varied considerably between chronological testing windows.
Transaction-Cost Sensitivity
The strategy remained positive under the assumed 0.4% round-trip cost, but the apparent edge weakened materially as costs increased.
EVIDENCE
Looking Beyond a Single Performance Number
AUDIT CONCLUSION
Promising Evidence Was Not the Same as Proof
The strategy survived the assumed transaction costs and produced positive aggregate walk-forward performance. However, the limited sample, chronological instability and concentration of profits meant that the evidence was not yet strong enough to establish a dependable and repeatable trading edge.
The next research question was therefore not simply how to improve the backtest. It was to understand why the strategy worked during certain periods, whether the largest winners shared repeatable characteristics, and whether those conditions could be identified prospectively.
This is a demonstration case study based on internal research and is provided to illustrate the audit methodology. It is not investment advice or a recommendation to trade BTC or any strategy.
YOUR STRATEGY
What Would an Independent Audit Find?
Send me your strategy, backtest or trading evidence. I can begin with a preliminary assessment and identify the highest-value questions to investigate.