Zach Anderson
Mar 13, 2026 17:07
New analysis exhibits backtests utilizing revised on-chain knowledge produce deceptive outcomes. Level-in-time metrics reveal considerably worse real-world efficiency.
That worthwhile buying and selling technique you backtested? It in all probability would not have labored in actual time. Glassnode’s newest analysis demonstrates how retroactively revised on-chain knowledge creates a harmful phantasm of profitability that evaporates when examined towards data merchants truly had entry to.
The analytics agency ran an identical backtests on a easy BTC trade steadiness technique—one utilizing normal historic knowledge, one other utilizing immutable point-in-time (PiT) metrics. Similar sign logic, similar parameters, similar 0.1% buying and selling charges. The outcomes diverged dramatically.
The Hidden Downside with On-Chain Information
Metrics like trade balances aren’t static. They get revised as handle clustering improves and entity labeling updates. That Binance BTC steadiness determine you are for January 15, 2024 might not match what was truly revealed on that date.
While you backtest towards revised knowledge, you are buying and selling on data that did not exist when selections would have been made. This look-ahead bias is especially extreme for metrics depending on entity identification—precisely the type of knowledge many merchants depend on for trade circulate evaluation.
Glassnode’s take a look at technique was easy: go lengthy when the 5-day transferring common of Binance’s BTC steadiness drops beneath the 14-day common (sustained outflows), exit when it crosses again above (outflows reversing). Working from January 2024 by means of March 2026 with $1,000 preliminary capital, the usual backtest confirmed efficiency roughly matching buy-and-hold.
The PiT model informed a distinct story. Whereas each methods tracked equally by means of a lot of 2024, the immutable knowledge model missed the robust November 2024 and March 2025 rallies that the revised-data backtest captured. Cumulative efficiency ended up “significantly decrease,” based on Glassnode.
Why This Issues for Quant Merchants
The implications lengthen past this single technique. Any backtest counting on knowledge topic to revision—trade balances, entity-tagged flows, even buying and selling volumes from exchanges that report with delays—faces the identical contamination danger.
This aligns with broader considerations in quantitative finance about knowledge high quality. Analysis from various knowledge suppliers exhibits PiT methodology prevents a number of bias sorts: look-ahead bias from utilizing future revisions, survivorship bias from datasets that exclude failed entities, and hindsight bias from restated figures.
For crypto particularly, the place on-chain analytics corporations repeatedly refine their entity labeling and clustering algorithms, the revision drawback compounds. A pockets recognized as belonging to Binance right now won’t have been tagged appropriately two years in the past when your backtest assumes you traded on that sign.
The Sensible Repair
Glassnode now gives PiT variants for all metrics by means of their Skilled tier. These append-only datasets lock in every knowledge level because it was initially computed—no retroactive modifications.
The tradeoff is actual: your backtests will possible look worse. However they will replicate what would have truly occurred. For merchants allocating actual capital primarily based on quantitative indicators, that accuracy hole between a flattering backtest and disappointing stay efficiency might be costly.
Earlier than deploying any technique constructed on on-chain metrics, the query is not whether or not the backtest appears worthwhile—it is whether or not you examined towards the info you’d have truly seen.
Picture supply: Shutterstock
