Machine learning in trading fails when it is sold as a magic price predictor.
It becomes useful when the trading problem has structure: hidden states, nonlinear interactions, data-heavy microstructure, persistent behaviour, and a clear execution action.
"ML is not a better trader. ML is a better state observer."
The model must change an execution decision.
1. Latent market states.
A market state is not directly visible. You do not observe “stress,” “chop,” “fragility,” or “toxic regime” in raw data. You infer it.
That makes state detection one of the cleanest use cases for machine learning.
- Normal liquidity → liquidity stress
- Trend → chop
- Calm → volatility burst
- Breakout → whipsaw
- Stable quoting environment → toxic passive-fill window
"The value is not prediction for its own sake. The value is knowing whether normal trading logic should still be active."
2. Nonlinear market behaviour.
Many trading rules fail because they are too linear. The same signal can mean opposite things depending on the state.
3. Data-heavy adverse selection.
For a market maker, the real question is simple: if I provide liquidity now, am I earning spread or being picked off?
This is not a charting problem. It is a microstructure problem. The edge is in the interaction between book state, trade flow, quote behaviour, and short-horizon price movement.
"The output should not be buy or sell. The output should be: this is a toxic passive-fill window."
4. In HFT, ML should usually sit outside the critical order path.
A serious HFT desk may reject a black-box model inside the latency-sensitive order loop. But it may accept a monitored ML overlay that changes risk parameters around that path.
- Market data feeds the feature engine
- The ML layer publishes a risk state: normal, caution, stress, toxic
- The quoting engine remains deterministic and latency-safe
- The overlay adjusts spread, size, skew, hedge urgency, inventory limits, and participation rate
5. Persistent and clustered behaviour.
Volatility clusters. Liquidity stress clusters. Momentum and chop cluster. Slippage often clusters around specific states.
The useful question is not simply whether risk is high. The useful question is whether stress will disappear quickly or persist for the next 5–30 minutes.
Three traps that destroy trading ML.
The model is ready only when you know when not to trust it.
- Use rolling training instead of one static historical fit
- Test walk-forward, not only random train/test splits
- Track performance by regime, not only overall score
- Monitor feature drift, label drift, relationship drift, and capacity decay
- Run live shadow mode before allowing the model to affect risk controls
- Automatically de-risk when the market is outside the model’s known distribution
Machine learning earns its place in trading when it protects the desk from applying the right strategy in the wrong state. The strongest use case is not predict the next price. It is know when your normal edge is no longer operating under normal conditions.