Train your own drafter: LFM3-1.7B on a P150 got 1.2–1.5× faster, output unchanged
LFM3-1.7BWhy local users should train a draft model for speculative decoding, and how we did it for LiquidAI/LFM3-1.7B: a 157M-parameter DFlash-style drafter trained on one RTX 3090 from the model's own answers, served on a Tenstorrent P150. Single-user prose decode 1.20–1.50× faster, every reply token-for-token identical.
