Free guide · Oct 8, 2026

Compare a smaller conversation cache fairly

How to check backend support, separate model weights from the conversation cache and plan a fair comparison.

The short version

The AtomicBot llama.cpp fork documents `turbo2`, `turbo3` and `turbo4` KV-cache formats, separate weight formats and a backend support matrix. CPU reference support is described as correctness rather than throughput. The October 1 build is a development prerelease. Publisher compression or speed figures are not measurements on your machine. Repository, releases

What's in the full guide

  1. 011. Separate two kinds of memory
  2. 022. Check the actual backend row
  3. 033. Build an original small answer test
  4. 044. Record a baseline and one changed setting
  5. 055. Read the trade-off before choosing