APC, SD, and SF

Explanation of Automatic Prefix Caching (APC), Speculative Decoding (SD), and Split Fuse (SF).

Jan-13-2025 · 2 min · 394 words · jamesnulliu