Contents Menu Expand Light mode Dark mode Auto light/dark, in light mode Auto light/dark, in dark mode Skip to content
KVBoost
Logo
KVBoost

Getting Started

  • Quick Start
  • Installation

User Guide

  • Recompute Strategies
  • KV Cache Quantization
  • Batch Inference
  • Disk Cache Tier
  • Model Compatibility

Benchmarks

  • Benchmark Results
  • KVBoost vs vLLM Prefix Caching

Architecture

  • Architecture Overview
  • Cache Key Design

API Reference

  • Engine API
  • Data Structures
  • Cache Manager
  • Internal Modules

Development

  • Changelog
Back to top
Copyright © 2025, Srihari Unnikrishnan
Made with Sphinx and @pradyunsg's Furo