1.
Overview
2.
Build
2.1.
Telemetry(alpha)
3.
Architecture
4.
Structure
5.
Components
5.1.
Router
5.1.1.
Disaggregation
5.1.2.
Exec_Blitz
5.1.3.
Infer
5.1.4.
Migration_queue
5.1.5.
Planner(TODO)
5.1.6.
Colocation(TODO)
5.2.
Client
5.3.
Server
6.
Scripts
6.1.
Args
6.2.
Usage
Example
7.
Example1
Q&A
8.
Questions
9.
Acknowledgement
Light
Rust
Coal
Navy
Ayu
blitzscale-doc
Router
在Huggingface项目Text Generation Inference的基础上，集成blitzscale扩缩容、zigzag与PD分离的逻辑