vllm.v1.hisparse ¶
Modules:
-
binding–Worker-side wiring of HiSparse caches to attention layers.
-
block_pool– -
coordinator– -
runtime–NVIDIA HiSparse resident, host, and hot-cache data plane.
-
types–
vllm.v1.hisparse ¶Modules:
binding – Worker-side wiring of HiSparse caches to attention layers.
block_pool – coordinator – runtime – NVIDIA HiSparse resident, host, and hot-cache data plane.
types –