vllm.models.step5.nvidia.config
¶
Functions:
-
checkpoint_has_step5_sparse_config–Return whether the checkpoint declares a sparse KV layout.
checkpoint_has_step5_sparse_config(config)
¶
Return whether the checkpoint declares a sparse KV layout.
Section presence determines the shared KV layout, even when sparse execution is disabled in the checkpoint.