Skip to content

vllm.models.step5.nvidia.config

Functions:

checkpoint_has_step5_sparse_config(config)

Return whether the checkpoint declares a sparse KV layout.

Section presence determines the shared KV layout, even when sparse execution is disabled in the checkpoint.

Source code in vllm/models/step5/nvidia/config.py
def checkpoint_has_step5_sparse_config(config: Any) -> bool:
    """Return whether the checkpoint declares a sparse KV layout.

    Section presence determines the shared KV layout, even when sparse
    execution is disabled in the checkpoint.
    """
    return _get_sparse_config_section(config) is not None