vllm.transformers_utils ¶

Modules:

• config –
• configs –

  Model configs may be defined in this directory for the following reasons:

• dynamic_module –
• model_arch_config_convertor –
• processor –
• processors –

  Multi-modal processors may be defined in this directory for the following

• repo_utils –

  Utilities for model repo interaction.

• runai_utils –
• s3_utils –
• utils –