vllm.distributed.device_communicators ¶

Modules:

• aiter_custom_all_reduce –

  vLLM-owned wrapper over AITER's CustomAllreduce.

• all2all –
• all_reduce_utils –
• base_device_communicator –
• cpu_communicator –
• cuda_communicator –
• cuda_wrapper –

  This file is a pure Python wrapper for the cudart library.

• custom_all_reduce –
• flashinfer_all_reduce –
• flashinfer_pcie_ipc_all_reduce –

  FlashInfer PCIe CUDA-IPC all-reduce integration.

• pynccl –
• pynccl_wrapper –
• quick_all_reduce –
• ray_communicator –
• shm_broadcast –
• shm_object_storage –
• xpu_communicator –