ray_env_utils - vLLM
Skip to content

vllm.v1.executor.ray_env_utils

Functions:

get_driver_env_vars(worker_specific_vars)

Return driver env vars to propagate to Ray workers.

Returns everything from os.environ except worker_specific_vars and user-configured exclusions (RAY_NON_CARRY_OVER_ENV_VARS).

Source code in vllm/v1/executor/ray_env_utils.py 
10
11
12
13
14
15
16
17
18
19
20
def get_driver_env_vars(
    worker_specific_vars: set[str],
) -> dict[str, str]:
    """Return driver env vars to propagate to Ray workers.

    Returns everything from ``os.environ`` except ``worker_specific_vars``
    and user-configured exclusions (``RAY_NON_CARRY_OVER_ENV_VARS``).
    """
    exclude_vars = worker_specific_vars | RAY_NON_CARRY_OVER_ENV_VARS

    return {key: value for key, value in os.environ.items() if key not in exclude_vars}

update_runtime_env_for_worker_import(runtime_env)

Expose driver environment variables needed before Ray actor import.

VllmConfig can auto-enable breakable CUDA graphs after Ray starts, while eager_break_during_capture resolves the setting during model import.

Source code in vllm/v1/executor/ray_env_utils.py 
23
24
25
26
27
28
29
30
31
32
33
def update_runtime_env_for_worker_import(runtime_env: dict) -> dict:
    """Expose driver environment variables needed before Ray actor import.

    VllmConfig can auto-enable breakable CUDA graphs after Ray starts, while
    eager_break_during_capture resolves the setting during model import.
    """
    for env_var in _RAY_WORKER_PRE_IMPORT_ENV_VARS:
        if env_var in os.environ:
            env_vars = runtime_env.setdefault("env_vars", {})
            env_vars[env_var] = os.environ[env_var]
    return runtime_env