monkeypatch.trainer.trl_vllm

monkeypatch.trainer.trl_vllm

Monkeypatches for TRL’s vLLM integration and trainer utils.

Adds: - VLLMClient.batch_update_named_params: batched weight sync (fewer HTTP round-trips) - extract_logprobs: NaN→0.0 fix (prevents downstream NaN propagation) - VLLMGeneration: weight_sync_chunk_size + batched sync path for non-FSDP/non-ZeRO - split_tensor_dict / shuffle_sequence_dict: scalar type handling (int/float/bool passthrough)

Functions

Name	Description
patch_trl_vllm	Apply all TRL vLLM monkeypatches.

patch_trl_vllm

monkeypatch.trainer.trl_vllm.patch_trl_vllm()

Apply all TRL vLLM monkeypatches.