monkeypatch.ring_attn.patch
monkeypatch.ring_attn.patch
Context-parallel group registry.
Tracks the process group used for context parallelism so the rest of axolotl
(GRPO trainer, is_cp_active) can find it. The
ringmaster ContextParallelPlugin sets this group; the actual ring/ulysses
attention is owned by ringmaster (the legacy ring_flash_attn kernel path has
been removed).
Functions
| Name | Description |
|---|---|
| get_ring_attn_group | Getter for the context-parallel group on this rank. |
| set_ring_attn_group | Setter for the context-parallel group on this rank. |
get_ring_attn_group
monkeypatch.ring_attn.patch.get_ring_attn_group()Getter for the context-parallel group on this rank.
set_ring_attn_group
monkeypatch.ring_attn.patch.set_ring_attn_group(ring_attn_group)Setter for the context-parallel group on this rank.