integrations.context_parallel.args
integrations.context_parallel.args
Pydantic args for the ringmaster context-parallel plugin.
Classes
| Name | Description |
|---|---|
| ContextParallelArgs | Input args contributed by the ringmaster context-parallel plugin. |
| ContextParallelConfig | Nested context_parallel: config block for the ringmaster plugin. |
ContextParallelArgs
integrations.context_parallel.args.ContextParallelArgs()Input args contributed by the ringmaster context-parallel plugin.
ContextParallelConfig
integrations.context_parallel.args.ContextParallelConfig()Nested context_parallel: config block for the ringmaster plugin.
Attributes
| Name | Description |
|---|---|
| ring_impl | Ring block-kernel provider. auto -> hf_kernels (FA2/3/4 via HF kernels) when the model uses a flash kernel, else torch_native (SDPA/flex). |
| ring_size | Ring degree. None = auto-select. ulysses_size * ring_size must == size. |
| size | Total context-parallel degree. 1 = disabled. |
| ulysses_size | All-to-all (head) degree. None = auto-select. |