integrations.context_parallel.args

integrations.context_parallel.args

Pydantic args for the ringmaster context-parallel plugin.

Classes

Name Description
ContextParallelArgs Input args contributed by the ringmaster context-parallel plugin.
ContextParallelConfig Nested context_parallel: config block for the ringmaster plugin.

ContextParallelArgs

integrations.context_parallel.args.ContextParallelArgs()

Input args contributed by the ringmaster context-parallel plugin.

ContextParallelConfig

integrations.context_parallel.args.ContextParallelConfig()

Nested context_parallel: config block for the ringmaster plugin.

Attributes

Name Description
ring_impl Ring block-kernel provider. auto -> hf_kernels (FA2/3/4 via HF kernels) when the model uses a flash kernel, else torch_native (SDPA/flex).
ring_size Ring degree. None = auto-select. ulysses_size * ring_size must == size.
size Total context-parallel degree. 1 = disabled.
ulysses_size All-to-all (head) degree. None = auto-select.