core.trainers.async_grpo.config

core.trainers.async_grpo.config

Training arguments of axolotl’s async GRPO trainer.

Classes

Name	Description
AxolotlAsyncGRPOConfig	TRL’s AsyncGRPOConfig plus axolotl’s training fields and extensions.

AxolotlAsyncGRPOConfig

core.trainers.async_grpo.config.AxolotlAsyncGRPOConfig(
    model_type=None,
    lr_quadratic_warmup=False,
    pretraining=False,
    sample_packing=False,
    batch_flattening=False,
    balance_labels=False,
    label_balance_window_optim_steps=1,
    label_keep_prob=None,
    label_keep_prob_normalize='dropped',
    sample_packing_sequentially=False,
    sample_packing_mp_start_method=None,
    sample_packing_drop_attention_mask=False,
    multipack_real_batches=False,
    checkpoint_save_retry_wait=None,
    checkpoint_save_retries=1,
    include_tkps=True,
    eval_sample_packing=None,
    sample_packing_efficiency=1.0,
    sample_packing_bin_size=200,
    sample_packing_group_size=100000,
    max_seq_length=2048,
    dataset_num_proc=None,
    relora_prune_ratio=None,
    relora_prune_method=None,
    jagged_restart_steps=None,
    jagged_restart_warmup_steps=None,
    jagged_restart_anneal_steps=None,
    bench_split='eval',
    bench_dataset='pharaouk/dharma-1/dharma_1_mini.json',
    do_bench_eval=False,
    do_causal_lm_eval=False,
    max_bench_samples=None,
    bench_source_max_len=2048,
    dataloader_prefetch_factor=None,
    cosine_min_lr_ratio=None,
    cosine_constant_lr_ratio=None,
    loraplus_lr_ratio=None,
    loraplus_lr_embedding=1e-06,
    embedding_lr_scale=None,
    lr_groups=None,
    embedding_lr=None,
    qlora=False,
    orpo_alpha=None,
    lisa_n_layers=None,
    lisa_step_interval=None,
    lisa_layers_attribute=None,
    curriculum_sampling=None,
    alternate_lr_scheduler_type=None,
    chat_template=None,
    adam_beta3=None,
    adam_epsilon2=None,
    activation_offloading=None,
    layer_offloading=None,
    image_size=None,
    image_resize_algorithm=None,
    dion_learning_rate=None,
    dion_momentum=None,
    dion_rank_fraction=None,
    dion_rank_multiple_of=None,
    reward_weights=None,
    multi_objective_aggregation='sum_then_normalize',
    scale_rewards='group',
    mask_truncated_completions=False,
    skip_zero_advantage_batches=True,
    reward_num_workers=1,
    scoring_token_budget=None,
    loss_type='dapo',
    vllm_importance_sampling_mode='token_truncate',
    vllm_importance_sampling_cap=3.0,
    rollout_loop=None,
    rollout_loop_kwargs=None,
    vllm_merge_check_interval=DEFAULT_MERGE_CHECK_INTERVAL,
    vllm_lora_alias=None,
)

TRL’s AsyncGRPOConfig plus axolotl’s training fields and extensions.