cli.args

cli.args

Module for axolotl CLI command arguments.

Classes

Name	Description
EvaluateCliArgs	Dataclass with CLI arguments for axolotl evaluate command.
InferenceCliArgs	Dataclass with CLI arguments for axolotl inference command.
PreprocessCliArgs	Dataclass with CLI arguments for axolotl preprocess command.
QuantizeCliArgs	Dataclass with CLI arguments for axolotl quantize command.
TrainerCliArgs	Dataclass with CLI arguments for axolotl train command.
VllmServeCliArgs	Dataclass with CLI arguments for axolotl vllm-serve command.

EvaluateCliArgs

cli.args.EvaluateCliArgs(
    debug=False,
    debug_text_only=False,
    debug_num_examples=0,
)

Dataclass with CLI arguments for axolotl evaluate command.

InferenceCliArgs

cli.args.InferenceCliArgs(prompter=None)

Dataclass with CLI arguments for axolotl inference command.

PreprocessCliArgs

cli.args.PreprocessCliArgs(
    debug=False,
    debug_text_only=False,
    debug_num_examples=1,
    prompter=None,
    download=True,
    iterable=None,
)

Dataclass with CLI arguments for axolotl preprocess command.

QuantizeCliArgs

cli.args.QuantizeCliArgs(
    base_model=None,
    weight_dtype=None,
    activation_dtype=None,
    quantize_embedding=None,
    group_size=None,
    output_dir=None,
)

Dataclass with CLI arguments for axolotl quantize command.

TrainerCliArgs

cli.args.TrainerCliArgs(
    debug=False,
    debug_text_only=False,
    debug_num_examples=0,
    merge_lora=False,
    prompter=None,
    shard=False,
    main_process_port=None,
    num_processes=None,
)

Dataclass with CLI arguments for axolotl train command.

VllmServeCliArgs

cli.args.VllmServeCliArgs(
    tensor_parallel_size=None,
    host=None,
    port=None,
    gpu_memory_utilization=None,
    dtype=None,
    max_model_len=None,
    enable_prefix_caching=None,
    serve_module=None,
)

Dataclass with CLI arguments for axolotl vllm-serve command.