cli.utils.load

cli.utils.load

Utilities for model, tokenizer, etc. loading.

Functions

Name Description
load_model_and_tokenizer Helper function for loading a model, tokenizer, and processor specified in the

load_model_and_tokenizer

cli.utils.load.load_model_and_tokenizer(cfg, inference=False)

Helper function for loading a model, tokenizer, and processor specified in the given axolotl config.

Parameters

Name Type Description Default
cfg DictDefault Dictionary mapping axolotl config keys to values. required
inference bool Boolean denoting inference mode. False

Returns

Name Type Description
tuple[PreTrainedModel, PreTrainedTokenizer | PreTrainedTokenizerFast | Any, ProcessorMixin | None] Tuple of (PreTrainedModel, PreTrainedTokenizer, ProcessorMixin).