utils.chat_templates.base

utils.chat_templates.base

utility functions for chat templates

Functions

Name Description
get_chat_template Finds the correct chat_template based on the user’s choice, jinja_template, and tokenizer.
register_chat_template Registers chat templates.

get_chat_template

utils.chat_templates.base.get_chat_template(
    user_choice,
    jinja_template=None,
    tokenizer=None,
)

Finds the correct chat_template based on the user’s choice, jinja_template, and tokenizer.

Parameters

Name Type Description Default
user_choice str The user’s choice of template. required
jinja_template str The jinja template string or Path to a valid jinja template file. Defaults to None. None
tokenizer PreTrainedTokenizerBase The tokenizer. Defaults to None. None

Returns

Name Type Description
str str The chosen template string.

Raises

Name Type Description
ValueError If the user_choice is not found in the templates.

register_chat_template

utils.chat_templates.base.register_chat_template(template_name, chat_template)

Registers chat templates.

Parameters

Name Type Description Default
template_name str The name of the template. required
chat_template str The template string. required