cli.utils.diffusion

cli.utils.diffusion

Helpers for diffusion-mode inference in CLI and Gradio.

Functions

Name Description
diffusion_inference Diffusion inference helper method.
launch_diffusion_gradio_ui Build and launch a simple Gradio UI for diffusion inference.
render_html Render HTML visualizing diffusion outputs.
run_diffusion Run a single diffusion generation and return a structured result dict.

diffusion_inference

cli.utils.diffusion.diffusion_inference(
    model,
    tokenizer,
    cfg,
    prompt,
    chat_template_str=None,
)

Diffusion inference helper method.

launch_diffusion_gradio_ui

cli.utils.diffusion.launch_diffusion_gradio_ui(
    model,
    tokenizer,
    cfg,
    prompter_module=None,
    chat_template_str=None,
)

Build and launch a simple Gradio UI for diffusion inference.

render_html

cli.utils.diffusion.render_html(
    generated_ids,
    orig_ids,
    masked_positions,
    tokenizer,
)

Render HTML visualizing diffusion outputs.

run_diffusion

cli.utils.diffusion.run_diffusion(
    model,
    tokenizer,
    cfg,
    prompt,
    chat_template_str,
    mode='random',
    target_mask_ratio=None,
    completion_tokens=0,
)

Run a single diffusion generation and return a structured result dict.