monkeypatch.models.pixtral.modeling_flash_attention_utils

monkeypatch.models.pixtral.modeling_flash_attention_utils

Monkeypatch for FA utils to accept 1D position_ids from Pixtral’s position_ids_in_meshgrid

Functions

Name Description
apply_patch_is_packed_sequence Apply patch to FA utils to accept 1D position_ids from Pixtral’s position_ids_in_meshgrid

apply_patch_is_packed_sequence

monkeypatch.models.pixtral.modeling_flash_attention_utils.apply_patch_is_packed_sequence(
)

Apply patch to FA utils to accept 1D position_ids from Pixtral’s position_ids_in_meshgrid