monkeypatch.models.pixtral.modeling_flash_attention_utils
monkeypatch.models.pixtral.modeling_flash_attention_utils
Monkeypatch for FA utils to accept 1D position_ids from Pixtral’s position_ids_in_meshgrid
Functions
| Name | Description |
|---|---|
| apply_patch_is_packed_sequence | Apply patch to FA utils to accept 1D position_ids from Pixtral’s position_ids_in_meshgrid |
apply_patch_is_packed_sequence
monkeypatch.models.pixtral.modeling_flash_attention_utils.apply_patch_is_packed_sequence(
)Apply patch to FA utils to accept 1D position_ids from Pixtral’s position_ids_in_meshgrid