Joao Gante 8bdd4f2acd [generate] skip compilation on cpu offload (#37709) ...

* skip compilation on cpu offload

* add test

* better logic

* docstring

* boolean logic

* add disk offload check

* warn users if compilation options are set but compilation doesn happen

* fix test

---------

Co-authored-by: Marc Sun <57196510+SunMarc@users.noreply.github.com>

2025-04-24 14:08:17 +01:00

..

__init__.py

[Test refactor 1/5] Per-folder tests reorganization (#15725)

2022-02-23 15:46:28 -05:00

test_beam_constraints.py

Use Python 3.9 syntax in tests (#37343)

2025-04-08 14:12:08 +02:00

test_beam_search.py

Use Python 3.9 syntax in tests (#37343)

2025-04-08 14:12:08 +02:00

test_candidate_generator.py

prune LM Head for USD (#36695)

2025-04-08 16:44:10 +01:00

test_configuration_utils.py

Use Python 3.9 syntax in tests (#37343)

2025-04-08 14:12:08 +02:00

test_fsdp.py

[MLU] Fix FA2 check error, remove deepspeed-mlu deps. (#36159)

2025-03-31 11:02:49 +02:00

test_logits_process.py

Allow Exclusion of Input IDs from RepetitionPenaltyLogitsProcessor (#37625)

2025-04-21 15:46:05 +01:00

test_stopping_criteria.py

Use Python 3.9 syntax in tests (#37343)

2025-04-08 14:12:08 +02:00

test_streamers.py

Use Python 3.9 syntax in tests (#37343)

2025-04-08 14:12:08 +02:00

test_utils.py

[generate] skip compilation on cpu offload (#37709)

2025-04-24 14:08:17 +01:00