Zach Mueller 6ba31a8a94 Enable users to use their own loss functions + deal with prefetching for grad accum (#34198) ...

* bookmark

* Bookmark

* Bookmark

* Actually implement

* Pass in kwarg explicitly

* Adjust for if we do or don't have labels

* Bookmark fix for od

* bookmark

* Fin

* closer

* Negate accelerate grad accum div

* Fixup not training long enough

* Add in compute_loss to take full model output

* Document

* compute_loss -> compute_loss_fn

* Add a test

* Refactor

* Refactor

* Uncomment tests

* Update tests/trainer/test_trainer.py

Co-authored-by: Daniel Han <danielhanchen@gmail.com>

---------

Co-authored-by: Daniel Han <danielhanchen@gmail.com>

2024-10-17 17:01:56 -04:00

..

agents

Decorator for easier tool building (#33439)

2024-09-18 11:07:51 +02:00

benchmark

[Test refactor 1/5] Per-folder tests reorganization (#15725)

2022-02-23 15:46:28 -05:00

bettertransformer

Fixed malapropism error (#26660)

2023-10-09 11:04:57 +02:00

deepspeed

Trainer - deprecate tokenizer for processing_class (#32385)

2024-10-02 14:08:46 +01:00

extended

[tests] skip tests for xpu (#33553)

2024-09-19 19:28:04 +01:00

fixtures

Implementation of SuperPoint and AutoModelForKeypointDetection (#28966)

2024-03-19 14:43:02 +00:00

fsdp

🚨🚨🚨 Update min version of accelerate to 0.26.0 (#32627)

2024-08-20 11:42:36 +02:00

generation

[fix] fix token healing tests and usage errors (#33931)

2024-10-16 14:22:55 +02:00

models

Llama3 and Llama2 are ExecuTorch compatible (#34101)

2024-10-17 17:33:19 +02:00

optimization

fix: Fixed the 1st argument name in classmethods (#31907)

2024-07-11 12:11:50 +01:00

peft_integration

[PEFT] Support low_cpu_mem_usage option for PEFT loading adapters (#33725)

2024-10-03 16:15:36 +02:00

pipelines

Fix default behaviour in TextClassificationPipeline for regression problem type (#34066)

2024-10-15 13:06:20 +01:00

quantization

Add GGUF for starcoder2 (#34094)

2024-10-14 10:22:49 +02:00

repo_utils

Refactor CI: more explicit (#30674)

2024-08-30 18:17:25 +02:00

sagemaker

Trainer - deprecate tokenizer for processing_class (#32385)

2024-10-02 14:08:46 +01:00

tokenization

Fix for slow the bug tokenizer adding spaces to single id decodes (#32564)

2024-09-18 12:32:02 +02:00

trainer

Enable users to use their own loss functions + deal with prefetching for grad accum (#34198)

2024-10-17 17:01:56 -04:00

utils

[fix] fix token healing tests and usage errors (#33931)

2024-10-16 14:22:55 +02:00

__init__.py

…

test_backbone_common.py

Align backbone stage selection with out_indices & out_features (#27606)

2023-12-20 18:33:17 +00:00

test_configuration_common.py

Refactor: Removed un-necessary object base class (#32230)

2024-07-26 10:33:02 +02:00

test_feature_extraction_common.py

Split common test from core tests (#24284)

2023-06-15 07:30:24 -04:00

test_image_processing_common.py

Update kwargs validation for preprocess with decorator (#32024)

2024-08-06 11:33:05 +01:00

test_image_transforms.py

fix: center_crop occasionally outputs off-by-one dimension matrix (#30934)

2024-05-21 13:56:52 +01:00

test_modeling_common.py

IDEFICS: support inputs embeds (#34043)

2024-10-16 09:25:26 +02:00

test_modeling_flax_common.py

add sdpa to ViT [follow up of #29325] (#30555)

2024-05-16 10:56:11 +01:00

test_modeling_tf_common.py

[TF] Fix Tensorflow XLA Generation on limited seq_len models (#33903)

2024-10-05 16:20:50 +02:00

test_pipeline_mixin.py

removes decord (#33987)

2024-10-17 17:27:34 +02:00

test_processing_common.py

Uniformize model processors (#31368)

2024-10-02 10:41:08 +02:00

test_sequence_feature_extraction_common.py

Fix typo (#25966)

2023-09-05 10:12:25 +02:00

test_tokenization_common.py

Trainer - deprecate tokenizer for processing_class (#32385)

2024-10-02 14:08:46 +01:00