SUMIN/HuggingFace_transformer
1
0
Fork 0
Code Issues Pull Requests Actions 7 Packages Projects Releases Wiki Activity
16,886 Commits 5 Branches 239 Tags
dc8b6eaeeeb59dd3089b478cc09b577f2c62a297
Commit Graph

3 Commits

Author SHA1 Message Date
Alex Sherstinsky
122ded0a11 Bugfix/alexsherstinsky/fix none check for attention factor in rope scaling 2024 08 28 0 (#33188) 
* Fixing a bug in the way "attention_factor" is validated in ROPE utilities.

* Fixing a bug in the way "attention_factor" is validated in ROPE utilities.

* Fixing a bug in the way "attention_factor" is validated in ROPE utilities.
 2024-09-04 17:01:12 +02:00
Joao Gante
083e13b7c4 RoPE: Add numerical tests ✨ (#32380) 
tests! :D
 2024-08-02 09:39:45 +01:00
Joao Gante
2e113422b3 Llama: RoPE refactor (#32135) 
Co-authored-by: amyeroberts <22614925+amyeroberts@users.noreply.github.com>
Co-authored-by: Arthur <48595927+ArthurZucker@users.noreply.github.com>
 2024-07-23 10:42:55 +01:00