SUMIN/HuggingFace_transformer
1
0
Fork 0
Code Issues Pull Requests Actions 7 Packages Projects Releases Wiki Activity

quickfix documentation (#32566)

Browse Source 
* fix documentation

* update config
This commit is contained in:
Pablo Montalvo
2024-08-26 17:49:44 +02:00
committed by GitHub
parent 3562772969
commit 26f043bd4d
1 changed files with 2 additions and 2 deletions
Download Patch File Download Diff File Expand all files Collapse all files

4
docs/source/en/model_doc/mamba2.md
View File

@@ -39,11 +39,11 @@ The original code can be found [here](https://github.com/state-spaces/mamba).
### A simple generation example: ### A simple generation example:
```python ```python
from transformers import MambaConfig, MambaForCausalLM, AutoTokenizer from transformers import Mamba2Config, Mamba2ForCausalLM, AutoTokenizer
import torch import torch
model_id = 'mistralai/Mamba-Codestral-7B-v0.1' model_id = 'mistralai/Mamba-Codestral-7B-v0.1'
tokenizer = AutoTokenizer.from_pretrained(model_id, revision='refs/pr/9', from_slow=True, legacy=False) tokenizer = AutoTokenizer.from_pretrained(model_id, revision='refs/pr/9', from_slow=True, legacy=False)
model = MambaForCausalLM.from_pretrained(model_id, revision='refs/pr/9') model = Mamba2ForCausalLM.from_pretrained(model_id, revision='refs/pr/9')
input_ids = tokenizer("Hey how are you doing?", return_tensors= "pt")["input_ids"] input_ids = tokenizer("Hey how are you doing?", return_tensors= "pt")["input_ids"]
out = model.generate(input_ids, max_new_tokens=10) out = model.generate(input_ids, max_new_tokens=10)