SUMIN/HuggingFace_transformer
1
0
Fork 0
Code Issues Pull Requests Actions 7 Packages Projects Releases Wiki Activity
Files
fc74c845377adcb292103b73b63fcd5e02f5c08f
HuggingFace_transformer/docs/source/imgs
History
Stas Bekman 027074f4d0 [doc] document MoE model approach and current solutions (#14725) 
* document MoE model approach

* additional info from Samyam

* fix
2021-12-10 18:24:38 -08:00
..
course_banner.png
Adjust banner width
2021-06-15 09:37:15 -04:00
local_attention_mask.png
Add model summary (#4789)
2020-06-05 12:22:50 -04:00
parallelism-deepspeed-3d.png
[doc] DP/PP/TP/etc parallelism (#12524)
2021-07-09 17:39:09 -07:00
parallelism-flexflow.jpeg
[doc] DP/PP/TP/etc parallelism (#12524)
2021-07-09 17:39:09 -07:00
parallelism-gpipe-bubble.png
[doc] DP/PP/TP/etc parallelism (#12524)
2021-07-09 17:39:09 -07:00
parallelism-sagemaker-interleaved-pipeline.png
[doc] DP/PP/TP/etc parallelism (#12524)
2021-07-09 17:39:09 -07:00
parallelism-tp-independent-gelu.png
[doc] DP/PP/TP/etc parallelism (#12524)
2021-07-09 17:39:09 -07:00
parallelism-tp-parallel_gemm.png
Update TP parallel GEMM image (#14112)
2021-10-22 12:57:48 -07:00
parallelism-tp-parallel_self_attention.png
[doc] DP/PP/TP/etc parallelism (#12524)
2021-07-09 17:39:09 -07:00
parallelism-tp-parallel_shard_processing.png
[doc] DP/PP/TP/etc parallelism (#12524)
2021-07-09 17:39:09 -07:00
parallelism-zero-dp-pp.png
[doc] DP/PP/TP/etc parallelism (#12524)
2021-07-09 17:39:09 -07:00
parallelism-zero.png
[doc] DP/PP/TP/etc parallelism (#12524)
2021-07-09 17:39:09 -07:00
perf-moe-transformer.png
[doc] document MoE model approach and current solutions (#14725)
2021-12-10 18:24:38 -08:00
ppl_chunked.gif
Guide to fixed-length model perplexity evaluation (#5449)
2020-07-07 16:04:15 -06:00
ppl_full.gif
Guide to fixed-length model perplexity evaluation (#5449)
2020-07-07 16:04:15 -06:00
ppl_sliding.gif
Guide to fixed-length model perplexity evaluation (#5449)
2020-07-07 16:04:15 -06:00
tf32-bf16-fp16-fp32.png
[doc] bf16/tf32 guide (#14579)
2021-12-01 14:18:58 -08:00
transformers_logo_name.png
GPU text generation: mMoved the encoded_prompt to correct device
2020-01-06 15:11:12 +01:00
transformers_overview.png
[Templates] Add template "call-for-model" markdown and "call-for-big-bird" markdown (#9921)
2021-02-05 15:47:54 +03:00
warmup_constant_schedule.png
GPU text generation: mMoved the encoded_prompt to correct device
2020-01-06 15:11:12 +01:00
warmup_cosine_hard_restarts_schedule.png
GPU text generation: mMoved the encoded_prompt to correct device
2020-01-06 15:11:12 +01:00
warmup_cosine_schedule.png
GPU text generation: mMoved the encoded_prompt to correct device
2020-01-06 15:11:12 +01:00
warmup_cosine_warm_restarts_schedule.png
GPU text generation: mMoved the encoded_prompt to correct device
2020-01-06 15:11:12 +01:00
warmup_linear_schedule.png
GPU text generation: mMoved the encoded_prompt to correct device
2020-01-06 15:11:12 +01:00