Files
HuggingFace_transformer/tests
Theia Vogel e719b65c31 Fix FbgemmFp8Linear not preserving tensor shape (#33239)
* add tests for linear shape behavior

* fix linear shape behavior

ended up adding the reshape at the end, after f8f8bf16_rowwise, because adding
it directly after quantize_fp8_per_row caused f8f8bf16_rowwise to drop the
seq_len dimension. (i.e., (17, 23, 1014) -> (17, 1024))

* save shape up front + comment
2024-09-11 13:26:44 +02:00
..
2024-09-04 17:30:54 +02:00
2024-06-26 21:59:08 +01:00
2024-08-20 11:42:36 +02:00
2024-09-09 09:51:39 +02:00