diff --git a/torchao/float8/README.md b/torchao/float8/README.md index 94df824d2..57bb7c77f 100644 --- a/torchao/float8/README.md +++ b/torchao/float8/README.md @@ -11,6 +11,8 @@ throughput speedups of up to 1.5x on 128 GPU LLaMa 3 70B pretraining jobs. :warning: The codebase is stable, but backwards compatibility is not yet guaranteed. +:warning: These APIs are training-only and float8-only, and we plan to [unify them with the rest of torchao](https://github.com/pytorch/ao/issues/894) in the future. + # Single GPU User API We provide three per-tensor scaling strategies: dynamic, delayed and static. See https://arxiv.org/pdf/2209.05433.pdf, Section 4.3 for more details. These strategies are configurable separately for activations (`input`), weights (`weight`) and gradients (`grad_output`).