Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Description
fp8_calibration
path is broken after 544dd14. This PR is a placeholder for the fixes now needed to make it work.When
fp8=False
andfp8_calibration=True
, Linear/LayerNormLinear/LayerNormMLP don't create any quantizers.Type of change
Changes
Please list the changes introduced in this PR:
Enable creation of quantizers when
fp8_calibraiton=True
.Checklist: