Skip to content

Support auto-generated FP8 meta for CKPT converters.#844

Open
mingxu1067 wants to merge 3 commits intomainfrom
mingh/ckpt_converter_fp8_meta
Open

Support auto-generated FP8 meta for CKPT converters.#844
mingxu1067 wants to merge 3 commits intomainfrom
mingh/ckpt_converter_fp8_meta

Conversation

@mingxu1067
Copy link
Copy Markdown
Contributor

No description provided.

Signed-off-by: Ming Huang <mingh@nvidia.com>
parser.add_argument(
'--amax-history-len',
type=int,
default=1,
Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Should we set this to the recommended default of 1024?

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Done

Copy link
Copy Markdown
Contributor

@ashors1 ashors1 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks for the PR! Can we also update the README to reflect these changes?

Signed-off-by: Ming Huang <mingh@nvidia.com>
@mingxu1067
Copy link
Copy Markdown
Contributor Author

Thanks for the PR! Can we also update the README to reflect these changes?

Updated

Signed-off-by: Ming Huang <mingh@nvidia.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants