Daniel Han
|
3bddfed117
|
Patch trunc_normal_ for low-precision stability (#4027)
* Fix low-precision trunc_normal initialization instability
* [pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
* Document TorchTitan trunc_normal low-precision failure mode
* Fix trunc_normal generator positional compatibility
* [pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
* Fix trunc_normal generator TypeError fallback
---------
Co-authored-by: Daniel Hanchen <danielhanchen@users.noreply.github.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
|
2026-02-19 04:40:14 -08:00 |
|