Discrepancy in LayerNorm Calculations?August 20, 2024 · 4 min readZ. YuanEngineerCurious about the numbers? Let's calculate and compare.
The Pitfall of Lists in PyTorchFebruary 20, 2024 · 2 min readZ. YuanEngineerResolving PyTorch OOM Issues.