Discrepancy in LayerNorm Calculations?August 20, 2024 · 4 min readZephyrEngineerCurious about the numbers? Let's calculate and compare.
The Pitfall of Lists in PyTorchFebruary 20, 2024 · 2 min readZephyrEngineerResolving PyTorch OOM Issues.