Search results

uv run torchrun resolves to user-site torchrun and bypasses the venv

Status: Open.

#68 In KempnerInstitute/KempnerForge;

· Naeemkh opened on Apr 27, 2026

Sliding window attention for long-context training

Status: Open.

#42 In KempnerInstitute/KempnerForge;

· mmshad opened on Apr 19, 2026

Track FlashAttention-3 landing in PyTorch SDPA

Status: Open.

#41 In KempnerInstitute/KempnerForge;

· mmshad opened on Apr 19, 2026

Defer: nest moe_* fields into ModelConfig.moe when field count grows

Status: Open.

#14 In KempnerInstitute/KempnerForge;

· mmshad opened on Apr 13, 2026

Elastic training: resilient multi-GPU training on preemptible partitions

Status: Open.

#3 In KempnerInstitute/KempnerForge;

· mmshad opened on Apr 12, 2026

Automatic recovery from training instability

Status: Open.

#2 In KempnerInstitute/KempnerForge;

· mmshad opened on Apr 12, 2026