feat: sequence-parallel Ring Attention for MLX - #2255

Open

abendrothj wants to merge 6 commits into

exo-explore:mainfrom

abendrothj:feat/ring-attention

Commits on Jul 10, 2026

feat: add production-ready sequence-parallel Ring Attention
abendrothj
committed
677290f

Commits on Jul 11, 2026

fix: support batched decode on Ring instances via attention passthrough
abendrothj
committed
0a0a6c4

Commits on Jul 13, 2026

fix: disable loguru variable inspection so runner exceptions surface
abendrothj
committed
5cdb447
fix: auto-detect CUDA_HOME from bundled nvidia headers on Linux
abendrothj
committed
30f6a02
fix: keep ring comm streams free of GPU dependencies; add prefill stall watchdog
abendrothj
committed
db853b2
feat: admit Ring placements against VRAM and the long-context working set
abendrothj
committed
c030c5c