Streaming Pathfinder: minibatch L-BFGS with same-batch curvature pairs - #722

Open

YichengYang-Ethan wants to merge 19 commits into

pymc-devs:mainfrom

YichengYang-Ethan:streaming-pathfinder

Commits on Aug 8, 2026

Add streaming Pathfinder via minibatch L-BFGS with same-batch curvature pairs
YichengYang-Ethan
committed
0dc9331
Pin same-batch pairing, the two-loop recursion, and the full-data pass
YichengYang-Ethan
committed
9e3c16d
Remove duplicate gradient passes, dead state, and the oversold defaults

YichengYang-Ethan
and
claude
committed
0dcb4f9
Pin the diagnostics, the eval batch width and the degenerate-pair guard

YichengYang-Ethan
and
claude
committed
4f072fa
Restore a real proposal pool, wire the callbacks hook, re-measure the limits

YichengYang-Ethan
and
claude
committed
407089f
Remove ELBO iterate selection in favour of tail-averaged positions

YichengYang-Ethan
and
claude
committed
d9d98d2
Re-measure the tail-averaging claims and prune duplicate tests

YichengYang-Ethan
and
claude
committed
e1b5948
Re-measure the operating range and drop the idioms that were not ours

YichengYang-Ethan
and
claude
committed
0b37796
Restore the batch placeholder and correct five falsified claims

YichengYang-Ethan
and
claude
committed
d74fd27
Remove duplicated test setup, three subsumed tests, and prose bloat

YichengYang-Ethan
and
claude
committed
00c7ab8
Finish the setup deduplication the ponytail pass left half-done

YichengYang-Ethan
and
claude
committed
5f16a15
Demand loader.total_size: len now means the batch count

YichengYang-Ethan
and
claude
committed
545de6e
Trim the measurement reports out of the docstrings

YichengYang-Ethan
and
claude
committed
fcd1ebc
Pin the total_size demand on loaders that cannot report N

YichengYang-Ethan
and
claude
committed
8fb24fc
Re-measure the stale docstring numbers and reattach a mislabeled metric

YichengYang-Ethan
and
claude
committed
4b82831

Commits on Aug 10, 2026

Pin the no-re-evaluation invariant by call count, not point identity

YichengYang-Ethan
and
claude
committed
cf8fcbc

Commits on Aug 14, 2026

Cover the two untested guard branches

YichengYang-Ethan
and
claude
committed
874080c
Close three silent failures found by external adversarial review

YichengYang-Ethan
and
claude
committed
57d0cae
Record the held-out validation limits in the Notes

YichengYang-Ethan
and
claude
committed
f98a4ff