Skip to content

All-time fold opt-in surface for windowed pyramid stores (gated on the source-axis ruling)Β #31

Description

@espg

πŸ€– from Claude (filed at espg's direction, from the PR #28 review discussion, 2026-07-31)

Deferred surface

PR #28 refuses window="all" (the reserved all-time token) rather than half-exposing the all-time folds β€” correctly, because the old path produced an incoherent tree: overview orders opened the all.zarr cross-window folds while the source order emptied (a windowed store has no all-time source leaf β€” the fold is of the windows, not a written leaf). This issue is the legitimate opt-in surface, deliberately not a window label.

Gating question (needs an espg ruling before API design)

What does the source node mean under an all-time read on a windowed pyramid store? The candidates differ semantically:

  1. Overviews-only tree β€” the all-time view simply has no source-order node (honest about what is materialized; breaks the source+overviews-siblings invariant, so it should be a visibly different surface, e.g. open_overview_order(..., all_time=True) returning fold nodes only).
  2. Computed source fold β€” recompute the cross-window fold at source order on read (requires the fields' merge laws; it is exactly what the overview family does, done lazily at order shard_order β€” cost and semantics both nontrivial).
  3. Lazy concat over windows β€” rows repeated per window with a window coordinate (not the same cells axis; arguably a different product view, not "all-time").

Option (1) is the cheapest honest surface and my lean; (2)/(3) are reader-model questions in zagg's O14 DataTree territory and should not be improvised moczarr-side.

Scope once ruled

The opt-in kwarg (or sentinel) on open_overview_order/open_store, D4 stamp admission for the all.zarr fold objects, the Β§4.2 naming stays reserved in the window grammar (moczarr#30 harmonizes the refusal), tests on the committed all-time fixture (PR #28's overview fixture already materializes per-window + all-time folds).

Refs PR #28 ("Questions for review" item 1), moczarr#30, zagg spec Β§4.2, zagg O14 (DataTree reader model, sparse_coverage.md Β§8.2).

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions