Add LRU to improve the memory usage of the indexer - #2050

Open

Lucccyo wants to merge 20 commits into

Lucccyo:lru_cache_index

Commits on May 4, 2026

Progress.

Tim-ats-d
authored and
Lucccyo
committed
0bc5cd6
Clean up.

Tim-ats-d
authored and
Lucccyo
committed
c45695f
Use shared cache sync with filesystem for ocaml-index file reading.

Tim-ats-d
authored and
Lucccyo
committed
005a2c5
Use shared cache in `Granular_marshal.read`.

Tim-ats-d
authored and
Lucccyo
committed
d1c23bd
Attach a random number to each index file in order to prevent reading expired data.

Tim-ats-d
authored and
Lucccyo
committed
97f314c
More precise error message.

Tim-ats-d
authored and
Lucccyo
committed
2647727
Use 8 bytes to store index file random ID.

Tim-ats-d
authored and
Lucccyo
committed
99c0146
Make `is_on_disk` behavior correct.

Tim-ats-d
authored and
Lucccyo
committed
8731dfb
Use a random state instead of initialize a global one.

Tim-ats-d
authored and
Lucccyo
committed
6802b4e
Delay pointing index check and check if a file descriptor is already opened.

Tim-ats-d
authored and
Lucccyo
committed
b7aee1f
Store ID in type `store` and delay the index ID check in `force_open_store`.

Tim-ats-d
authored and
Lucccyo
committed
6247b2f
Proper exception raising when attempting to consult an outdated index file.

Tim-ats-d
authored and
Lucccyo
committed
d403b4c
Catch Outdated_store exception in ocaml-index binary and provides an error message.

Tim-ats-d
authored and
Lucccyo
committed
6230faf
Add LRU to limit the memory usage
Lucccyo
committed
f825928
Removing compress optimization
Lucccyo
committed
dc9ac33
Add optim small_with_papa
Lucccyo
committed
3cf7589
review changes
Lucccyo
committed
1616aa9
printing in stderr
Lucccyo
committed
c86e8b3

Commits on May 18, 2026

minor fixes
Lucccyo
committed
9777008

Commits on May 21, 2026

Fix functional value error
Lucccyo
committed
34e63f9