Skip to content

perf(langsmith): cache large JuiceFS writes (v16 backport) #922

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
Daniel Kneipp (DanielKneipp) wants to merge 2 commits into
base: v16-stable
Choose a base branch
from
Open

perf(langsmith): cache large JuiceFS writes (v16 backport) #922

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
2 commits
Select commit Hold shift + click to select a range
c199115
perf(langsmith): cache large JuiceFS writes (v16)
DanielKneipp Aug 6, 2026
0d01259
Merge branch 'v16-stable' into daniel/v16-cache-large-write
DanielKneipp Aug 6, 2026
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
2 changes: 1 addition & 1 deletion charts/langsmith/README.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -899,7 +899,7 @@ Two things worth planning for before you enable it:
| sandboxes.juicefs.csi.controller.serviceAccount.annotations | object | `{}` | Annotations applied to the JuiceFS CSI controller ServiceAccount. |
| sandboxes.juicefs.csi.existingSecretName | string | `""` | Existing Secret containing JuiceFS CSI config keys `name`, `metaurl`, `storage`, and `bucket`. When set, this chart does not render the CSI config Secret and `sandboxes.juicefs.name`, `sandboxes.juicefs.storage`, `sandboxes.juicefs.bucket`, and `sandboxes.juicefs.redis.metaURL` are not used for the CSI config. |
| sandboxes.juicefs.csi.install | bool | `true` | Install the bundled JuiceFS CSI driver. Set to false when the cluster already runs one; the chart then renders only the sandbox PV/PVCs and CSI config Secret, bound to the existing driver. |
| sandboxes.juicefs.csi.mountPodPatch | list | `[{"mountOptions":["cache-dir=/var/cache/juicefs-csi","cache-size=51200","buffer-size=300","prefetch=3","metrics=0.0.0.0:9567"],"resources":{"limits":{"cpu":"2","memory":"4Gi"},"requests":{"cpu":"2","memory":"4Gi"}}},{"mountOptions":["cache-dir=/var/cache/juicefs-csi","cache-size=307200"],"pvcSelector":{"matchLabels":{"juicefs.langsmith.com/cache":"ssd"}}}]` | Mount pod patches used by the JuiceFS CSI driver for sandbox volumes. Override only when tuning JuiceFS mount behavior or observability. |
| sandboxes.juicefs.csi.mountPodPatch | list | `[{"mountOptions":["cache-dir=/var/cache/juicefs-csi","cache-size=51200","buffer-size=300","prefetch=3","metrics=0.0.0.0:9567"],"resources":{"limits":{"cpu":"2","memory":"4Gi"},"requests":{"cpu":"2","memory":"4Gi"}}},{"mountOptions":["cache-dir=/var/cache/juicefs-csi","cache-size=307200","cache-large-write"],"pvcSelector":{"matchLabels":{"juicefs.langsmith.com/cache":"ssd"}}}]` | Mount pod patches used by the JuiceFS CSI driver for sandbox volumes. Override only when tuning JuiceFS mount behavior or observability. |
| sandboxes.juicefs.csi.node.annotations | object | `{}` | Annotations applied to the JuiceFS CSI node DaemonSet and pod template. |
| sandboxes.juicefs.csi.node.serviceAccount.annotations | object | `{}` | Annotations applied to the JuiceFS CSI node ServiceAccount. Use this for workload identity annotations such as AWS IRSA or GCP Workload Identity. |
| sandboxes.juicefs.csi.pvName | string | `"smithbox-juicefs-csi"` | |
Expand Down
9 changes: 9 additions & 0 deletions charts/langsmith/tests/sandbox_juicefs_csi_driver_test.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -296,6 +296,15 @@ tests:
path: metadata.name
value: RELEASE-NAME-langsmith-juicefs-csi-driver-config

- it: should cache large writes for SSD-backed mount pods
values:
- ./values/sandboxes-enabled.yaml
template: sandboxes/juicefs-csi-driver/configmap.yaml
asserts:
- matchRegex:
path: data["config.yaml"]
pattern: "cache-large-write"

- it: should render the JuiceFS CSIDriver when sandboxes are enabled
values:
- ./values/sandboxes-enabled.yaml
Expand Down
1 change: 1 addition & 0 deletions charts/langsmith/values.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -232,6 +232,7 @@ sandboxes:
mountOptions:
- cache-dir=/var/cache/juicefs-csi
- cache-size=307200
- cache-large-write
pvName: "smithbox-juicefs-csi"
pvcName: "smithbox-juicefs-csi"
sandboxHost:
Expand Down
Loading