From 0d0de2b422224a6af097e762c6d66d2094f829e4 Mon Sep 17 00:00:00 2001 From: Kirit93 Date: Mon, 10 Aug 2026 12:12:07 -0700 Subject: [PATCH] docs(telemetry): split reports into one file per period and add Jul 26 + Aug 10 reports Signed-off-by: Kirit93 --- telemetry/2026-07-08.md | 46 ++++++++++++++++++++++++++++++++ telemetry/2026-07-26.md | 46 ++++++++++++++++++++++++++++++++ telemetry/2026-08-10.md | 46 ++++++++++++++++++++++++++++++++ telemetry/README.md | 59 ++++++----------------------------------- 4 files changed, 146 insertions(+), 51 deletions(-) create mode 100644 telemetry/2026-07-08.md create mode 100644 telemetry/2026-07-26.md create mode 100644 telemetry/2026-08-10.md diff --git a/telemetry/2026-07-08.md b/telemetry/2026-07-08.md new file mode 100644 index 0000000000..39340605ff --- /dev/null +++ b/telemetry/2026-07-08.md @@ -0,0 +1,46 @@ +# OpenShell Telemetry — June 24 – July 8, 2026 + +[← All reports](README.md) + +First public telemetry update, so there is no prior period to compare against. The **Last 2 weeks** column covers this two-week window; **All-time** is cumulative since telemetry landed on June 1, 2026 (~5 weeks). A large share of all-time activity falls within this two-week window. Numbers are aggregate counts only — see the [Telemetry section](../README.md#telemetry) of the main README for what's collected and how to opt out. + +| Metric | Last 2 weeks | All-time | +|---|---:|---:| +| Sandboxes created | 269,220 | 383,224 | +| Sandboxes deleted | 247,727 | 343,216 | +| Sandbox creation failures | 5,345 | 12,822 | +| Actions denied | 2,323,468 | 3,861,935 | +| Network activity events | 29,935,431 | 43,079,862 | + +Creation failure rate held around 2% over the last two weeks (~3% all-time). + +**Sandbox drivers.** Docker dominates at 208,816, followed by Podman (34,637) and Kubernetes (23,480). VM (1,562), unknown (422), and MXC (303) make up the long tail. All-time we've also seen a handful of apple-container and macos sandboxes. + +```mermaid +xychart-beta + title "Sandboxes Created by Driver (Jun 24 – Jul 8)" + x-axis ["docker", "podman", "kubernetes", "vm", "unknown", "mxc"] + y-axis "Sandboxes created" 0 --> 220000 + bar [208816, 34637, 23480, 1562, 422, 303] +``` + +**Where sandboxes are created.** The United States leads by a wide margin, followed by Israel, Australia, Hong Kong, India, Singapore, South Korea, Germany, Japan, and China. + +**Providers.** `custom` profiles lead (~30k), then `openai` (~21k), with nvidia, claude, anthropic, github, gitlab, opencode, codex, and copilot trailing. + +```mermaid +xychart-beta + title "Top Provider Profiles (Jun 24 – Jul 8, approx.)" + x-axis ["custom", "openai", "nvidia", "claude", "other"] + y-axis "Profiles created" 0 --> 32000 + bar [30300, 21100, 1200, 1000, 3000] +``` + +**Policy.** Roughly 73% of policy decisions were approved over the last two weeks. Of denied sandbox connections, ~99% fell under the "Connect Policy" deny group, with "Bypass" denials near zero. + +```mermaid +pie showData + title Policy Decisions — Jun 24 – Jul 8 (approx.) + "Approved" : 3700 + "Rejected" : 1400 +``` diff --git a/telemetry/2026-07-26.md b/telemetry/2026-07-26.md new file mode 100644 index 0000000000..9247708dce --- /dev/null +++ b/telemetry/2026-07-26.md @@ -0,0 +1,46 @@ +# OpenShell Telemetry — July 13 – July 26, 2026 + +[← All reports](README.md) + +Metrics below cover this two-week window, compared with the prior period (June 24 – July 8, 2026). Numbers are aggregate counts only — see the [Telemetry section](../README.md#telemetry) of the main README for what's collected and how to opt out. + +| Metric | This period | Prior period | Change | +|---|---:|---:|---:| +| Sandboxes created | 556,370 | 269,220 | +106.7% | +| Sandboxes deleted | 421,946 | 247,727 | +70.3% | +| Sandbox creation failures | 100,246 | 5,345 | +1,775.5% | +| Actions denied | 3,505,237 | 2,323,468 | +50.9% | +| Network activity events | 34,946,280 | 29,935,431 | +16.7% | + +The creation failure rate was ~18% this period (100,246 failures against 556,370 creates), up from ~2% in the prior period. Docker was the most-used driver at 332,238, ahead of Kubernetes (172,834). + +**Sandbox drivers.** Docker leads at 332,238, then Kubernetes (172,834) and Podman (47,374). The long tail: VM (3,198), unknown (399), and MXC (327). + +```mermaid +xychart-beta + title "Sandboxes Created by Driver (Jul 13 – Jul 26)" + x-axis ["docker", "kubernetes", "podman", "vm", "unknown", "mxc"] + y-axis "Sandboxes created" 0 --> 350000 + bar [332238, 172834, 47374, 3198, 399, 327] +``` + +**Where sandboxes are created.** The United States leads by a wide margin, followed by Israel, Japan, India, Singapore, Hong Kong, China, Germany, Thailand, and Sweden. + +**Providers.** `custom` profiles lead at 42,758, then `openai` (33,074), claude (2,261), nvidia (1,744), github (784), anthropic (660), opencode (624), gitlab (284), codex (38), and copilot (18). + +```mermaid +xychart-beta + title "Top Provider Profiles (Jul 13 – Jul 26)" + x-axis ["custom", "openai", "claude", "nvidia", "other"] + y-axis "Profiles created" 0 --> 50000 + bar [42758, 33074, 2261, 1744, 2414] +``` + +**Policy.** Roughly 70% of policy decisions were approved this period (~8.7k approved vs ~3.7k rejected). Of denied sandbox connections, ~98% fell under the "Connect Policy" deny group. + +```mermaid +pie showData + title Policy Decisions — Jul 13 – Jul 26 (approx.) + "Approved" : 8700 + "Rejected" : 3700 +``` diff --git a/telemetry/2026-08-10.md b/telemetry/2026-08-10.md new file mode 100644 index 0000000000..9f2da71eb7 --- /dev/null +++ b/telemetry/2026-08-10.md @@ -0,0 +1,46 @@ +# OpenShell Telemetry — July 27 – August 10, 2026 + +[← All reports](README.md) + +Metrics below cover this two-week window, compared with the prior period (July 13 – July 26, 2026). Numbers are aggregate counts only — see the [Telemetry section](../README.md#telemetry) of the main README for what's collected and how to opt out. + +| Metric | This period | Prior period | Change | +|---|---:|---:|---:| +| Sandboxes created | 556,389 | 556,370 | +0.0% | +| Sandboxes deleted | 457,086 | 421,946 | +8.3% | +| Sandbox creation failures | 66,511 | 100,246 | -33.7% | +| Actions denied | 4,220,436 | 3,505,237 | +20.4% | +| Network activity events | 27,077,441 | 34,946,280 | -22.5% | + +The creation failure rate was ~12% this period (66,511 failures against 556,389 creates), down from ~18% in the prior period. Kubernetes (245,144) overtook Docker (239,444) as the most-used sandbox driver. + +**Sandbox drivers.** Kubernetes leads at 245,144, just ahead of Docker (239,444), with Podman third at 58,657. The long tail: unknown (6,386), VM (6,267), MXC (461), apple-container (23), and LXD (7). + +```mermaid +xychart-beta + title "Sandboxes Created by Driver (Jul 27 – Aug 10)" + x-axis ["kubernetes", "docker", "podman", "unknown", "vm", "mxc"] + y-axis "Sandboxes created" 0 --> 260000 + bar [245144, 239444, 58657, 6386, 6267, 461] +``` + +**Where sandboxes are created.** The United States again leads by a wide margin, followed by India, Germany, China, Poland, Japan, the United Kingdom, Israel, Hong Kong, and Denmark. + +**Providers.** `custom` profiles lead (~61k), then `openai` (~51k), with claude, nvidia, github, anthropic, gitlab, opencode, codex, and copilot trailing. + +```mermaid +xychart-beta + title "Top Provider Profiles (Jul 27 – Aug 10, approx.)" + x-axis ["custom", "openai", "claude", "nvidia", "other"] + y-axis "Profiles created" 0 --> 65000 + bar [61000, 51000, 3000, 2000, 4000] +``` + +**Policy.** Roughly 67% of policy decisions were approved this period (~16.5k approved vs ~8.2k rejected). Of denied sandbox connections, ~93% fell under the "Connect Policy" deny group, with "Bypass" denials near zero. + +```mermaid +pie showData + title Policy Decisions — Jul 27 – Aug 10 (approx.) + "Approved" : 16500 + "Rejected" : 8200 +``` diff --git a/telemetry/README.md b/telemetry/README.md index 0d0f105606..e6e378eb65 100644 --- a/telemetry/README.md +++ b/telemetry/README.md @@ -1,56 +1,13 @@ # OpenShell Community Telemetry Reports -OpenShell collects anonymous, aggregate usage telemetry (see the [Telemetry section](../README.md#telemetry) of the main README for what's collected and how to opt out). We publish a summary of the trends here every two weeks so the community can see how the project is being used. +OpenShell collects anonymous, aggregate usage telemetry (see the [Telemetry section](../README.md#telemetry) of the main README for what's collected and how to opt out). We publish periodic summaries of the trends here so the community can see how the project is being used. -Telemetry collection landed in [#1433](https://github.com/NVIDIA/OpenShell/pull/1433) on **June 1, 2026**, so all "All-time" figures are cumulative from that date. +Numbers are aggregate counts only — no user data, code, prompts, or command contents are collected. Each report covers one two-week period and, where available, compares against the prior period. Reports are listed newest first. -Numbers are aggregate counts only — no user data, code, prompts, or command contents are collected. Reports are listed newest first. +## Reports ---- - -## Update — July 8, 2026 - -First public telemetry update. The **Last 2 weeks** column covers the trailing two-week window; **All-time** is cumulative since telemetry landed on June 1, 2026 (~5 weeks). A large share of all-time activity falls within this first two-week window. - -| Metric | Last 2 weeks | All-time | -|---|---:|---:| -| Sandboxes created | 269,220 | 383,224 | -| Sandboxes deleted | 247,727 | 343,216 | -| Sandbox creation failures | 5,345 | 12,822 | -| Actions denied | 2,323,468 | 3,861,935 | -| Network activity events | 29,935,431 | 43,079,862 | - -Creation failure rate held around 2% over the last two weeks (~3% all-time). - -**Sandbox drivers (last 2 weeks).** Docker dominates at 208,816, followed by Podman (34,637) and Kubernetes (23,480). VM (1,562), unknown (422), and MXC (303) make up the long tail. All-time we've also seen a handful of apple-container and macos sandboxes. - -```mermaid -xychart-beta - title "Sandboxes Created by Driver (Last 2 Weeks)" - x-axis ["docker", "podman", "kubernetes", "vm", "unknown", "mxc"] - y-axis "Sandboxes created" 0 --> 220000 - bar [208816, 34637, 23480, 1562, 422, 303] -``` - -**Where sandboxes are created (last 2 weeks).** The United States leads by a wide margin, followed by Israel, Australia, Hong Kong, India, Singapore, South Korea, Germany, Japan, and China. - -**Providers (last 2 weeks).** `custom` profiles lead (~30k), then `openai` (~21k), with nvidia, claude, anthropic, github, gitlab, opencode, codex, and copilot trailing. - -```mermaid -xychart-beta - title "Top Provider Profiles (Last 2 Weeks, approx.)" - x-axis ["custom", "openai", "nvidia", "claude", "other"] - y-axis "Profiles created" 0 --> 32000 - bar [30300, 21100, 1200, 1000, 3000] -``` - -**Policy.** Roughly 73% of policy decisions were approved over the last two weeks. Of denied sandbox connections, ~99% fell under the "Connect Policy" deny group, with "Bypass" denials near zero. - -```mermaid -pie showData - title Policy Decisions — Last 2 Weeks (approx.) - "Approved" : 3700 - "Rejected" : 1400 -``` - -Next update: ~July 22, 2026. +| Reporting period | Report | +|---|---| +| July 27 – August 10, 2026 | [View report](2026-08-10.md) | +| July 13 – July 26, 2026 | [View report](2026-07-26.md) | +| June 24 – July 8, 2026 | [View report](2026-07-08.md) |