Skip to content

Document when a deploy does not replace running agents - #1080

Open
jamsea wants to merge 2 commits into
mainfrom
docs/deploy-no-op-warm-pods-t3002
Open

Document when a deploy does not replace running agents#1080
jamsea wants to merge 2 commits into
mainfrom
docs/deploy-no-op-warm-pods-t3002

Conversation

@jamsea

@jamsea jamsea commented Aug 11, 2026

Copy link
Copy Markdown
Contributor

Why

Nothing customer-facing documented the fact that a Pipecat Cloud deploy does not always replace running pods. A customer with warm instances (min-agents >= 1) can keep serving an older version of their agent with no sign that anything is wrong. One customer ran a broken Krisp setup for two months, building from the mutable dailyco/pipecat-base:latest tag.

The behavior is intentional (a no-op deploy used to roll pods and drop in-flight sessions), but it was only intuitive if you already knew the internals. This documents the customer-facing shape of it.

A deploy only replaces running agent instances when it creates a new
version. If the config you send matches what the agent already has,
Pipecat Cloud keeps the current version and leaves warm instances
running, so they can keep serving old code with no sign of a problem.

Nothing customer-facing covered this. A customer with min-agents >= 1
served a stale image for two months, building from a mutable :latest
base tag.

Adds a section to the Deployments page covering which changes create a
new version and which do not, that --force is how you force one, and
why to pin the base image instead of using :latest. Cross-links it from
Secrets, Agent images, and Scaling.
@github-actions

Copy link
Copy Markdown
Contributor

🔍 Mintlify preview for this branch: https://daily-docs-deploy-no-op-warm-pods-t3002.mintlify.site

@jamsea jamsea self-assigned this Aug 11, 2026
@jamsea
jamsea requested a lite review from Copilot August 11, 2026 07:07
@jamsea
jamsea requested a review from markbackman August 11, 2026 07:09
@jamsea
jamsea marked this pull request as ready for review August 11, 2026 07:09

Copilot AI left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

This PR improves Pipecat Cloud documentation by explaining a customer-visible deploy behavior: successful deploys don’t necessarily replace already-running (warm) agent instances unless the deploy results in a new agent version (or is forced). It adds a dedicated section to the Deployments doc and cross-links it from related fundamentals pages to help users diagnose “deploy succeeded but nothing changed” scenarios.

Changes:

  • Added a new “When a deploy does not replace running agents” section to clarify which actions do/don’t create a new version and how to force one.
  • Updated Secrets, Agent images, and Scaling fundamentals pages to cross-link to the new section and highlight relevant gotchas (secrets updates, :latest tags, scaling-only deploys).

Reviewed changes

Copilot reviewed 4 out of 4 changed files in this pull request and generated 2 comments.

File Description
pipecat-cloud/fundamentals/deploy.mdx Adds the new section explaining version creation vs no-op deploys, plus --force guidance and an image pinning tip.
pipecat-cloud/fundamentals/secrets.mdx Clarifies that secret value updates require a forced redeploy to be picked up, and links to the new deploy section.
pipecat-cloud/fundamentals/agent-images.mdx Expands the pinning recommendation to explain why mutable tags can result in no-op deploys; links to the new deploy section.
pipecat-cloud/fundamentals/scaling.mdx Adds a cross-link note explaining scaling-only deploys don’t create a new version or restart instances.

💡 Add a code-review agent skill or configure MCP servers for context-aware, tailored reviews. Learn more in the docs.

Comment thread pipecat-cloud/fundamentals/deploy.mdx Outdated
Comment thread pipecat-cloud/fundamentals/scaling.mdx Outdated
Cut repetition. The :latest warning was explained in full in four places, and
each exception carried a paragraph of rationale where a clause does the job.

- Drop the closing tip in deploy.mdx: it repeated the image-tag bullet above it
  and the tip in agent-images.mdx, which already links here.
- Drop the list of changes that DO create a new version. That is what readers
  already expect, and --force has its own paragraph.
- Drop the symptom list: two of its three lines restated the bullets below it.
- One line per exception, and fold cloud builds into the image-tag bullet since
  it is the same mechanism (the tag did not change).
- Trim the three cross-links to one sentence each.

Copilot AI left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

Copilot reviewed 4 out of 4 changed files in this pull request and generated no new comments.

Please note that changing your scaling parameters will not disrupt any active sessions.
If you reduce your max instance count below the number of currently active sessions, you will still be billed for the duration of those sessions.

A scaling-only change also doesn't create a new version or restart your instances, so it won't pick up new code, a new image, or a new secret value ([why](/pipecat-cloud/fundamentals/deploy#when-a-deploy-does-not-replace-running-agents)).

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Has this been a point of confusion? New code and images are only used when they're pushed. This seems obvious, so I want to make sure this has been confusing.

New agent requests may, therefore, start with prior deployment configuration if updates are not fully propagated. This ensures on-demand availability
remains consistent and avoids potential cold starts.

### When a deploy does not replace running agents

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@jamsea can we consolidate this point to 1 simple paragraph?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants