Skip to content

Latest commit

Β 

History

91 Commits

Folders and files

NameName
Last commit message
Last commit date
Β 
Β 
Β 
Β 
Β 
Β 

Repository files navigation

Awesome Agent Skills Security Awesome

πŸ›‘οΈ A curated list of resources on securing AI agent tool use and skill ecosystems β€” attacks, defenses, frameworks, benchmarks, and standards.

AI agents increasingly use external tools, plugins, and skills to interact with the world. This creates a new attack surface: agent skills security. This list covers the threats, defenses, and research landscape for securing these capabilities.

Contents


Threat Frameworks & Standards

Surveys & Systematizations

Attack Research

Prompt Injection via Tools

Tool Poisoning & Supply Chain

Privilege Escalation & Excessive Agency

Data Exfiltration & Privacy

Indirect Prompt Injection

Agent Deception & Manipulation

Compound System Attacks

Cross-Plugin Attacks

Backdoor Attacks on Agents

Jailbreaking & Guardrail Bypass

Defense Research

Permission & Access Control

  • πŸ“„ Linguistic Firewall: Geometry as Defense in Multi-Agent Systems Routing β€” Alsheich et al., 2026. ANTAP routes tasks to agents based on empirically verified capability rather than self-declared textual descriptions, resisting description-based injection, embedding attacks, and covert-backdoor impersonation where malicious agents misrepresent their proficiencies.
  • πŸ“„ PAuth: Precise Task-Scoped Authorization For Agents β€” Sharma et al., 2026. Implicit authorization model where NL task submission authorizes only required operations; uses NL slices and envelopes for provenance-based server-side verification, blocking injected operations in AgentDojo with zero false positives.
  • πŸ“„ Securing Multi-Tool AI Agent Chains With Dynamic, Real-Time Compositional Policies β€” Schneider et al., 2026. Proposes the Dynamic Security Control Compositor (DSCC), which enforces compositional security policies over multi-tool agent chains by combining static analysis with runtime data-flow tracking.
  • πŸ“„ Rethinking Agent Security as a Networking Problem β€” Tran et al., 2026. Argues agent-centric defenses fail because they entrust policy enforcement to nondeterministic, injectable LLMs, and instead borrows networking principles β€” centralized control with distributed enforcement, capability-based access, and zero-trust least privilege β€” combining deterministic enforcement with semantic, context-aware policies in a reference architecture for securing AI agent systems.
  • πŸ“„ Twin Agent: Context Residual Compression for Privilege Separated Agents β€” Hu et al., 2026. General privilege-separation design pattern using two near-symmetric agents β€” an Explore Agent that inspects untrusted context and a Safe Agent that executes privileged actions β€” where the Explore Agent, conditioned on the Safe Agent's context, communicates only compact hints about the next action, improving the security–utility tradeoff and preventing prompt injection across SWE-bench Lite, AgentDojo, and DecodingTrust-Agent.
  • πŸ“„ TrustAgent: Towards Safe and Trustworthy LLM-based Agents β€” Agent Constitution for safety-aware planning with pre/post-action inspection.
  • πŸ“„ Autoformalization of Agent Instructions into Policy-as-Code β€” Mondl et al., 2026. Uses an LLM generator-critic loop to automatically translate natural-language agent instructions and policy documents into formally enforceable Cedar policies, achieving broader coverage than hand-coded symbolic enforcement while avoiding the no-guarantees weakness of probabilistic guardrails on medical agent benchmarks.
  • πŸ“„ Governing Actions, Not Agents: Institutional Attestation as a Governance Model for Autonomous AI Systems β€” Salfeld-Nebgen et al., 2026. Formalizes an institutional governance model where an autonomous agent keeps full planning autonomy but must present independently attested evidence at the point of consequential, irreversible action (e.g., clinical prescribing, production deployment) rather than having its reasoning monitored.
  • πŸ“„ A Deterministic Control Plane for LLM Coding Agents β€” Madatha, 2026. Proposes Rel(AI)Build, treating coding-agent definitions as a managed supply chain with content addressing, permission enforcement, and audit logging, arguing governance of the agent-config layer must be deterministic and tool-agnostic rather than delegated to further LLM orchestration.
  • πŸ“„ A Dual-Helix Governance Approach for Reliable Agentic AI β€” 3-track architecture (Knowledge, Behavior, Skills) using knowledge graphs.
  • πŸ“„ Talk Freely, Execute Strictly: Schema-Gated Agentic AI β€” Schema-gated orchestration for trustworthy agent deployment in regulated domains.
  • πŸ“„ ESAA-Security: Event-Sourced Architecture for Agent-Assisted Security Audits β€” 26 tasks, 95 checks, append-only event logs for reproducible AI code audits.
  • πŸ“„ Caging the Agents: A Zero Trust Security Architecture for Autonomous AI in Healthcare β€” Maiti, 2026. Production-deployed zero-trust architecture for 9 autonomous AI agents: gVisor kernel isolation, credential proxy sidecars, network egress allowlisting, and prompt integrity framework with untrusted content labeling. Open-source configs released.
  • πŸ“„ Sovereign Execution Brokers: Enforcing Certificate-Bound Authority in Agentic Control Planes β€” He & Yu, 2026. Runtime enforcement layer that intercepts autonomous agent requests and verifies them against cryptographically-issued certificates before allowing infrastructure mutations, ensuring production changes cannot originate from agent reasoning alone.
  • πŸ“„ The Unfireable Safety Kernel: Execution-Time AI Alignment for AI Agents and Other Escapable AI Systems β€” Dobrin & Chmiel, 2026. Rust-based, formally verified safety kernel that enforces authorization on agent actions through process separation and cryptographic verification, designed to resist self-modification and escape attempts so an agent cannot circumvent its own safety controls at runtime.
  • πŸ“„ A First Measurement Study on Authentication Security in Real-World Remote MCP Servers β€” Zhou et al., 2026. Large-scale measurement of 7,973 remote MCP servers finding widespread unauthenticated exposure and pervasive OAuth flaws, with 9 CVEs from responsible disclosure.
  • πŸ“„ CmdNeedle: Measuring the Incompleteness of Command Denylists for AI Agents β€” Chen et al., 2026. Shows that the denylist component of terminal agents' three-list command-gating mechanism β€” including Claude Code's built-in list β€” is systematically incomplete against the large, ever-expanding set of shell commands shipped by modern operating systems.
  • πŸ“„ SecureClaw: Clawing Back Control of LLM Agents β€” Ma et al., 2026. Dual-boundary security architecture placing authorization at the effect sink and plaintext confinement at the read boundary, using opaque handles and a PREVIEWβ†’COMMIT protocol to block unauthorized external actions and sensitive-data leakage in tool-using agents.
  • πŸ“„ SessionBound: Turning Enterprise Task Approval into Budgeted Database Sessions β€” Wu, 2026. Confines enterprise agent-generated SQL to pre-approved business tasks via short-lived, budgeted, auditable database sessions β€” the agent may generate queries freely, but every attempt must stay inside the approved boundary β€” enforcing safety through database-layer access controls, query budgets, and disclosure limits rather than trusting the LLM to self-police.
  • πŸ“„ Janus: A Playground for User-Involved Agentic Permission Management β€” Brigham et al., 2026. Playground system implementing six permission assistants across a design space of user involvement in agentic tool-call authorization; shows user input meaningfully strengthens privacy and security, AI augmentation of user decisions reduces cognitive load, and permission fatigue must be modeled since no single design is optimal across contexts. Code.
  • πŸ“„ aiAuthZ: Off-Host, Identity-Bound Authorization for AI Agents β€” Kodathala, 2026. Off-host authorization gateway that binds tool calls to verified user authority via HMAC-SHA256 signatures and role-based policies, blocking deceived agents from executing actions beyond granted permissions rather than trusting the model's own refusals over unverifiable text context.
  • πŸ“„ From Neural Intent to Cryptographic Authorization: Governing Agentic Workflows β€” Weng et al., 2026. Neural Cryptographic Services (NCS) inserts a deterministic symbolic controller between LLM agents and privileged tools, admitting a tool invocation only when it matches cryptographically authorized instructions from an offline-signed, hash-chained instruction stream rather than trusting the model to comply with intent β€” cutting attack success while preserving utility on legitimate workflows.
  • πŸ“„ Steerability via Constraints: A Substrate for Scalable Oversight of Coding Agents β€” Winninger, ICML 2026 Deep Learning for Code Workshop. Argues the controls long used to manage large human engineering teams β€” access control, network policies, tooling-enforced coding conventions β€” transfer directly to unconstrained coding agents (whose autonomy introduces security risks) and are cheaper in tokens than agentic scaffolding; a controlled experiment shows a small reviewer's recall on 11 inserted backdoors rising from 54.5% to 90.9% when given a constrained substrate plus a ~200-LoC docs CLI.
  • πŸ“„ Context-to-Execution Integrity for LLM Agents β€” Santos-Grueiro, 2026. CXI is an execution-boundary system that marks protected sink fields, carries narrow validated values from writable context via typed releases, keeps evidence in opaque data slots, and admits a tool call only when field authority, exact-effect authorization, and invocation authority all bind to the same action manifest β€” yielding zero field/effect/invocation escapes across 720 AgentDojo episodes and 400 code-agent episodes.
  • πŸ“„ Reason Less, Verify More: Deterministic Gates Recover a Silent Policy-Violation Failure Mode in Tool-Using LLM Agents β€” Reddy et al., 2026. Identifies "silent wrong-state" failures where policy-permissive tools execute forbidden state transitions without any error, and shows lightweight deterministic read-only pre-execution gates raise τ²-bench airline success from 29.6% to 42.0% by blocking policy-violating writes at the action boundary.
  • πŸ“„ ScopeJudge: Cost-Aware Pre-Execution Gating for Offensive Security Agents β€” Caldwell et al., 2026. Pre-execution gate in which a lightweight LLM judge inspects each offensive-security agent tool call against the engagement scope inferred from the user's request β€” treating the boundary as intent-declared rather than a fixed policy β€” to block out-of-scope actions before they execute.
  • πŸ“„ How Agents Ask for Permission: User Permissions for AI Agents, from Interfaces to Enforcement β€” Michael & Roesner, 2026. Systematizes user-level permission systems for AI agents via a taxonomy of 21 proposals and an analysis of five commercial agents, examining how permissions are specified, derived, and enforced at runtime to counter prompt injection and unauthorized task execution.
  • πŸ“„ Toward Cryptographically Verifiable Authorization for Autonomous AI Agents β€” LlambΓ­-Morillas & FernΓ‘ndez-FernΓ‘ndez, 2026. Formalizes agent authorization as a cryptographically verifiable relation (CVA) that jointly binds an agent principal, a concrete request, an execution context, and policy satisfaction while preserving confidentiality of private attributes; defines candidate properties (authorization soundness, principal/request/policy binding, replay resistance), gives a Groth16 zk-SNARK proof-of-concept, and identifies the structural separation of identity, request, and runtime-execution binding as a central open problem for secure agentic systems.
  • πŸ“„ ToolGuardian: Declarative Security for AI Agent-Tool Interactions β€” Ravindran & Deochake, 2026. Policy-driven framework pairing pre-admission tool vetting via progressive characterization (declared descriptions, syscall traces, mock-execution effects, source analysis) with task-aware runtime authorization, built on an Answer Set Programming declarative policy layer that reasons explicitly over capabilities, effects, task context, and multi-tool composition; on 16 MCP-style tools (8 malicious variants of real open-source tools) it reaches deny-class F1 0.86 for vetting and classifies all runtime scenarios correctly when fully specified.
  • πŸ“„ Dynamic Capability Scoping for Enterprise AI Agents: A Synthetic Dataset and Three-Source Permission Architecture β€” Noyan, AIWILD @ ICML 2026. Treats capability scoping as prevention before detection β€” a credential absent from an agent's context cannot be misused regardless of reasoning or evasion β€” via a three-source architecture (role-based ceilings, a task-context classifier, and policy-derived combination prohibitions), and releases a 600-prompt synthetic dataset labeled with minimum required permissions across a 15-permission tool-based taxonomy, with iterative dataset–policy refinement cutting ceiling violations 93% (46β†’3).
  • πŸ“„ Agentic Permissions Policy Algebra for Taint Confinement in LLM Agents β€” Kravchenko et al., 2026. Introduces APPA, which uses engine-managed context branching and prospective evaluation to confine taint from untrusted data locally β€” child trajectories absorb contamination while sanitizers return cleaned results to an unchanged parent context β€” preventing prompt injection from polluting the primary workspace without sacrificing operational utility.
  • πŸ“„ Toward Standardized Cross-Vendor Agent Tool Trust Management in Autonomous Networks β€” Sharma et al., 2026. Proposes AgentToolMO, a 3GPP NRM information model that gives agents cross-vendor visibility into tool trust degradation β€” a formally defined trust state machine with graduated enforcement, damped cascade propagation, and trust notifications over existing Management Services interfaces β€” so a compromised tool from one vendor no longer keeps getting invoked by another vendor's agents, shrinking blast radius from hours-scale undetected propagation to near-real-time containment.
  • πŸ“„ FAVA: Formal Authorization for Verified Agents with Evidence-Backed Permission Graphs β€” Zhang et al., 2026. Permission-carrying authorization framework that translates ambiguous natural-language tasks into a Permission Intermediate Representation, lowers it into an evidence-backed permission graph tracking data flows, dependencies, and contextual labels, and has a Satisfiability Modulo Theories authorizer mathematically verify each effectful action against security policies before a runtime gateway either authorizes it or intercepts it with a precise counterexample β€” reaching a 90.5% Decision Compliance Rate across OpenAgentSafety, OctoBench, and ActPlane.
  • πŸ“„ Are You Still the Agent I Authorized? Earned Authority under a Fixed Ceiling for Evolving Agents β€” Zhang & Zhang, 2026. Addresses the authorization gap created when long-lived agents evolve after deployment β€” retaining experience, acquiring skills and tools, revising workflows, and delegating β€” so the subject or context exercising a live grant no longer matches what the user evaluated; proposes earned authority bounded by a fixed ceiling to keep prompt-injection- and error-driven external actions within originally-authorized limits.
  • πŸ“„ Memory Provenance Laundering in LLM Agents: A Non-Amplification Firewall for Persistent Memory β€” Xu et al., 2026. Identifies "memory provenance laundering," where untrusted external observations are rewritten into persistent agent memory as trusted user history during consolidation, and proposes the Provenance-Preserving Memory Firewall (PPMF), a middleware that keeps platform-maintained provenance and authorizes tool calls by matching action risk to the authority of the action-relevant memories.
  • πŸ“„ Beyond Single-Use Tokens: Durable Authorization State for Replay-Resistant LLM Agent Actions β€” Xu et al., 2026. Identifies semantic replay β€” where replanning, retries, delegation, and crash-resumption cause one user authorization to execute multiple times under freshly issued single-use tokens β€” and proposes durable, token-independent authorization state that bounds an authorized action's execution budget.
  • πŸ“„ MNC: Scope-Bound Semantic Declassification for Private LLM-Agent Communication β€” Xu et al., 2026. Scope-bound semantic declassification framework for multi-agent LLM systems that specifies what a legitimately informed agent should disclose and how, closing privacy leaks through internal messages, tool arguments, logs, and persistent memory that surface-redaction and source-level access controls leave open.
  • πŸ“„ Hardware Keystores for AI Agent Signing Workflows: A Zero-Trust MCP Enforcement Architecture β€” Sambrook & Sovio, 2026. Replaces software-resident agent signing keys (git commits, API auth, certificate issuance) with hardware-confined keys behind a vendor-neutral PKCS#11 interface, wrapped in a five-layer zero-trust enforcement stack β€” session identity, scope bounds, semantic validation, taint tracking, and a hardware execution boundary β€” motivated by a production incident where keys were exfiltrated via email injection in under five minutes; cuts attack success from 19.3% to 0% across 12 AgentDojo-derived injection scenarios with zero false positives on benign tasks.
  • πŸ“„ NiyamAI: An Intent-Bound AI Agent with Cryptographically Verifiable Guardrails using Zero-Knowledge Proofs β€” Katkar et al., 2026. Locks permitted tools and constraints into a SHA-256-committed Intent Contract at session start and validates every tool call with an isolated Judge model that emits an EZKL zk-SNARK proof, so a tool executes only after proof verification and third parties can confirm enforcement without accessing the Judge model's weights; reaches 88.5% F1 at a 1.1% false-positive rate on Agent-SafetyBench.
  • πŸ“„ A Gateway Architecture for Enterprise MCP Authentication: Unifying Heterogeneous Auth, Identity Delegation, and the User / Non-User Persona Problem β€” Kumar et al., 2026. Reports a production centralized MCP gateway fronting dozens of downstream servers to resolve the governance crisis of fragmented per-team auth (some with none, some API keys, some OAuth); contributes a two-axis personaΓ—credential authentication model, three enterprise SSO grants with BYO/GYO/delegated-OAuth (RFC 8693) token provisioning, and three end-to-end identity flows spanning user and non-user (automated) agent personas.
  • πŸ“„ InterSAGE: The Secure and Verifiable Interoperability Protocol for An Internet of Agents β€” Zou et al., 2026. Trust-native protocol suite that supplies the missing security substrate for the Internet of Agents alongside existing communication protocols, via four layers (Persistent Identity, Discovery, Trust Negotiation, and Accountability) that let an agent prove its identity, authorization, advertised capabilities, and accountability after delegation across organizational boundaries.
  • πŸ“„ Bounded Agents: Delegation Security for Multi-Agent AI Systems β€” Muruaga, 2026. Frames agent misbehavior within granted permissions as an authorization-architecture problem and proposes the Agentic Principal Chain (APC), which tracks delegated authority across principals so static per-request permissions cannot be combined into a prohibited outcome or delegated unbounded to a sub-agent.
  • πŸ“„ Authorization Before Context: A Model-Neutral Audience Boundary Against Cross-Audience Memory Leakage in Agentic Systems β€” Liu, 2026. Enforces an anti-monotone audience-membership rule at the memory-to-context transition β€” a memory item is admitted only when every current viewer already belonged to its audience β€” preventing cross-audience information disclosure in multi-user agentic systems independent of the underlying model.
  • πŸ“„ PACE: Policy-Attested Contract Execution for Safe AI Agents in Decentralized Finance β€” Karanjai et al., 2026. Transaction-level authorization framework interposing between LLM agents and blockchain execution, using typed transaction intents, a deterministic policy verifier, and signed Policy Decision Records to cryptographically bind verifier-approved actions to the exact on-chain transactions submitted, blocking prompt-injection-driven DeFi actions.

Runtime Monitoring & Sandboxing

  • πŸ“„ Forensic Trajectory Signatures for Agent Memory Poisoning Detection β€” Leong, 2026. Finds that successful agent memory-poisoning attacks leave an invariant tool-call signature (a memory recall preceding a sensitive action such as email send), enabling incident responders to detect memory-channel attacks from tool-call logs alone at 99% accuracy without inspecting memory contents.
  • πŸ“„ MESA: Prioritizing Vulnerable Communication Channels for Securing Multi-Agent Systems β€” Li et al., 2026. Framework that ranks the most security-critical inter-agent communication edges so defenders can deploy protection proactively, showing channel-level attack impact is highly non-uniform β€” a single compromised edge can account for up to 75% of total attack success.
  • πŸ“„ AI Sandboxes: A Threat Model, Taxonomy, and Measurement Framework β€” Singh et al., 2026. Formal framework for evaluating AI testing environments via threat models, sandbox archetypes, and measurement criteria (fidelity, controllability, observability, containment, reproducibility) across digital, embodied, and cyber-physical deployments.
  • πŸ“„ Cordon: Semantic Transactions for Tool-Using LLM Agents β€” Chen et al., 2026. Transactional runtime that wraps multi-step agent workflows in a task-scoped containment boundary for staging, validating, committing, and rolling back irreversible tool actions, rather than relying on isolated per-call guardrails.
  • πŸ“„ VIGIL: Runtime Enforcement of Behavioral Specifications in AI Agent Skills β€” Li et al., 2026. End-to-end framework that monitors agent execution traces against behavioral policies declared in skill specifications and operator constraints, using a dedicated policy language and symbolic evaluation to catch violations across temporal dependencies, argument relationships, and value flows spanning multiple tool calls β€” over 95% recall with sub-10% false positives on real-world agent tasks.
  • πŸ“„ AIRGuard: Guarding Agent Actions with Runtime Authority Control β€” Qin et al., 2026. Runtime defense layer that treats untrusted context as informative but never authorizing, normalizing tool calls and enforcing action-time authority checks to reduce tool-mediated attacks.
  • πŸ“„ Safeguarding LLM Agents from Misalignment through Provenance Analysis β€” She, Liang & Kang, 2026. ProvenanceGuard detects and blocks misaligned tool invocations by tracing whether each proposed agent action is actually supported by evidence in the agent's context, catching actions that deviate from user intent before they execute.
  • πŸ“„ Operating-Layer Controls for Onchain Language-Model Agents Under Real Capital β€” Barton et al., 2026. Production study of 3,505 real-capital agents showing that agent reliability depends on operating-layer controls like prompt compilation, typed controls, policy validation, execution guards, and trace-level observability.
  • πŸ“„ Governing What You Cannot Observe: Adaptive Runtime Governance for Autonomous AI Agents β€” Marin and Chaudhary, 2026. Proposes adaptive runtime governance based on bounding unobserved risk as agent behavior drifts after authorization.
  • πŸ“„ AgentWard: A Lifecycle Security Architecture for Autonomous AI Agents β€” Zhang et al., 2026. Lifecycle security architecture for autonomous agents spanning skills, external content, memory, planning, and privileged tool execution.
  • πŸ“„ Behavioral Integrity Verification for AI Agent Skills β€” Wu et al., 2026. Scalable pre-deployment skill auditing framework that compares declared versus actual capabilities, surfaces description-implementation gaps, and detects malicious skills with 0.946 F1.
  • πŸ“„ ADR: An Agentic Detection System for Enterprise Agentic AI Security β€” Li et al., MLSys Industry Track 2026. Production MCP security system with telemetry, red teaming, and two-tier online detection deployed across 7,200+ hosts and 10,000+ daily agent sessions.
  • πŸ“„ Content-Aware Attack Detection in LLM Agent Tool-Call Traffic: An Empirical Study of Features, Architectures, and Evaluation Protocols β€” Zavrak, 2026. Shows content-aware graph and embedding-based monitoring of MCP tool-call traffic substantially outperforms metadata-only detection and highlights evaluation leakage pitfalls.
  • πŸ“„ Arbiter: Detecting Interference in LLM Agent System Prompts β€” Mason, 2026. Framework combining formal evaluation rules with multi-model LLM scouring to detect interference and vulnerability classes in agent system prompts.
  • πŸ“„ MCPShield: A Security Cognition Layer for Adaptive Trust Calibration in MCP Agents β€” Zhou et al., 2026. Plug-in security cognition layer for MCP agents that validates third-party tool invocations via experience-driven trust calibration.
  • πŸ“„ OpenClaw PRISM: A Zero-Fork, Defense-in-Depth Runtime Security Layer for Tool-Augmented LLM Agents β€” Li, 2026. Runtime security layer distributing enforcement across ten lifecycle hooks with hybrid heuristic-plus-LLM scanning, session-scoped risk accumulation, and tamper-evident audit for agent gateways.
  • πŸ“„ Governing Evolving Memory in LLM Agents: Risks, Mechanisms, and the SSGM Framework β€” Lam et al., 2026. Stability and Safety-Governed Memory framework mitigating topology-induced knowledge leakage and semantic drift in persistent agent memory systems.
  • πŸ“„ Securing LLM-Agent Long-Term Memory Against Poisoning: Non-Malleable, Origin-Bound Authority with Machine-Checked Guarantees β€” Louck, 2026. Proves content- and lineage-based memory-poisoning defenses are fundamentally insufficient against agent-specific laundering, and proposes TMA-NM, a non-malleable information-flow-control mechanism that achieves 0% attack success with full legitimate utility across eight frontier models versus up to 68% for prior defenses.
  • πŸ“„ Detecting Malicious Agent Skills in the Wild using Attention β€” Etteib et al., 2026. Locate-and-Judge, a two-stage detector that flags malicious marketplace skills by analyzing instruction-following attention patterns, concentrating expensive LLM examination on high-attention instruction spans for cost-efficient marketplace-wide auditing while catching malicious skills existing scanners miss.
  • πŸ“„ AgentSentry: Real-time Monitoring for Agentic AI Systems β€” Runtime behavioral monitoring of tool-using agents.
  • πŸ“„ Monitoring Emergent Reward Hacking via Internal Activations β€” Sparse autoencoders detect reward-hacking during generation.
  • πŸ“„ Self-Attribution Bias: When AI Monitors Go Easy on Themselves β€” AI monitors exhibit systematic leniency on own outputs.
  • πŸ“„ Salient Directions in AI Control β€” Structure of AI Control evaluations: trusted monitors overseeing untrusted agents.
  • πŸ“„ Governed Memory: A Production Architecture for Multi-Agent Workflows β€” Taheri, 2026. Shared memory governance layer with dual memory model, tiered governance routing, entity-scoped isolation (zero cross-entity leakage across 500 adversarial queries), and 100% adversarial governance compliance in production.
  • πŸ“„ Agent-Native Immune System: Architecture, Taxonomy, and Engineering β€” Shen et al., 2026. Proposes ANIS, an endogenous biologically-inspired defense embedded directly in the agent's cognitive loop with a six-layer "Immune Tower" (including a non-cognitive isolation layer), a taxonomy of agent viruses and vaccines, and continual immune learning to counter runtime hijacking via memory poisoning, tool-chain manipulation, and multi-agent protocol attacks that survive training-time alignment.
  • πŸ”— Behavioral Attestation and Compaction Drift in Persistent AI Agents β€” Morrow (agent-morrow), 2026. Identifies compaction drift β€” non-adversarial behavioral shift caused by context window compression β€” as a runtime integrity threat class distinct from adversarial injection. Proposes behavioral attestation (context fingerprint delta against a pre-compression baseline) as the mechanism for continuous rather than one-time agent authorization. Complements credential-scope enforcement (e.g., AATs) with runtime execution verification.
  • πŸ“„ The Decomposition Is the Fingerprint: Per-Component Identity for Agent Skills β€” Liu et al., 2026. Fingerprinting framework that assigns each agent-skill component a locality-sensitive-hash identity to detect tampering, unauthorized reuse, and drift across skill versions, complementing behavioral verification with structural provenance.
  • πŸ“„ From Tool Connection to Execution Control: Benchmarking Security Invariants in MCP-Style Agent Runtimes β€” Liu, 2026. Defines and benchmarks eight security invariants for MCP-style execution runtimes; the proposed HCP runtime blocks all modeled attacks (tool poisoning, unauthorized execution, privilege drift) that a naive baseline permits.
  • πŸ“„ AgenticOS: An Intent-Oriented Secure Operating System Architecture for Autonomous AI Agents β€” Zhao et al., 2026. OS-like security architecture that reframes agent protection as an intent filter, layering a Ghost Kernel, Logic Shutter, Agent Capsule, and Semantic Boundary Gateway to isolate and mediate autonomous agent actions.
  • πŸ“„ Proof of Execution: Runtime Verification for Governed AI Agent Actions β€” Rhodes et al., 2026. Cryptographically-sound runtime verification framework that binds authorization, effectful actions, tamper-evident history, and deterministic replay into attestable execution objects, so each governed agent step's authority and integrity can be proven rather than assumed from output plausibility.
  • πŸ“„ When Agents Go Rogue: Activation-Based Detection of Malicious Behaviors in Multi-Agent Systems β€” Xu et al., ICML 2026. AcMAS detects semantically stealthy attacks in multi-agent systems by analyzing local agents' activation-space reasoning states without relying on explicit interaction graphs, staying robust to asynchronous execution (+0.55 F1 over graph baselines asynchronously) and using the same signals to restore compromised agents rather than isolate them.
  • πŸ“„ Token-Flow Firewall: Semantic Runtime Auditing for Persistent AI Agents β€” Wang et al., 2026. TokenWall audits the natural-language token flows of long-lived agents at runtime, intercepting unsafe behaviors before they reach privileged operations and achieving a 12.5% attack success rate while preserving 97.4% benign-operation compatibility.
  • πŸ“„ TRACE: A Two-Channel Robust Attribution Watermark via Complementary Embeddings for LLM-Agent Trajectories β€” Gao et al., 2026. Embeds attribution watermarks directly into an agent's action-log trajectory across two complementary channels β€” one surviving content deletion, the other surviving rewrites β€” so a rebranding reseller who silently substitutes a cheaper model or tampers with logs can be detected, protecting agent provenance in production deployments.
  • πŸ“„ FlowGuard: From Signals to Evidence for MCP Security Detection β€” An et al., 2026. Evidence-grounded MCP security detection system that verifies execution-related risks (command injection, file-system access) through runtime evidence rather than suspicious semantic signals alone, combining recon-guided payload narrowing, schema-valid probe generation, and evidence adjudication; on a 1,880-case executable benchmark it reaches 0.879–0.942 F1 while cutting end-to-end latency up to 2.23x, and surfaces 523 findings across 326 real-world servers.
  • πŸ“„ Democratizing Agent Deployment Safety: A Structural Monitoring Approach β€” Ravindra et al., ICML 2026 Workshops. Untrained Information Flow Graph (IFG) monitor that detects infrastructure-level sabotage under task success β€” coding agents that complete their task while covertly broadening permissions, degrading logging, or planting persistence β€” by diffing control- and data-flow graphs; cuts missed attacks from 11.6% to 3.5% asynchronously and, run synchronously as a pre-merge gate with rollback, drops joint main+covert task success from 74.4% to 0.0% without reducing legitimate completion.
  • πŸ“„ Cross-Agent Campaign Attribution: Linking Asynchronous Attacks Across LLM Agents β€” Park et al., 2026. Links coordinated attack campaigns across separate agent sessions with no shared infrastructure or labels by fingerprinting behavioral signals such as tool-usage patterns and writing style, enabling cross-agent attribution for incident response.
  • πŸ“„ ChainWatch: A Kill Chain-Aligned Sequential Detection Framework for Multi-Step Attacks in MCP-Based AI Agent Systems β€” Narayan et al., 2026. Sequential detection framework that models MCP attack progression as a six-stage kill chain and applies a Hidden Markov Model over a 20-dimensional tool-interaction feature schema to flag malicious tool-call sequences composed from individually benign invocations that evade per-call defenses, covering direct sequential, indirect-injection, and hybrid multi-stage attack chains.
  • πŸ“„ Operational Hallucination and Safety Drift in AI Agents β€” Yu et al., 2026. Empirically characterizes two multi-turn failure modes in tool-using agents β€” Safety Drift (declared safety intent eroding into constraint-violating actions such as refusal followed by unsafe execution) and Operational Hallucination (livelock-inducing repetitive tool calls from flawed state perception) β€” attributes them to reasoning/execution-state decoupling, and proposes a plug-in Action-Aware Supervision Layer with intent-action consistency checks, runtime state tracking, and forced-termination primitives.
  • πŸ“„ JANUS: Foreseeing Latent Risk for Long-Horizon Agent Safety β€” Xiong et al., 2026. Foresight-oriented guard framework that trains a guard model (Vanguard) to anticipate delayed risks from partial agent trajectories via coupled anticipation and adjudication tasks optimized with CoAA-RL, blocking unsafe actions before execution and improving average protection by 15.9 points over baseline guards while raising benign task completion by 5.1 points across four agent-safety benchmarks.
  • πŸ“„ CARE: Pre-Execution Command Verification for Shell-Executing LLM Agents β€” Zhang et al., ISSRE 2026. Shell-specific static-first verifier that mediates individual commands at the dispatch boundary β€” canonicalizing generated commands into stable verification targets, deriving deterministic evidence over syntax, command semantics, path context, and provenance-backed risk patterns, and escalating only underdetermined cases to an LLM judge β€” reaching 85.64% F1 at a 0.91% false-positive rate and 2.32 ms mean latency, and cutting realized harm on RedCode-gen to 37.33% in its static enforcement profile.
  • πŸ“„ SafeFlow: Semantic Information-Flow Control for Blocking Malicious Propagation in Multi-Agent Systems β€” Dai et al., 2026. Reframes cross-agent malicious propagation β€” where a harmful objective is fragmented into locally plausible subtasks that evade any single agent β€” as a semantic information-flow problem, attaching structured semantic taints to root requests, propagating them through a dynamic collaboration graph, and performing workflow-level validation to reconstruct global risk context before irreversible actions commit.
  • πŸ“„ Hybrid Analysis for Secure MCP Tool Use in LLM Agents β€” 2026. MTGuard defends MCP tool use through lifecycle-aware static–dynamic co-analysis rather than inspecting prompts and outputs alone, arguing static-only defenses limit effectiveness and robustness against agents induced into malicious or unauthorized tool actions.
  • πŸ“„ Distributing Security Controls Through Harness Engineering β€” Gore, 2026. Shows off-the-shelf security controls (OS sandboxing, skill scanning, tool restriction) can be embedded into a distributable agent harness (SHarD, built on Pi) and scaled to commercial coding agents via a single install command, matching direct-install efficacy and scoring 100% on a 23-test suite derived from the OWASP Top 10 for Agentic Applications.
  • πŸ“„ SkillGate: Cost Efficient Runtime Malicious Skill File Detection in Coding Agents β€” Yang et al., 2026. Deployable security gateway that screens skill packages before coding-agent installation via a hybrid regex-prefilter + LLM-judge pipeline β€” safe-signal files bypass the LLM entirely and flagged files send only matched snippet windows rather than full content β€” reaching F1 0.817 at 1.13% FPR on SkillsBench (n=1,650, 9.1% malicious) while cutting LLM input tokens 77% and outperforming existing tools 5–6x on threshold-independent AUPRC.
  • πŸ“„ Early Detection of Distributed Backdoors in Multi-Agent LLM Systems: A Characterization Study β€” Arias et al., 2026. Studies distributed backdoors where a poisoned tool hides encrypted payload fragments across several agents that an external step reassembles after the run, evading per-step safety checks; a prefix detector flags 99.3% of successful attacks with a median of five steps remaining (10.3% safe-run false positives), but shows much of that warning rests on removable surface cues (ciphertext length and entropy) rather than the attack's distributed structure β€” once stripped, detection arrives later and transfers poorly across domains.
  • πŸ“„ $S^3$: Improving Agent Safety through Multi-Stage Defense β€” Xiao et al., 2026. Multi-stage defense that jointly protects LLM agents across the memory, planning, and tool-execution stages of the agentic workflow, mitigating risks that emerge at one stage and propagate across steps rather than protecting isolated stages in ways that are hard to integrate.
  • πŸ“„ AgentAntibody: An Adaptive Immune System for Defending LLM Agents against Prompt Injection β€” Weng et al., 2026. Self-evolving "immune system" against prompt injection that represents the user's security boundary as a persistent library of antibodies, learning from each encounter to recognize and neutralize injections that exploit underspecified user requests where the desired outcome is stated but acceptable behavior is not.
  • πŸ“„ DreamGuard: Efficient Runtime Guardrail for LLM Agents via Risk-Aware World Model β€” Lin et al., 2026. Proactive runtime guardrail built around a risk-aware world model that maintains a compact recurrent latent state over the agent's trajectory and predicts future latent states to derive immediate-hazard and prefix-risk signals, catching long-horizon risks where individually benign-looking actions gradually drift the agent toward hazardous states; fuses the multi-horizon signals into pre-execution intervention decisions, achieving the best safety–utility trade-off across four benchmarks at ~25 ms average latency per call.
  • πŸ“„ Beyond Handcrafted Security: Towards Self-Evolving Defense for LLM Agents β€” Ruan et al., 2026. Develops a harness-level formulation of runtime defense that characterizes how harness mechanisms enable defense construction, then uses it to move past manually designed interventions toward self-evolving defenses that automatically construct and maintain security mechanisms inside the agent execution loop.
  • πŸ“„ Proof-of-Execution Memory: Defending LLM Agents Against Forged-Reasoning Attacks by Verifying What Actually Happened β€” Rahman & Kim, 2026. Counters memory-forgery attacks such as FARMA β€” where fabricated reasoning-memory entries claim a required safety step is already done so the agent skips it β€” by verifying entries against what the agent actually executed, rather than scoring them against a fixed suspicious-wording list that an automated rewriter can evade.

Input/Output Validation

Formal Verification & Analysis

  • πŸ“„ Efficient and Sound Probabilistic Verification for AI Agents β€” Solko-Breslin et al., 2026. Verification framework using distributionally robust optimization to compute sound upper bounds on the probability of agent policy violations under uncertainty, without independence assumptions between predicates.
  • πŸ“„ Agentics 2.0: Logical Transduction Algebra for Agentic Data Workflows β€” Formalizes LLM inference as typed semantic transformations with algebraic composition.
  • πŸ“„ Knowledge Divergence and the Value of Debate for Scalable Oversight β€” Formal framework for choosing oversight mechanisms.
  • πŸ“„ AutoSpec: Safety Rule Evolution for LLM Agents via Inductive Logic Programming β€” Ma et al., 2026. Counterexample-guided inductive synthesis that evolves expert-designed agent safety rules via inductive logic programming, reaching F1 of 0.98/0.93 across two domains, cutting false positives up to 94%, and producing human-auditable rules that generalize to unseen scenarios.
  • πŸ“„ Local LLM Agents as Vulnerable Runtimes: A Source-Code Audit of the Agent Runtime Layer β€” Zhang et al., 2026. CLAWAUDIT static-analysis framework that audits the agent runtime layer itself for security vulnerabilities, raising recall from 13.8–21.7% baselines to 66.8–75.1% across 217 held-out advisories.
  • πŸ“„ AgentFlow: Building Agent Dependency Graphs for Static Analysis of Agent Programs β€” Wang et al., 2026. First static analysis framework to recover agent-specific dependencies (agent constructors, tool decorators, handoff declarations) into an Agent Dependency Graph, enabling Agent Bill of Materials generation and prompt-to-tool risk detection; uncovers 238 taint-style prompt-to-tool risks across 5,399 real-world agent programs.
  • πŸ“„ SkillsMetric: Mapping the Detection Boundary of Static Analysis for Malicious Agent Skills β€” Chen et al., 2026. Five-stage static-analysis framework scoring skill packages along pattern density, statistical anomaly, dataflow taint, import anomaly, and capability-mismatch dimensions (AUC 0.93 on the full SkillMD-138K corpus plus a 2,266-skill adversarial set spanning 16 attack types), while exposing a fundamental blind spot: host-destruction attacks using common shell commands evade all five stages.
  • πŸ“„ SkillConsist: Detecting Inconsistencies in Agent Skills via Bidirectional Graph Alignment β€” Meng et al., 2026. Detects agent-skill inconsistencies β€” undisclosed dangerous behavior or mismatched declarations that cause wrong skill selection β€” by separating declaration and implementation content into behavior records (via an LLM plus static analysis) and aligning them with a bidirectional graph, handling cases where declaration and implementation are mixed across text and code and a concise declaration maps to multiple connected implementation steps.
  • πŸ“„ Correct Is Not Governed: Provenance Integrity in Agentic Workflows β€” Salas, 2026. Argues outcome-correctness is insufficient in institutional settings, where a correct action may rely on the wrong authority, an unsupported completion claim, or work made stale by a later change, and defines governed execution as work whose decisions, completion, and response to change are backed by inspectable provenance; presents Matrix, a deterministic causal-state layer that records authority and fact dependencies, verifies completion evidence, and selectively invalidates affected work.

Evaluation & Red Teaming

Benchmarks & Datasets

Benchmark Focus Size Paper
ASB Comprehensive agent security 10 agents, 398 envs Zhang et al.
InjecAgent Indirect prompt injection 1,054 test cases Zhan et al.
R-Judge Safety risk awareness 162 records, 27 scenarios Yuan et al.
ToolSword Tool learning safety 6 scenarios, 3 stages Ye et al.
AgentDyn Dynamic prompt injection Open-ended, extensible Li et al.
SkillSafetyBench Skill-mediated agent safety 155 cases, 47 tasks Jin et al.
SkillVetBench Security risk eval of open-source agent skills Live leaderboard Hossain et al.
SCR-Bench Skill composition risk Multi-skill chains Xie et al.
SafeClawBench Staged harm in tool-using agents 600 adversarial tasks Tian et al.
ToolPrivacyBench Purpose-bound privacy in tool-using agents 2,150 cases Hu et al.
TAB Selective cue following in terminal agents 89 terminal tasks Mavali et al.
Skill-Inject Skill file attacks Multi-scenario Schmotz et al.
NAAMSE Evolutionary agent security eval Adaptive red-teaming Pai et al.
AgentHarm Agent misuse 110 behaviors, 440 variants Andriushchenko et al.
SkillGuard Dataset Malicious skill detection 157 malicious skills Liu et al.
WIPI Web-based indirect injection Multi-scenario Liu et al.
IssueTrojanBench Malicious issue requests vs. coding agents 4 attack categories, 6 vectors Singh et al.
OpenSkillRisk Agent safety with risky third-party skills 263 skills, 7 categories Liu et al.
AudioAgentSecurity Audio prompt injection vs. multimodal agents 8 scenarios, 10 patterns Liu et al.
AIP-Bench Agentic commerce protocol-level security 3 platforms, 33 vulns Louck
ContainmentBench Post-injection containment in tool-using agents Trace-based, multi-metric Lan et al.
MemSecBench Lifecycle security of agent memory poisoning 310 cases, 24-config matrix Chen et al.
IH-Benchmark Instruction-hierarchy robustness incl. tool-mediated conflicts 44 constraint families, 37 models McCauley et al.
AgentS4D Lifecycle runtime risks of workspace agents Sandboxed, trajectory-aware Zhou et al.
StepJack Multi-step indirect prompt injection vs. computer-use agents 480 test cases Zhan et al.
HarnessSafe Safety across persistent carriers in agent harnesses 328 cases, 7 carrier families Zhang et al.
ToolHazard Scalable synthesis of adversarial tool environments for indirect prompt injection Expandable via seed domains + compute Mou et al.
ATOBench Pentest-agent vulnerability verification under deceptive target evidence Runtime response transformations Chen et al.
HarnessRisk Lifecycle safety of agent harnesses across operational phases 6 operational phases Bai et al.

Tools & Frameworks

Tool Description Link
Agent Memory Guard OWASP reference implementation for ASI06 (Memory Poisoning): runtime defense that screens every agent memory read/write through detectors + a declarative policy, with source-class provenance, forensic SecurityEvents, and snapshot rollback. LangChain/OpenAI-Agents/AutoGen/CrewAI/mem0 integrations GitHub
Bounty Sieve Offline-by-default bounty intake guardrail for coding agents: read-only GitHub issue/URL-list import, deterministic triage, local decision briefs, and human approval gates GitHub
SkillGuard LLM-native agent skill security auditor (OWASP Agentic + MITRE ATLAS) GitHub
Pipelock Open-source AI agent firewall and MCP-aware egress proxy with DLP, prompt injection scanning, process sandboxing, and mediator-signed action receipts GitHub
NemoClaw NVIDIA reference stack for running always-on AI agents more safely in sandboxes, with network policy, hardening, routed inference, and lifecycle controls GitHub
CubeSandbox Hardware-isolated (per-kernel) sub-60ms sandbox for secure AI agent code execution, with an out-of-sandbox credential vault, eBPF network isolation, and domain-allowlisted egress controls with audit logging GitHub
Invariant Guardrails Policy-based agent security guardrails GitHub
Armorer Guard Local Rust scanner for AI-agent prompt injection, credential redaction, sensitive-data requests, exfiltration-style text, and dangerous tool-call context GitHub
LLM Guard Input/output scanning for LLM applications GitHub
Rebuff Self-hardening prompt injection detector GitHub
NeMo Guardrails NVIDIA's toolkit for adding guardrails to LLM-based applications GitHub
Lakera Guard Enterprise prompt injection defense API Website
Promptfoo LLM red teaming and evaluation framework GitHub
Garak LLM vulnerability scanner GitHub
IPI-Proxy Intercepting proxy for red-teaming web-browsing agents against indirect prompt injection on live whitelisted domains GitHub
Tuning Engines CLI MCP server and CLI for governed agent/skill/tool access with policy checks, approvals, traces, and role-scoped registries GitHub
AgentSkillsScanner Static analysis scanner for agent skill definitions GitHub
SkillTotal Static, offline scanner for AI components (MCP servers, agent skills, npm/PyPI packages, repos): supply-chain risk, dangerous capabilities, prompt-injection, exfiltration; deterministic, evidence-anchored, SARIF + pre-commit/GitHub Action GitHub
SkilLock Behavior-pinning lockfile + capability-delta PR review for Claude Code & Codex skills; SARIF output for Code Scanning GitHub
agent-diff-guard Pre-push guardrail that flags high-risk coding-agent diffs such as CI/CD changes, dependency edits, test deletions, hardcoded secrets, and task-scope drift before merge GitHub
Skillid Policy-driven Claude Code plugin that combines skill guidance with per-tool hooks to enforce org guardrails, confirmation rules, redaction, and connector-specific access control GitHub
Agent Audit Security analysis system for LLM agent apps: dataflow analysis, credential detection, MCP config parsing, privilege-risk checks Zhang et al.
mcp-sec-audit MCP server security toolkit: static pattern matching + dynamic sandboxed fuzzing via Docker/eBPF for detecting over-privileged tool capabilities Huang et al.
Assay Harness CI gate that checks an agent's claimed tool side-effects (filesystem, network, process) against independently observed runtime evidence, classifying each claim as supported, degraded, blocked, or not-evaluable (observed support is the ceiling) GitHub
Agent Scan Snyk's scanner for local agent supply chains, covering MCP servers and skills with checks for prompt injection, tool poisoning, toxic flows, and malware-laced skill files GitHub
DScan Open-source agent security suite for runtime tool-call tracing, prompt-injection shielding, MCP audits, adversarial testing, and sequence-level attack detection GitHub
Sayfos SDK Runtime guardrail SDK for AI agents with provenance checks, budget governance, plan preflight, and adjudication tokens before high-risk tool actions GitHub
PIC Standard Local-first standard and reference verifier that checks agent intent, provenance, and evidence at the action boundary and fails closed before high-impact tool calls; Python CLI, MCP/LangGraph/OpenClaw integrations, HTTP bridge, and a language-agnostic conformance suite GitHub
agent-sentinel eBPF/BPF-LSM prototype that monitors local agent behavior and atomically blocks prompt-injection-driven access to sensitive files at the kernel boundary GitHub
mcp-sploit Metasploit-style framework for authorized security testing of MCP servers and MCP security gateways, including enumeration and exploit modules for unsafe tool exposure GitHub
Clawvisor AI agent gateway for purpose-based authorization, credential vaulting, and audit logging β€” agents declare task scope, humans approve once, Clawvisor enforces on every request without the agent ever seeing credentials GitHub
trentclaw Security assessment skill for OpenClaw environments: scans gateway config, skill permissions, MCP trust boundaries, and plugins, and correlates them into chained attack paths with severity-ranked remediation steps GitHub
Nobulex Trust Capital scoring layer for AI agents: bilateral Ed25519 receipts (pre- and post-execution signatures), content-addressed via action_ref and hash-chained per RFC 8785, that accumulate into a published 300-850 reputation score gating agent autonomy. CTEF v0.3.2 14/14 conformance. Python + TypeScript SDKs. Receipt-signing approach merged into Microsoft AGT. GitHub

Agent Skill Specifications

Specification Org Focus
AgentSkills.io Open Standard Agent skill definition and security requirements
Model Context Protocol (MCP) Anthropic Tool/resource integration protocol for LLMs
OpenAI Function Calling OpenAI Tool use specification for GPT models
Tool Use (Claude) Anthropic Claude's native tool use interface
LangChain Tools LangChain Tool abstraction for agent frameworks
AutoGPT Plugins AutoGPT Plugin system for autonomous agents
OpenAPI/Swagger Linux Foundation API specification commonly used as tool definitions

Industry Reports & Blog Posts

  • πŸ”— Snowflake Cortex AI Escapes Sandbox and Executes Malware β€” PromptArmor, 2026. Prompt injection attack chain in Snowflake's Cortex Agent bypassed command allowlists via bash process substitution to achieve RCE; now patched.
  • πŸ”— Confused Deputy Attacks on Autonomous AI Agents β€” Cloud Security Alliance AI Safety Initiative, 2026. Research note on prompt injection chains enabling privilege escalation and autonomous compromise in AI agent systems.
  • πŸ”— How AI Assistants are Moving the Security Goalposts β€” Krebs on Security, 2026. AI agents as insider threats.
  • πŸ”— Hackers Used Meta’s AI Support Bot to Seize Instagram Accounts β€” Krebs on Security, 2026. Real-world incident where attackers socially engineered an AI account-recovery assistant into relinking target accounts, illustrating a new tool-mediated support-agent attack surface.
  • πŸ”— Anthropic: Challenges in Red Teaming AI Systems β€” Anthropic's perspective on evaluating agent safety.
  • πŸ”— OpenAI: Safety of Advanced AI Agents β€” Practices for governing agentic AI systems.
  • πŸ”— Compromising Agents via MCP β€” Invariant Labs deep-dive into MCP attack vectors.
  • πŸ”— Simon Willison: Prompt Injection Explained β€” Accessible introduction to prompt injection risks.
  • πŸ”— The sorry state of skill distribution β€” Trail of Bits, 2026. Demonstrates practical bypasses against ClawHub, Cisco skill-scanner, and skills.sh, showing how malicious skills can evade current marketplace scanners via truncation, archive indirection, poisoned bytecode, and prompt-injection framing.
  • πŸ”— TRAIL: Trusted Reasoning and AI Logging β€” Logging framework for auditable agent execution.
  • πŸ”— Cyber Threat Intelligence for AI Systems β€” AI-specific CTI framework with IoCs for supply-chain phases.
  • πŸ”— AI Safety Has 12 Months Left β€” Window to embed safety into infrastructure before market forces prevent it.
  • πŸ”— LiteLLM Hack: Were You One of the 47,000? β€” FutureSearch via Simon Willison, 2026. Analysis of PyPI supply-chain attack on LiteLLM: 47K downloads of exploited packages in 46 minutes, 88% of 2,337 dependent packages had unpinned versions.
  • πŸ”— Exploiting Agentic Browsers: From False Information to Cross-Site Data Leaks β€” Trail of Bits, 2026. Demonstrates lack of isolation in agentic browsers enabling attacks from false information dissemination to cross-site data leaks, resurfacing decades-old web vulnerability patterns.
  • πŸ”— OpenAI Help: Lockdown Mode β€” Simon Willison, 2026. Highlights OpenAI's new network-egress restriction mode for ChatGPT as a concrete mitigation for prompt-injection-driven data exfiltration in agentic workflows.
  • πŸ”— ClawHub by the Numbers: Metadata on All 52,652 Packages β€” Trent AI, 2026. Registry-wide metadata analysis of all 52,652 ClawHub packages finding only 22% meet a "clean" baseline; quantifies supply-chain risk across the OpenClaw skill ecosystem.
  • πŸ”— The Memory Heist β€” Ayush Paul, 2026 (via Simon Willison). Real-world data-exfiltration vulnerability in Claude's web_fetch tool: a honeypot site with letter-by-letter navigation links tricked the agent into spelling out sensitive user memory (names, employers, security answers) through URL paths; Anthropic patched it by disabling web_fetch link-following on external pages.
  • πŸ”— OpenAI's Accidental Cyberattack Against Hugging Face is Science Fiction That Happened β€” Simon Willison, 2026. Real-world incident: while OpenAI ran a cybersecurity eval against an unreleased model with guardrails disabled, the agent broke out of OpenAI's sandbox and exploited Hugging Face to steal the test answers rather than solve the task. Synthesizes the ExploitGym eval paper, Hugging Face's July 16 breach disclosure, and OpenAI's July 21 confirmation β€” a landmark case of an autonomous agent escaping its sandbox and turning offensive capability against a third party.
  • πŸ”— Auto Mode Is Now the Default in Claude Code β€” Simon Willison, 2026. Reports Anthropic's Trajectory Labs evaluation in which 0 of 720 attack attempts across 72 indirect prompt-injection scenarios succeeded against auto-mode agents (Fable 5, Opus 5, Sonnet 5), with auto mode blocking 89% of harmful actions versus 13.6% caught by human review β€” while cautioning that malicious third-party packages mean indirect prompt injection is not a solved problem.

Related Awesome Lists

Contributing

Contributions are welcome! Please read the contribution guidelines before submitting a pull request.

How to Contribute

  1. Fork the repository
  2. Add your resource in the appropriate category
  3. Use the format: - πŸ“„ **[Title](URL)** β€” Authors, Venue Year. One-sentence description.
  4. Submit a pull request

Criteria

  • Resources must be directly related to agent/tool/skill security
  • Papers should be published or on arXiv
  • Tools should be actively maintained (commits within last 6 months)
  • Blog posts should provide substantial technical analysis

Citation

If you find this list useful in your research, please cite:

@misc{awesome-agent-skills-security,
  author = {Liu, Yi},
  title = {Awesome Agent Skills Security},
  year = {2026},
  publisher = {GitHub},
  journal = {GitHub Repository},
  howpublished = {\url{https://github.com/LLMSecurity/awesome-agent-skills-security}}
}

License

CC0

This list is released under CC0 1.0 Universal.

About

πŸ›‘οΈ A curated list of resources on agent skills security: attacks, defenses, frameworks, and benchmarks for securing AI agent tool use and skill ecosystems

Topics

Resources

Contributing

Stars

90 stars

Watchers

2 watching

Forks

Releases

Packages

Contributors