Your Evaluation Sandbox Holds Production Authority
An evaluation environment can be disposable while its credentials are not. A practical design for separating test workloads, provider keys, and production authority.
notebook / tag
#aisecops
23 entries with this tag.
What Happens Before the SOC Can Respond?
The PaperCut campaign is a reason to examine exposure, privileged access, and rehearsed containment. Detection cannot carry the entire burden of defending against faster exploitation.
Your Agents Share More Than You Think
METR's investigation adds an agent-coordination layer to the Hugging Face incident. Shared caches and agent-controlled transcripts need to be part of the isolation threat model.
Vendor Approval Is Not Your Authorization Model
Restricted cyber-model access adds a governance decision above the API key. Your organization still has to decide who can use that capability, against which systems, and how to revoke it.
A Pentest Story Is Not Authorization
Aur0ra operators reportedly persuaded a coding agent that real intrusions were authorized tests. The lesson is not simply that models can be fooled. Authorization has to exist outside the conversation.
Prompt-Injection Testing Belongs in CI
ToolHazard turns indirect prompt-injection testing into executable, stateful evaluation. The useful lesson is not its leaderboard. It is how to make agent security a repeatable release gate.
Disabled Is Not Removed
Two Rovo disclosures show why agent governance cannot stop at an admin-console toggle. Security teams need to verify runtime capabilities, data reach, and egress independently.
Telemetry Is an Instruction Channel
GhostJacking shows how attacker-controlled text can cross from WAF events, logs, and error reports into privileged agent actions. The missing control is provenance from evidence to side effect.
Your Agent Config Is Executable Code
ChainDrop used npm lifecycle scripts to steal credentials and spread, then planted Claude Code and VS Code configuration as secondary execution paths. Those files belong in the executable supply-chain surface.
The Range Was Not a Boundary
Anthropic found three real intrusions inside cyber evaluations whose prompts claimed the internet was unavailable. A safe range needs machine-enforced scope, verified egress, and live boundary detection.
Seventeen Thousand Actions, Five Days, One Detection Contract
Hugging Face reconstructed roughly 17,600 actions across an autonomous intrusion. The durable lesson is a detection contract that joins agent, identity, Kubernetes, network, and source-control evidence.
Red, Blue, Green, and Who Can Change Production?
Project Perception puts red, blue, and green agents into a closed security loop. Autonomous remediation needs separate identities, signed evidence, deterministic policy, rollback, and independent validation.
When the Attacker Is a Model Passing a Test
An OpenAI model evaluation became a real intrusion into Hugging Face. The useful lessons are about containment, credentials, ephemeral telemetry, and whether responders can analyze hostile evidence.
Five Models, One Hallucination
Five models produced the same 127 package-name candidates. Registry review narrowed them to 53 registrable slopsquatting targets, turning model hallucinations into a supply-chain watchlist.
Nine of Fourteen Behaviors, Two That Alert
CrowdStrike found viable detection signals for nine of fourteen SANDWORM_MODE behaviors, but only two were reliable enough to alert. The result shows where behavioral detection weakens and where provenance still helps.
Detecting the Confused Deputy in Azure DevOps MCP
A hidden pull-request comment turned legitimate MCP calls into a cross-project data path. Detecting it requires source, identity, scope, sequence, and sink.
What Hermes Changed in Post-Exploitation—and What It Didn't
A threat actor used an unattended AI agent inside a real intrusion. The useful lesson is in the evidence it added, not the capabilities it replaced.
Using Citadel to Make Microsoft Foundry Governance Real
I am using the Foundry Citadel reference platform to test how identity, network isolation, gateway policy, observability, and agent lifecycle controls fit together in a governed Azure deployment.
The Agentic Attack Surface Does Not Stay Still
Four recent papers show why LLM security now has to cover memory, retrieval, tools, identity, delegation, interfaces, and the infrastructure around the model.
Using MITRE ATLAS to Make AISecOps Threat-Informed
MITRE ATLAS gives AI security teams a shared map of adversary behavior for threat modeling, detection engineering, red teaming, and incident response.
Using OWASP's Agentic Top 10 to Govern Systems That Act
The OWASP Agentic Top 10 moves security beyond model output and into goals, tools, identities, memory, delegation, and runtime control.
Using the OWASP LLM Top 10 as an Engineering Baseline
The OWASP LLM Top 10 turns common language-model failure modes into security requirements, tests, telemetry, and response plans.
Using NIST AI RMF to Build an AISecOps Program
NIST AI RMF gives an AI security program its operating model: govern the work, map the context, measure the risk, and manage what happens next.