The Question Black Hat Keeps Circling This Week: What Will This Code Actually Do?
Black Hat USA 2026 has a number attached to it this year that is hard to ignore: 35 of the 121 Briefings on the schedule, close to 29 percent, are directly about AI security, AI red teaming, or AI-assisted offensive research (Straiker, “AI Agents Take Center Stage at Black Hat USA 2026”). That is not a niche track anymore. It is close to a third of the entire conference.
The number tracks with what is happening inside engineering organizations, including the ones building the AI tools themselves. Anthropic reported in June that more than 80 percent of the code merged into its own codebase is now written by Claude rather than by engineers, up from low single digits before Claude Code’s 2025 launch, with engineers merging roughly eight times as much code as they were two years earlier (Anthropic, “When AI Builds Itself,” June 2026). When code volume grows that fast, human review capacity does not grow with it. That gap is exactly where SOC triage backlogs come from.
Every Tool in Your Stack Still Guesses
Here is what none of those 35 Briefings changes: the tools most SOCs rely on to evaluate a suspicious artifact are still probabilistic.
An EDR platform scores a file against known patterns and behavior signatures and returns a confidence level, not a decision. A sandbox has to execute the file to observe what it does, which takes time and can be evaded by anything built to detect sandbox conditions or wait them out. A threat intelligence feed is only as good as what has already been seen and cataloged somewhere, which is exactly the coverage AI-generated and polymorphic code is designed to fall outside of.
Signature-based controls carry the same ceiling for a simple reason: when every payload is unique, there is no hash to check and no prior observation to match against, and AI-assisted tooling now generates malware variants on demand, built for a single target and never repeated.
Each of these tools is useful. None of them answers the question a SOC analyst actually has to answer before closing a ticket: what will this artifact do if it is allowed to run?
Probabilistic Plus Probabilistic Does Not Equal Deterministic
The instinct when one probabilistic tool is not enough is to add another one. Stack an AI-driven alert summarizer on top of the EDR. Add a second threat intel source. Layer in an autonomous triage assistant.
Every one of those additions makes the queue faster to move through. None of them changes the underlying math. Averaging or chaining together several confidence scores still produces a confidence score. It does not produce a fact, and it does not produce evidence an auditor or a regulator will accept as a documented decision.
That distinction is not a technicality. It is a timing problem as much as a math problem. By the time a high-confidence alert reaches a SOC queue, the artifact has often already run. Detection is working, it is just positioned at the wrong moment in the workflow, downstream of the risk instead of upstream of it.
What a Deterministic Verdict Changes
Pre-execution behavioral analysis evaluates what an artifact is capable of doing before it runs, without detonation, and without relying on a signature or a prior sighting. That behavioral finding gets mapped to MITRE ATT&CK and the Malware Behavior Catalog. The verdict, allow, block, restrict, quarantine, or require review, is what that evidence produces, not a starting assumption.
This matters most on exactly the files this year’s Briefings are worried about: code with no prior observation history, because it was generated by an LLM an hour ago, or code that mutates on every build so no two copies share a signature. Those files are precisely where probabilistic tools have the least to say and where a behavioral verdict has the most value. It is also where composition-based trust signals run out of road. SBOMs, signing, and provenance answer what is inside a build and where it came from, not what it can do once it executes, and an AI coding agent can generate code that works exactly as intended while still introducing consequences nobody authorized.
This Is a Workflow Question, Not Just a Tooling Question
The practical effect on a SOC is that the artifacts driving this year’s Black Hat AI coverage, AI-generated code, agent-produced scripts, autonomously mutating payloads, stop being special cases that need a senior analyst and a sandbox queue. They get evaluated the same way, and the same way, as every other artifact in triage: analyzed for behavior first, verdict second, documented automatically either way.
Black Hat will keep publishing bigger numbers on AI security every year for a while. The number that should matter more to a SOC Manager is not how much of the conference is about AI risk. It is how many of this week’s flagged artifacts your team can answer for with certainty, and how many are still sitting on a probability score.













