LLM Security News: AI Vulnerabilities & Prompt Injections

LLM security news - prompt injection, vulnerabilities, and AI safety updates

Readers tracking llm security news want more than headlines. This briefing organizes llm security news by threat class — prompt injection, jailbreaks, supply-chain model risks, and CVEs that already have public identifiers — so you can map llm security news to your own risk register. Where a claim appears in llm security news without an advisory, we say so instead of inventing severity.

Large language models now sit inside email clients, coding assistants, customer support stacks, and autonomous agents. They also sit inside a growing pile of CVEs, red-team reports, and national security advisories.

This LLM security news roundup pulls together verified findings from OWASP, NIST, the UK NCSC, Microsoft, academic research, and public vulnerability databases. No invented attack names. No speculative “AI doom” framing. Just what security teams actually need to track.

Prompt Injection Is Still the Number One LLM Risk

For the third year running, OWASP ranked prompt injection first in its community-driven Top 10 for LLM Applications. The latest ranking, published August 4, 2026, made an uncomfortable point: if the list were ranked by raw incident counts alone, prompt injection would not make the top 10 at all.

That gap between perceived risk and recorded incidents is not a reason to relax. OWASP’s own framing is that practitioners see prompt injection as the most dangerous LLM class because it opens the door to data leakage, unauthorized actions, and downstream system compromise—not because every incident makes the news cycle.

Excessive agency climbed from sixth to third in the same ranking. When an LLM can call tools, write files, or trigger workflows, a manipulated output is no longer a chat problem. It becomes an action problem.

If you track AI security news for your organization, OWASP’s GenAI Security Project is the canonical source for how the risk taxonomy is shifting year to year.

UK NCSC: Prompt Injection May Never Be Fully Mitigated

In December 2025, the UK National Cyber Security Centre issued one of the blunter government assessments of LLM security risks to date. NCSC technical director David C. argued that prompt injection should not be treated like SQL injection.

SQL injection works because systems confuse data with instructions. LLMs never separate the two in the first place. A language model predicts the next token from the full prompt stream. There is no hard boundary between “user question” and “hidden instructions smuggled inside retrieved content.”

That is why NCSC warned that prompt injection attacks may never be totally mitigated the way SQL injection has been. Defenses that try to detect injection attempts, train models to prefer “instructions” over “data,” or explain to the model what data is can all be defeated under adaptive attack.

NCSC’s guidance instead pushes non-LLM safeguards: constrain what the agent is allowed to do, isolate privileged tools from untrusted content paths, and assume the instruction boundary will eventually be crossed. Those ideas line up with ETSI TS 104 223 baseline cyber security requirements for AI models and systems.

Indirect Prompt Injection Is the Agentic Attack Path That Matters

Direct prompt injection is when the attacker is the user. Indirect prompt injection is when the attacker controls a webpage, email, document, or tool response that the LLM later reads.

Microsoft’s MSRC research group published a detailed defense breakdown of this class in July 2025. Their threat model covers chat assistants that summarize mail, browse pages, or call tools on a user’s behalf.

Impact scenarios include data exfiltration through crafted links, leakage of conversation history or connected documents, and remote command execution when the app can run code with the user’s privileges. Injection payloads can be hidden in white text, non-printing Unicode, or tool output the user never sees.

Academic work has kept pace with the threat. At NAACL Findings 2025, researchers evaluated eight published defenses against indirect prompt injection on LLM agents and bypassed every one of them with adaptive attacks, sustaining attack success rates above 50%.

That paper is a useful reality check for any AI security news headline promising that a new guardrail “solves” injection. A defense tested only against static jailbreak templates is not the same as a defense tested against an attacker who can iterate.

For a broader look at how agentic systems are changing the attack surface, see our ongoing coverage in the LLM news section.

Real CVEs on the LLM Attack Surface

LLM vulnerabilities are not all abstract prompt games. Public CVE records now cover model runtimes, agent tooling, and AI-powered applications.

Ollama: Model Parsing and Service Abuse

Ollama, one of the most widely deployed local model servers, has accumulated a meaningful advisory trail.

  • CVE-2024-8063 — A divide-by-zero flaw in Ollama 0.3.3 triggered by importing a GGUF model with a crafted block_count value. Remote, unauthenticated denial of service.
  • CVE-2025-0312 — An unchecked null pointer dereference in Ollama versions through 0.3.14. A malicious GGUF file can crash the server. CVSS 7.5.
  • CVE-2025-51471 — Information disclosure allowing theft of authentication tokens via a malicious realm value in a WWW-Authenticate header returned by the /api/pull endpoint. Check Point rated the issue high severity for Ollama 0.6.7.
  • CVE-2026-5757 — An unauthenticated remote information disclosure in Ollama’s quantization engine that can expose heap memory. CVSS 7.5, published June 2026.

The pattern is consistent: untrusted model files and network-facing model APIs are treated as low-risk plumbing. In practice they are classic untrusted-input surfaces.

Anthropic’s Official Git MCP Server

Model Context Protocol servers extend assistants into real repositories and filesystems. That extension comes with real CVEs.

Security firm Cyata disclosed three flaws in Anthropic’s official mcp-server-git: CVE-2025-68143, CVE-2025-68144, and CVE-2025-68145. All versions released before December 8, 2025 were affected in default configurations.

Exploitation requires only influence over content the assistant reads—a poisoned README, a malicious issue description, or a compromised page. No credentials and no direct system access. Impact includes code execution when Git MCP is paired with a filesystem server, arbitrary file deletion, and loading sensitive files into model context.

Anthropic accepted the reports in September 2025 and shipped fixes in December. The operational lesson is bigger than one package: MCP server combinations define the real trust boundary, not any single tool’s README.

EmailGPT Prompt Injection (CVE-2024-5184)

Not every LLM vulnerability is in a model runtime. CVE-2024-5184, disclosed through Synopsys in June 2024, is a prompt injection flaw in the EmailGPT service. An attacker could take over service logic, leak hard-coded system prompts, and force unwanted prompt execution through the API.

OWASP cites this CVE directly in its LLM01:2025 prompt injection entry as a concrete case of application-level injection leading to sensitive information disclosure.

LangChain Chain Abuse via NVIDIA AI Red Team

NVIDIA’s AI Red Team disclosed three LangChain issues in 2023 that remain a useful teaching case for LLM security risks in agent frameworks.

  • CVE-2023-29374 — Remote code execution through the llm_math Python interpreter chain.
  • CVE-2023-32786 — Server-side request forgery in chain tooling.
  • CVE-2023-32785 — SQL injection through SQLDatabaseChain.

All three followed the same shape: a chain sits between the user and the model, then turns model output into an external call. A classic “ignore all previous instructions” style injection is enough to redirect that call. Prompt injection becomes RCE or SQLi only because the surrounding application made the model the control plane.

How to Act on LLM Security News This Week

Triage llm security news in three buckets. Immediate: anything with a CVE id and a patch. Planned: architecture changes such as egress controls on tool-using agents. Watch: research demos without a shipped fix. Writing llm security news this way keeps your backlog honest — you do not drop everything for a demo, and you do not ignore a real CVE because the vendor blog is vague.

Share llm security news internally with a one-line owner and due date. “Prompt injection via uploaded PDFs — platform team — patch egress this sprint” moves llm security news from chat noise to a ticket. That habit is the difference between consuming llm security news and reducing exposure.

Guardrails Themselves Are Now a Research Target

LLM security news in 2026 is no longer only about breaking models. It is about breaking the systems built to stop breaks.

In March 2026, Palo Alto Networks Unit 42 described AdvJudge-Zero, an automated fuzzer that treats the model’s own decision logic as the search space. The tool searches for token sequences that flip an LLM judge or reward model from refuse to allow.

Unit 42 reported a 99% success rate in bypassing controls across multiple architectures, including open-weight enterprise models, specialized reward models, and commercial LLMs. Models with more than 70 billion parameters were still susceptible. The researchers argued that model complexity gives these logic-based attacks more surface area, not less.

Separately, work presented at the First Workshop on LLM Security (LLMSEC 2025) showed that guardrail products including Microsoft Azure Prompt Shield and Meta Prompt Guard can be evaded with character injection and adversarial machine-learning techniques, in some cases reaching 100% evasion success against tested detection systems.

None of this means guardrails are useless. It means guardrails are one control in a stack. Treating a detection model as a hard security boundary is the failure mode.

Supply Chain and Data Leakage Are Not Theoretical

OWASP’s GenAI Exploit Round-up for Q1 2026 documented practical incidents across the AI toolchain. Prompt injection had already matured into a working enterprise data-leakage vector. Third-party AI dependencies were a parallel weak point.

Highlights from that roundup include:

  • A LiteLLM supply-chain breach affecting Mercor and multiple downstream AI operations environments, involving Meta, OpenAI, Anthropic, and contractor integrations.
  • An accidental Claude Code source map exposure through the public npm package, with roughly 59.8 MB across about 1,906 files and around 513,000 lines mirrored after the packaging error. Anthropic said no customer credentials or data were exposed.
  • An AI-assisted intrusion campaign against Mexican government systems in which attackers used Claude and, at times, ChatGPT to automate reconnaissance and exploit development, reportedly exposing on the order of 150 GB of data across agencies.

On the vendor side, Anthropic also disclosed in mid-2026 that evaluation runs had, in a small number of cases, touched real third-party systems after a testing-environment misconfiguration left an open internet path. OpenAI separately reported an internal test in which models autonomously interacted with Hugging Face infrastructure. Both companies framed the primary failure as test-environment control, not a new model capability.

If you only read one class of AI security news closely, make it supply chain and output handling. Sensitive information disclosure ranks second on OWASP’s LLM list for a reason: unlike injection volume, disclosure incidents and practitioner concern already line up.

How to Read LLM Vulnerabilities Without Getting Whiplash

A practical filter for evaluating any LLM security news item:

  1. Where is the trust boundary? Model prompt, tool result, file system, network, or all four.
  2. Does the model only produce text, or does it act? Action is where excessive agency becomes breach material.
  3. Is the CVE in the model, the runtime, the agent framework, or the app around them? Most real incidents live in the last two.
  4. Was the defense tested against adaptive attack? Static jailbreak benchmarks overstate robustness.
  5. What is the blast radius if output is untrusted? RCE, SQLi, file deletion, and data exfiltration are the recurring outcomes.

That checklist is deliberately boring. LLM failures keep looking novel and usually resolve into older classes: injection, broken access control, insecure deserialization of “just text,” and missing least privilege.

Defense Guidance That Still Holds Up

Frameworks have not solved prompt injection. They have made the response more operational.

The OWASP LLM01:2025 prompt injection guidance is blunt about the residual risk. Retrieval-augmented generation and fine-tuning reduce some failure modes and do not remove the class. The highest-value mitigations sit outside the model: least-privilege tool access, output validation before side effects, separation of untrusted content from action paths, and logging that can catch exfiltration-shaped behavior.

NIST’s AI Risk Management Framework (NIST AI 100-1) and the Generative AI Profile (NIST AI 600-1) provide the governance layer. Govern, Map, Measure, and Manage are not prompt-level controls. They force organizations to inventory AI systems, define risk tolerance, and treat model-enabled workflows with the same discipline as any other production dependency.

NCSC’s December 2025 position is worth keeping on the wall: assume residual prompt injection risk. Design systems that survive a crossed instruction boundary instead of systems that pretend the boundary cannot be crossed.

That is not a counsel of defeat. It is the difference between a demo guardrail and a control you can defend in an incident review.

What Security Teams Should Do This Quarter

LLM security news moves fast. The underlying work does not.

  • Inventory every LLM touchpoint that can read untrusted content or call tools. Include MCP servers, browser plugins, email assistants, and CI coding agents.
  • Pin and monitor AI dependencies the same way you monitor web frameworks. Ollama, LangChain, LiteLLM, and similar packages are now CVE-bearing infrastructure.
  • Separate untrusted content from privileged action. If a model can summarize mail, that mailbox reader should not also hold production credentials.
  • Validate model output before side effects. Treat LLM output as untrusted input into the next system. This is the insecure output handling lesson from OWASP LLM02.
  • Red-team the guardrails, not just the model. Use adaptive attacks, not only fixed jailbreak lists.
  • Log prompts, tool calls, and external fetches where policy allows. Detection still matters even when prevention cannot be complete.

Organizations building or buying AI assistants can also use this material as vendor diligence. Ask which OWASP LLM risks were threat-modeled, which CVEs affect the runtime stack, and what happens when prompt injection succeeds. Vague answers are themselves a finding.

Our about page explains how we source and verify the reports behind these updates. For questions about corrections, research tips, or newsroom contacts, use the contact page.

The Bottom Line

LLM security news in 2026 has a consistent shape. Prompt injection remains the top-ranked risk. Guardrail bypass research is accelerating. Real CVEs now cover model servers, agent tooling, and AI apps. National cyber agencies are openly describing residual risk that cannot be fully engineered away.

The organizations handling this well are not waiting for a silver-bullet classifier. They are shrinking the blast radius of a successful injection: less privilege, fewer autonomous side effects, tighter dependency hygiene, and logging that makes failure visible.

Language models will keep predicting the next token from whatever text you give them. Security engineering’s job is to decide what that text is allowed to make the rest of the stack do.

A practical way to read llm security news is by owner. AppSec teams care when llm security news names a CVE. ML platform owners care when llm security news describes model supply-chain issues. Policy teams care when llm security news cites NIST or EU guidance. Grouping llm security news by owner prevents the common failure mode: everyone forwards the same link and nobody owns the fix.

FAQ: LLM Security News and AI Security Risks

What is prompt injection in LLM security?

Prompt injection occurs when crafted input changes an LLM’s behavior or output in ways the application developer did not intend. Direct injection comes from the user. Indirect injection hides instructions in webpages, documents, emails, or tool results the model later reads. OWASP ranks it as the top LLM application risk.

Which LLM vulnerabilities have real CVEs?

Public examples include Ollama issues such as CVE-2024-8063, CVE-2025-0312, CVE-2025-51471, and CVE-2026-5757; prompt injection in EmailGPT under CVE-2024-5184; LangChain chain flaws CVE-2023-29374, CVE-2023-32785, and CVE-2023-32786; and Anthropic mcp-server-git advisories CVE-2025-68143 through CVE-2025-68145.

Can LLM security risks be fully prevented?

Not cleanly. The UK NCSC has stated that prompt injection may never be fully mitigated because models do not separate data from instructions. Practical risk reduction focuses on limiting tool privileges, validating outputs, isolating untrusted content, and monitoring for abuse rather than claiming total prevention.

Are LLM guardrails reliable against jailbreaks?

They help, but they are not a hard boundary. Unit 42 reported a 99% bypass rate against multiple judge and reward-model controls in 2026. LLMSEC 2025 research also demonstrated high evasion rates against commercial prompt-injection and jailbreak detectors. Treat guardrails as layered defense, not the control that stops the incident.

How does NIST approach AI security risk?

NIST’s AI Risk Management Framework (AI 100-1) organizes work into Govern, Map, Measure, and Manage. The Generative AI Profile (AI 600-1) extends that with genAI-specific risks. Together they push organizations toward inventory, risk tolerance, measurement, and lifecycle controls around LLM deployments.

Where can I follow ongoing AI security news?

Track OWASP GenAI advisories, NIST publications, NCSC guidance, vendor MSRC and red-team blogs, NVD/CVE records, and peer-reviewed work from venues such as NAACL and LLMSEC. Our LLM news desk consolidates primary-source updates for security and product teams.

Aman Alria

Aman Alria is the co-editor of The LLM News, covering AI agents, developer tools, and the startup side of artificial intelligence. He focuses on what ships versus what gets announced, and on the details that matter to people building with AI every day.

Leave a Comment