What is the latest update in the AI safety market?

The AI safety market is moving fast, and Q1 2026 brought federal policy moves, platform acquisitions, and fresh fundraising rounds that are reshaping the landscape.

We constantly update this blog post so you always have the latest picture of what is happening in the AI safety market.

We estimate the AI safety market will reach $5.5 billion globally in 2026, and the activity this quarter shows why.

And if you want to better understand this new industry, you can download our pitch covering the AI safety market.

Summary table of the most important updates in the AI safety market

We define the AI safety market as products and services that reduce harms and failure modes from AI systems by measuring, mitigating, and governing model behavior and AI-specific risk.

We include AI evaluation and red teaming, safety monitoring and incident response, safety/guardrail layers, and AI trust-risk-security management capabilities such as governance, robustness, privacy/security controls, and explainability when used for risk reduction.

We exclude generic MLOps, general cybersecurity, and general compliance or content moderation offerings unless they are specifically designed to address AI-model behavior or AI-specific threats.

You can also get all the latest market news for the month here.

News	Category	Date	Source
White House pushed a national AI framework, reshaping rules around safety and child protection	Regulations & Policies	March 20, 2026	The White House
Databricks jumped into AI security and bought two startups in one move	M&A	March 24, 2026	Databricks
F5 and Forcepoint linked data security to runtime guardrails in a major AI safety alliance	Partnerships	March 24, 2026	Forcepoint
The biggest international AI safety report yet landed with 100+ experts and 30+ backers	Market Research	February 3, 2026	International AI Safety Report
Gartner said AI governance is becoming a billion-dollar software market	Market Research	February 17, 2026	Gartner
F5 turned AI guardrails and red teaming into a live commercial product line	Product launches	January 14, 2026	F5
WitnessAI raised $58 million, one of the quarter's biggest pure-play AI security rounds	Fundraisings	January 13, 2026	PR Newswire
Fiddler raised $30M to build a control plane for AI agents	Fundraisings	January 27, 2026	Fiddler AI
OPAQUE raised $24M to make confidential AI usable with sensitive enterprise data	Fundraisings	February 12, 2026	PR Newswire
NIST published fresh evidence on how AI agents fail under red-team pressure	Breakthrough	March 23, 2026	NIST
OWASP released new GenAI security guides as AI security consolidation accelerated	New tech and infrastructure	March 19, 2026	OWASP
Forcepoint launched ARIA to write AI risk policies and speed incident response	Product launches	March 4, 2026	Forcepoint

How is the AI safety market doing now?

How do we define the AI safety market?

We define the AI safety market as products and services that reduce harms and failure modes from AI systems by measuring, mitigating, and governing model behavior and AI-specific risk.

We include AI evaluation and red teaming, safety monitoring and incident response, safety/guardrail layers, and AI trust-risk-security management capabilities such as governance, robustness, privacy/security controls, and explainability when used for risk reduction.

We exclude generic MLOps, general cybersecurity, and general compliance or content moderation offerings unless they are specifically designed to address AI-model behavior or AI-specific threats.

This is also the definition we use in our report covering the AI safety market.

How big is the AI safety market in 2026?

We estimate the AI safety market will reach approximately $5.5 billion globally in 2026, based on the AI TRiSM backbone at $3.5 billion plus about $2 billion in incremental red teaming, evaluation, and safety operations spending.

This is not a random guess, if you want to know how we have come up with this estimate, you can read our AI safety market size analysis here.

To put that in perspective, the AI safety market in 2026 is roughly the size of the global video conferencing market, and it represents about 2.75% of the $200 billion cybersecurity market.

The AI safety market scores 35 out of 100 on maturity (still early), 80 out of 100 on competitiveness (very contested), and 75 out of 100 on fragmentation (lots of specialist tools, no dominant platform yet).

How fast will the AI safety market grow in the future?

We expect the AI safety market to grow at about 25% per year from 2026 through 2030, sitting between the aggressive governance-only forecasts (35-45%) and the slower broad risk management rates (12-13%).

At that pace, the AI safety market should reach approximately $13.4 billion by 2030 and could hit $51.2 billion by 2036, which would represent about 9 times growth in ten years.

For comparison, that 2030 figure would make the AI safety market roughly the size of today's enterprise content management market, and the 2036 figure would put it in the same range as the current global CRM software market.

What does current funding activity look like in the AI safety market?

Our team, who continually updates our AI safety market pitch deck, is keeping a close eye on the market and tracking key signals.

One of those signals is fundraising activity across startups. Each month, we refresh this page with a list of startups of the AI safety market that have raised funding, and we also publish a quarterly analysis here.

Is funding momentum accelerating or cooling in the AI safety market these days?

In Q1 2026, the three largest disclosed AI safety rounds totaled $112 million (WitnessAI at $58M, Fiddler at $30M, and OPAQUE at $24M), which shows strong investor appetite for pure-play AI safety startups heading into the year.

Compared to the same period a year ago, AI safety funding is growing in both deal size and investor conviction, driven by the EU AI Act deadline approaching in August 2026 and rising enterprise demand for agentic AI security.

Average deal sizes in Q1 2026 skewed toward larger rounds, with two deals above $30 million, suggesting the AI safety market is maturing past seed-stage experimentation into growth-stage scaling.

Which categories and business models are attracting capital in the AI safety market?

These categories and business models of the AI safety market are receiving important fundraising currently:

• Agentic AI security and governance attracted the largest round, with WitnessAI raising $58 million for agent-level identity, observability, and runtime controls.
• AI observability and control planes drew $30 million to Fiddler, which is building standardized telemetry and policy enforcement for compound AI systems.
• Confidential AI infrastructure secured $24 million for OPAQUE, which focuses on privacy-preserving computation for sensitive enterprise data.

The pattern is clear: investors in the AI safety market are backing companies that go beyond simple prompt filtering and instead offer infrastructure-level safety for agents, data, and multi-model systems.

Who's writing the most checks in the AI safety market?

These investors are being very active when it comes to fundraising in the AI safety market:

• Ballistic Ventures is a cybersecurity-focused venture firm that backed WitnessAI's $58 million round, showing deep conviction in AI agent security as the next big safety category.
• Lightspeed Venture Partners participated in Fiddler's $30 million Series C, betting on the AI control plane category as an essential infrastructure layer for enterprise AI safety.
• Intel Capital backed OPAQUE's $24 million Series B, signaling that hardware-adjacent investors see confidential AI as a critical part of the AI safety stack.

The mix of cybersecurity specialists, growth-stage VCs, and strategic corporate investors shows that AI safety funding is attracting capital from multiple angles, not just one type of backer.

Any big acquisitions or IPOs in the last three months in the AI safety market?

These are the big acquisitions and IPOs that happened recently in the AI safety market:

• Databricks acquired both Antimatter and SiftD.ai in a single announcement on March 24, 2026, bundling secure AI agent authentication and threat analytics into its data platform.

This double acquisition by Databricks is a strong signal that large platform companies now view AI safety features as core infrastructure, not optional extras, which could accelerate consolidation across the AI safety market.

How are companies in the AI safety market performing overall?

We are watching this market everyday, because we need to constantly update our pitch deck. Here is a couple of things we have noticed.

Are there any standout success metrics or financial results in the AI safety market?

Yes, a few AI safety companies shared impressive growth numbers this quarter:

• WitnessAI reported over 500% ARR growth and said it now protects hundreds of thousands of enterprise employees and apps, making it one of the fastest-growing pure-play AI safety vendors.
• Fiddler reported more than 4x revenue growth over the past 18 months, showing strong enterprise demand for AI agent observability and governance platforms.
• OPAQUE reached a $300 million post-money valuation at its Series B, which is a notable milestone for a confidential AI infrastructure company.

These numbers suggest the AI safety market is producing real commercial traction, not just hype, with multiple companies showing the kind of revenue acceleration that attracts follow-on investment.

Have there been any major partnerships in the AI safety market?

Yes, one major AI safety partnership stood out this quarter:

• F5 and Forcepoint partnered to connect data security with runtime AI protection, combining Forcepoint's data discovery and classification with F5's AI guardrails and red teaming into one workflow.

This partnership shows buyers are pushing for end-to-end AI safety stacks rather than buying data security and runtime protection separately, which could reshape how AI safety vendors position their products.

Have there been any notable technology or infrastructure breakthroughs in the AI safety market?

Yes, a few important AI safety technology developments happened this quarter:

• NIST published results from a large-scale AI agent red-teaming competition, providing practical evidence on how agents can be manipulated through indirect prompt injection and external content.
• OWASP expanded its GenAI security frameworks with new landscape guides, and noted that several of its sponsor alumni have already been acquired by larger security players.

Both developments give the AI safety market shared benchmarks and open frameworks, which typically help buyers compare products and help the overall category grow faster.

Have any companies restructured or shifted pricing or business model in the AI safety market?

We did not spot any major restructuring, pricing changes, or business model shifts during Q1 2026 in the AI safety market.

Are there any other notable wins or successes in the AI safety market?

Yes, two product launches stood out as notable wins:

• F5 launched commercially available AI Guardrails and AI Red Team products in January, moving AI runtime protection from pilot stage to standard enterprise purchasing.
• Forcepoint launched ARIA, an AI assistant that helps teams create enforcement policies and speed up AI-related incident response, showing the AI safety market is moving from dashboards to automated action.

These launches show that AI safety is no longer just a startup game. Large infrastructure vendors are shipping real products, which raises the bar for everyone in the AI safety market.

What is the overall sentiment in the AI safety market right now?

Are there any notable recent opinion pieces, thought leadership about the AI safety market?

Yes, one major thought leadership piece stood out this quarter:

• COSO released a practical roadmap for managing generative AI risks and controls, translating AI safety concepts like prompt manipulation, model drift, and opaque reasoning into the language of internal audit and compliance teams.

This matters because AI safety spending grows faster when non-technical buyers like audit and finance teams can understand the problem and justify the budget.

Are there any interesting and recent market research reports about the AI safety market?

Yes, several important AI safety market research reports came out during Q1 2026:

• The International AI Safety Report 2026 was published with over 100 experts and backing from more than 30 countries, making it the broadest scientific consensus document on AI risks and safeguards to date.
• Gartner published a forecast saying AI governance platform spending will hit $492 million in 2026 and exceed $1 billion by 2030, confirming this is becoming a standalone software budget line.
• Zscaler published its 2026 AI Threat Report, revealing an 83% year-over-year surge in enterprise AI activity and critical flaws in every system the company analyzed.

These reports all point in the same direction: AI adoption is outrunning safety controls, which means the AI safety market has strong demand drivers for the rest of 2026 and beyond.

Have there been any regulatory changes, policy updates, or new compliance requirements in the AI safety market?

Yes, two significant regulatory developments shaped the AI safety market in Q1 2026:

• The White House unveiled a national AI legislative framework on March 20, covering child safety, privacy, deepfakes, and federal preemption of state-level AI rules, which could quickly change which AI safety products buyers need first.
• The European Commission held the first meeting of the Signatory Taskforce for the General-Purpose AI Code of Practice on February 12, moving from writing AI rules to organizing real implementation ahead of the August 2026 deadline.

With both the US and EU moving from policy debate to concrete action, AI safety vendors are likely to see faster purchasing decisions as companies scramble to meet new requirements.

Who is the author of this content?

NEW MARKET PITCH TEAM

We track new markets so founders and investors can move faster

We build living “market pitch” documents for emerging markets: from AI to synthetic biology and new proteins. Instead of digging through outdated PDFs, random blog posts, and hallucinated LLM answers, our clients get a clean, visual, always-updated view of what’s really happening. We map the key players, deals, regulations, metrics and signals that matter so you can decide faster whether a market is worth your time. Want to know more? Check out our about page.

How we created this content 🔎📝

At New Market Pitch, we kept seeing the same problem: when you look at a new market, the data is either missing, paywalled, or buried in 300-page reports that feel like they were written in the 80s. On the other side, LLMs and random blog posts give you confident answers with no sources, and sometimes they just make things up. That’s not good enough when you’re about to invest real money or launch a company.

So we decided to fix the experience. For each market we cover, we build a structured database and update it on a regular basis. We track funding rounds, fund memos, M&A moves, partnerships, new products, policy changes, and the real activity of startups and incumbents. Then we turn all of that into a clear “market pitch” that shows where the opportunities are and how people actually win in that space.

Every key data point is checked, sourced, and put back into context by our team. That’s how we can give you both speed and reliability: fast coverage of new markets, without the usual guesswork.