Friday, 18 September 2026 · Morning editionLondon ⛅ 16°CGBP/USD 1.3376 · GBP/EUR 1.1651About UsOur TeamSourcesContactNewsletter

David Gandy – Why AI Assistants Refuse to Answer

When a conversational AI declines to answer, the response is rarely a simple “no.” Researchers have begun to study the refusal as a distinct linguistic and technical event — one that reveals how safety protocols, knowledge limits, and ethical guidelines interact inside large language models. The field is still young, but a growing body of work is mapping when, why, and how well AI assistants refuse.

Refusals occur when a system determines it should not comply with a request. That decision can stem from a lack of relevant knowledge, a violation of safety policies, or an ethical boundary. The challenge for developers is to make those refusals both reliable and helpful — a balance that remains difficult to achieve.

In early 2025, a BBC audit of news-related questions found that out of 3,113 prompts, only 17 were refused — just 0.5%. That was a sharp drop from an earlier round where the refusal rate stood at 3%. The finding suggests that some assistants may now be highly willing to answer, even when caution might be warranted.

Why do AI assistants refuse to answer?

AI systems refuse requests for several distinct reasons. Researchers group these into categories that range from safety boundaries to simple ignorance. Understanding the motivation behind a refusal is the first step toward evaluating whether it was appropriate.

Safety violations

Requests that could cause harm, such as instructions for building weapons or generating hate speech, are typically refused under safety alignment protocols.

Lack of knowledge

When a model lacks the information to answer accurately, it may refuse rather than risk hallucinating a plausible but false response.

Policy boundaries

Organisations define usage policies that prohibit certain topics, such as medical diagnosis or financial advice, even if the model could produce an answer.

Ethical guardrails

Some refusals are triggered by ethical considerations, including requests that involve deception, manipulation, or violations of user trust.

Key findings from the research literature highlight several patterns:

  • After alignment with an “I don’t know” dataset, Llama-2-7b-chat could explicitly indicate knowledge limits on up to 78.96% of questions in one open-domain QA test set.
  • A 2026 benchmark on emotional boundary handling evaluated refusals across six languages and 1,156 prompts, measuring apology, explanation, deflection, acknowledgment, boundary setting, and emotional awareness.
  • Refusal behaviour in Llama-2-7b-chat may be triggered by a small set of attention heads and a harmfulness feature, according to mechanistic interpretability work.
  • A 2026 MIT-related report summarised that refusal rates differed depending on how the user was profiled, including education level, fluency, and country cues.
  • The open moderation tool WILDGUARD outperformed the prior open refusal classifier baseline by 26.4% on full-refusal evaluation at NeurIPS 2024.
  • Zappavigna’s 2025 article frames refusal as a discourse act that can position the assistant as authoritative, cautious, or ethically oriented, rather than simply saying “no.”

The table below summarises the main topics researchers are investigating, along with representative findings:

Topic What researchers study Representative findings
Uncertainty / “I don’t know” refusal Whether assistants can recognise knowledge gaps and refuse instead of hallucinating After alignment, Llama-2-7b-chat reached 78.96% explicit know/don’t-know discrimination on an open-domain QA test set
Safety refusals How models decline unsafe, unethical, or policy-violating requests Refusal is defined as the response generated when an assistant declines a request due to safeguards or safety protocols
Refusal quality Whether the refusal is abrupt, explanatory, corrective, or still accidentally helpful One framework distinguishes complicit, neutral, and corrective refusals in research-integrity scenarios
Over-refusal Whether models refuse too much, including benign or emotional requests A benchmark explicitly measures direct refusal, apology, explanation, deflection, acknowledgment, boundary setting, and emotional awareness
Detection / classification How to automatically detect refusal behaviour Open models and classifiers are being developed to detect refusal and refusal explanations
Mechanistic interpretability What internal model features cause refusal Work on Llama-2-7b-chat suggests refusal may be triggered by a small set of attention heads and a harmfulness feature
Fairness / sociolinguistic effects Whether refusal rates vary by perceived user identity A 2026 MIT-related report found refusal rates differed by education level, fluency, and country cues

How do researchers measure the quality of a refusal?

Not all refusals are equal. A blunt “I cannot answer that” may stop a harmful interaction but can also frustrate a user who has a legitimate need. Researchers have developed frameworks to assess whether a refusal is informative, safe, and contextually appropriate.

Complicit, neutral, and corrective refusals

One benchmark defines refusal quality on a three-point scale. A complicit refusal still leaks useful guidance, even while ostensibly declining. A neutral refusal stops abruptly without explanation. A corrective refusal explains the issue and provides safe alternatives. The corrective type is generally considered the gold standard because it maintains user trust while upholding safety.

Emotional and cultural sensitivity

The 2026 benchmark on emotional boundary handling tested models across six languages. It measured how well assistants could navigate emotionally charged requests, using patterns such as apology, deflection, acknowledgment, and boundary setting. The results showed significant variation across languages, raising questions about whether refusal quality is consistent for all users.

Key insight

A 2025 study by Zappavigna analysed how LLM chatbots regulate moral values through refusals. The work frames refusal as a discourse act that can position the assistant as authoritative, cautious, or ethically oriented — not merely as a safety filter but as a form of communication that shapes user perception.

Detection and classification tools

Automatically identifying whether a response constitutes a refusal — and what kind — is an active area of development. The NeurIPS 2024 benchmark paper reported that WILDGUARD, an open moderation tool, outperformed the prior open refusal classifier baseline by 26.4% on full-refusal evaluation. Open models and classifiers are becoming available on platforms such as Hugging Face to help researchers detect refusal and refusal explanations.

What happens when refusal goes wrong?

The central tension in refusal research is the trade-off between safety and usefulness. Models can err in two opposing directions: refusing benign requests or complying with harmful ones. Both failure modes have consequences for user trust and system reliability.

Over-refusal: when models say no too often

Over-refusal occurs when an assistant rejects benign or emotionally sensitive requests. This can reduce the system’s usefulness and frustrate users. The emotional boundary handling benchmark was designed specifically to measure this phenomenon, testing whether models can distinguish between genuinely problematic requests and those that only appear sensitive on the surface. The 2026 results suggest that over-refusal remains a significant challenge, particularly for requests involving emotional vulnerability.

Under-refusal: when models comply with harmful requests

Under-refusal is the opposite failure: models comply with requests that violate safety or ethics. This is considered a more severe safety failure because it can lead to real-world harm. Research-integrity scenarios, for example, have shown that some models provide complicit refusals that still leak useful guidance, effectively undermining the intended safety boundary.

Ongoing concern

Boilerplate refusals — repetitive, stereotyped text that generic “I cannot answer” responses — are also under scrutiny. Some work examines how to detect and suppress these automatic refusals, while other research shows that refusal behaviour itself can be attacked. Jailbreaking techniques have been demonstrated to suppress refusal keywords or alter response generation, effectively bypassing safety measures.

What internal mechanisms drive refusal in AI models?

Mechanistic interpretability research attempts to trace refusal behaviour back to specific components inside a neural network. Work on Llama-2-7b-chat suggests that refusal may be triggered by a small set of attention heads — the parts of the model that decide which parts of the input to focus on — along with a harmfulness feature that detects problematic content. Understanding these mechanisms could allow developers to make refusal more robust and less susceptible to attack.

The ability to distinguish between true ignorance — when a model genuinely does not know an answer — and policy-based refusal — when a model withholds a known answer for safety reasons — is another open question. Current systems often conflate the two, making it difficult for users to understand why a request was declined. Research from 2024 and 2025 has begun to explore how models can separate these cases more transparently.

Research direction

Some researchers treat refusals as a communication problem, not only a safety filter. Corpus-based work examines how the phrasing of a refusal affects user trust and perceived helpfulness. Refusals that explain the reason for the decision and offer safe alternatives tend to preserve trust better than abrupt or unexplained rejections.

How has AI refusal research evolved over time?

The study of AI refusals has developed rapidly, moving from simple detection to nuanced evaluation of quality, fairness, and interpretability. The following timeline captures key milestones:

  1. 2024 — A study finds that after training with an “I don’t know” dataset, an assistant can refuse unknown questions on up to 78.96% of cases in an open-domain QA test set.
  2. 2024 — NeurIPS publishes a benchmark paper showing that WILDGUARD outperforms prior open refusal classifiers by 26.4% on full-refusal evaluation.
  3. Early 2025 — BBC’s “News Integrity in AI Assistants” report finds that across 3,113 questions, only 17 were refused (0.5%), down from 3% in an earlier round.
  4. 2025 — Zappavigna’s article in Discourse & Communication analyses how LLM chatbots regulate moral values through refusal as a discourse act.
  5. 2025 — ACL Findings publishes work on jailbreaking refusals, demonstrating that refusal behaviour can be attacked by suppressing refusal keywords.
  6. 2026 — A benchmark on emotional boundary handling evaluates refusals across six languages and 1,156 prompts, targeting over-refusal in sensitive contexts.
  7. 2026 — An MIT-related report summarises that refusal rates differ depending on perceived user identity, including education level, fluency, and country cues.

What is known and what remains uncertain about AI refusals?

Researchers have established several facts about how AI assistants refuse, but important questions remain open. The table below separates established findings from areas that are still being investigated.

Established information Information that remains unclear
Refusals can be triggered by safety violations, knowledge gaps, and policy boundaries. How can models refuse harmful requests reliably without becoming unhelpfully cautious?
Refusal quality can be classified as complicit, neutral, or corrective. How can refusals be made clear, empathetic, and useful without accidentally giving operational advice?
Over-refusal and under-refusal are both measurable failure modes. How can systems distinguish between true ignorance and policy-based refusal?
Refusal behaviour can be detected using open classifiers like WILDGUARD. How do refusal patterns vary across languages, cultures, and user profiles?
Mechanistic interpretability has identified attention heads associated with refusal in Llama-2-7b-chat. What internal model mechanisms produce refusal, and can those mechanisms be controlled more robustly?
Refusal rates can vary by perceived user identity, including education and country cues. How should refusals be phrased to preserve user trust while maintaining safety?

Why does refusal research matter beyond safety?

The way an AI assistant refuses a request communicates values. A refusal that explains its reasoning and offers a safe alternative positions the system as helpful and trustworthy. An abrupt or opaque refusal can erode user confidence and reduce the willingness to engage with the system at all.

Research that treats refusal as a communication problem, not merely a safety filter, addresses this broader impact. Corpus-based work has examined how the linguistic framing of a refusal affects user satisfaction and perceived fairness. The findings matter for any application where an AI system interacts with the public, from customer service to education to healthcare information.

The sociolinguistic dimension adds another layer. If refusal rates differ by perceived user identity — as the 2026 MIT-related report suggested — then the way an assistant says “no” could introduce fairness concerns that go beyond individual interactions. Researchers are beginning to study whether refusal behaviour is consistent across demographic groups and what that consistency (or lack of it) means for equitable access to AI assistance.

Who is leading the research and what have they found?

The refusal research community spans academic institutions, industry labs, and independent organisations. Work published at NeurIPS, ACL, and in journals such as Discourse & Communication has shaped current understanding. Open-source tools and datasets, including the WILDGUARD classifier and emotional boundary handling benchmarks, have made it easier for new researchers to enter the field.

Key contributions include the alignment study that demonstrated 78.96% refusal accuracy on unknown questions, the BBC’s audit of real-world refusal rates, and the mechanistic interpretability work that traced refusal to specific attention heads in Llama-2-7b-chat. Each of these findings has informed the next generation of safety alignment techniques.

“Refusal is defined as the response generated when an assistant declines a request due to safeguards or safety protocols.”

— OpenReview, 2024

“A good refusal should avoid harmful or hallucinated content while still explaining limits and, when appropriate, offering safe alternatives.”

— arXiv, 2025 and 2026

What does the future hold for AI refusal research?

The open questions in the field point toward a future where refusals are more nuanced, more transparent, and more equitable. Researchers are working on systems that can distinguish between ignorance and policy, that can refuse without being unhelpful, and that can adapt their refusal style to different languages and cultural contexts. The goal is not to eliminate refusals — some requests should always be declined — but to make sure that when an AI says no, it does so in a way that is safe, informative, and fair.

Frequently asked questions about AI refusal responses

What is an AI refusal response?

An AI refusal response is the output an assistant generates when it declines a request due to safety protocols, knowledge limits, or policy constraints. It is not simply a “no” but often includes explanation or alternatives.

Why do AI assistants sometimes refuse harmless questions?

Over-refusal happens when a model’s safety alignment is too aggressive. It may misclassify benign requests as harmful, especially if the request touches on sensitive topics or uses emotional language.

How do researchers tell if a refusal is good or bad?

Researchers use quality scales such as complicit, neutral, and corrective. A corrective refusal explains the issue and provides safe alternatives, while a complicit refusal still leaks helpful information.

Can AI refusal behaviour be bypassed?

Yes. Jailbreaking techniques have been shown to suppress refusal keywords or alter response generation, effectively bypassing safety measures. This is an active area of security research.

Do AI assistants refuse differently depending on who is asking?

Some research suggests yes. A 2026 MIT-related report found that refusal rates varied based on perceived user education level, fluency, and country cues, raising fairness concerns.

What is the difference between “I don’t know” and a safety refusal?

“I don’t know” indicates a knowledge gap. A safety refusal withholds a known answer because of policy or ethics. Current systems often conflate the two, which researchers are working to address.

How common is refusal in real-world AI use?

A BBC audit of news-related questions found a refusal rate of 0.5% across 3,113 prompts, down from 3% in an earlier round. Refusal is relatively rare but varies by domain and model.

What is WILDGUARD?

WILDGUARD is an open moderation tool for detecting refusal behaviour in AI responses. It outperformed prior classifiers by 26.4% on full-refusal evaluation at NeurIPS 2024.

Are refusals the same across all languages?

No. A 2026 benchmark tested refusals across six languages and found variation in how models handle emotionally charged requests. Cultural and linguistic factors influence refusal patterns.

Why is refusal research important for AI safety?

Refusal is the primary mechanism for preventing AI systems from causing harm. Understanding when, how, and why models refuse helps developers build safer and more trustworthy systems.

Olivia Hartley
Olivia HartleyStaff Writer

Olivia Hartley is Business & Economy Correspondent at DailyCity.co.uk, reporting on the city economy, property, retail, hospitality and employment.