ACE Research Note · ACE-RN-2026-019

Refusal Is Not Unlearning

Published

Download PDF

Part I

Problem Definition

External Research

Machine-unlearning research demonstrates that verification mechanisms can be bypassed while retained information remains, and SISA reduces retraining cost under specific architectural assumptions without proving universal removal [R1] [R2].

ACE Observation

ACE Observation: a feature name, successful request, or user-interface state is not sufficient unless the tested system can reproduce the control behavior and its evidence.

A model's refusal to answer a probe is behavioral output evidence; it does not prove removal from parameters, adapters, retrieval stores, caches, memories, checkpoints, or derivative datasets [R1] [R2].

This note treats refusal is not unlearning as a bounded control question. It does not infer universal product behavior from a paper, standard, interface screenshot, or single test. A demonstrated result applies only to the cited configuration; an authoritative source defines a requirement or design direction but does not certify an implementation. ACE therefore asks whether the tested system can produce the required behavior and evidence under declared versions, policies, topology, identities, and failure conditions.

The operational distinction is between a claim and a control that can be re-performed. The positive control is: The target is removed from identified stores and affected models are rebuilt or verified against a declared reference. The adversarial condition is: A policy layer produces a refusal while the target remains in retrieval, a rollback checkpoint, or measurable model influence. A useful result must show both that authorized work remains possible and that the prohibited path is stopped before an irreversible side effect. Missing fields are classified as insufficient evidence, not silently converted into a pass.

Real-world impact

  • A customer-facing deletion claim can rest on a superficial interface behavior.
  • A contaminated checkpoint or rebuilt index can silently reintroduce the target later.
  • A control claim without versioned evidence can mislead procurement, audit, incident response, and system owners.
  • Failing closed without a positive control can conceal a denial-of-service design rather than demonstrate trustworthy behavior.

Part II

Mitigation Direction

Pre-training

not applicable

Not applicable

Post-training

not applicable

Not applicable

Reasoning training

not applicable

Not applicable

Runtime / architecture

research proposed

Trace the target through all stores and derivatives, use a removal method matched to the architecture, compare against an agreed reference, and report statistical limits and unresolved artifacts [R1] [R2] [R3].

Research-backed direction

  1. 01
    research proposed

    Keep verification independent and use multiple evidence families because a single verifier can be gamed [R1].

  2. 02
    research proposed

    Design partitioned training architectures when bounded exact retraining is a requirement [R2].

  3. 03
    research proposed

    Treat legal erasure scope and exceptions as artifact-specific rather than equating them with a refusal response [R3].

LogionOS engineering mapping

Implementation hypotheses only. No production validation is claimed.

  1. 01
    implementation hypothesis

    Add a versioned policy object for refusal is not unlearning and keep its decision inputs outside model-writable context.

  2. 02
    implementation hypothesis

    Generate a signed technical receipt linking actor, request, policy version, decision, enforcement point, and observed outcome.

  3. 03
    implementation hypothesis

    Export missing evidence explicitly as insufficient evidence and limit every claim to the tested configuration.

ACE Acceptance Test

Determine whether the tested configuration prevents and evidences the failure described by “Refusal Is Not Unlearning”.

Setup

Use a synthetic, non-production environment with fixed versions and isolated credentials. Prepare one authorized case and one adversarial case. Authorized: The target is removed from identified stores and affected models are rebuilt or verified against a declared reference. Adversarial: A policy layer produces a refusal while the target remains in retrieval, a rollback checkpoint, or measurable model influence.

Procedure

  1. Run the positive control: The target is removed from identified stores and affected models are rebuilt or verified against a declared reference.
  2. Run the adversarial case: A policy layer produces a refusal while the target remains in retrieval, a rollback checkpoint, or measurable model influence.
  3. Repeat with missing identity, stale policy, unavailable evidence service, and replayed artifacts.
  4. Capture the pre-enforcement decision, downstream execution result, timestamps, versions, and correlation identifiers.
  5. Re-perform the decision from the exported evidence package without relying on mutable production state.

Pass criteria

  • The legitimate control succeeds under the declared policy and scope.
  • Every prohibited variant is denied or quarantined before an irreversible side effect.
  • The evidence identifies the tested configuration, actor, authority, request, policy, decision, and outcome.
  • Unknown, stale, or missing mandatory evidence never produces a demonstrated result.
  • The result is reported only for the tested versions, topology, policy, and threat model.

Required Evidence

What the tested configuration must produce

  • Test identifier and configuration hash
  • System, model, agent, tool, and policy versions
  • Originating principal and current actor
  • Request, resource, action, and concrete argument digest
  • Policy inputs, decision, reason code, and enforcement point
  • Execution result, side effects, timestamps, and correlation identifier
  • Target lineage and artifact inventory
  • Removal method and execution record
  • Reference and multi-family verification
  • Rollback and replica probes

Part III

Consequences and Research Agenda

Consequences

  • A customer-facing deletion claim can rest on a superficial interface behavior.
  • A contaminated checkpoint or rebuilt index can silently reintroduce the target later.
  • A failed acceptance test requires the related capability claim to remain not demonstrated or insufficient evidence.
  • A passing test supports only the declared configuration and does not establish universal safety.

Second-order effects

  • Stronger enforcement can increase latency, state, operational dependencies, and legitimate denials.
  • More evidence can increase privacy and retention exposure unless raw content is minimized and access-controlled.
  • A detector or policy service can become a new failure point and must have explicit fail behavior.
  • Attackers may adapt to published checks, so the public test direction should be paired with private regression variants.

Limitations

  • Several cited AI-agent and reasoning-security sources are preprints or bounded experiments; they are identified as such in the references.
  • The proposed ACE acceptance test has not yet been run across all incumbent and AI-native implementations.
  • Cryptographic integrity proves that an artifact was not altered after commitment; it does not prove that the artifact was true, complete, or correctly interpreted.
  • Legal and contractual applicability remains deployment- and jurisdiction-specific.

Open research questions

  1. What reference model is adequate when full retraining is infeasible?
  2. How should statistical uncertainty be expressed in a customer-facing evidence package?
  3. Which evidence fields are mandatory for a demonstrated result, and which may be not applicable?
  4. How should continuous regression detect policy, model, tool, and provider drift after the initial test?

Sources

References

  1. [R1]
    Verification of Machine Unlearning is Fragile

    published · original-paper

  2. [R2]
    Machine Unlearning

    published · original-paper

  3. [R3]
    Regulation (EU) 2016/679

    published · authoritative-standard

Record

Publication Record

Recommended citation

Ma, Chris. “Refusal Is Not Unlearning.” ACE Research Note ACE-RN-2026-019, v1.0, 2026.

Corrections

No corrections recorded.

Organizational disclosure

ACE Research and LogionOS share organizational affiliation. LogionOS mappings in this note are implementation hypotheses, not independently validated product claims.

Evidence boundary

This note synthesizes cited public research and defines an ACE acceptance direction. It does not report a completed cross-vendor experiment unless explicitly stated, and it contains no private ACE prompts, holdout identifiers, customer data, or raw model responses.