ACE Research

Research for enterprise AI trust.

Benchmark research Failure analysis Evaluation reliability
Technical Whitepaper June 2026

ACE Benchmark v1.1 Technical Whitepaper

The original ACE benchmark methodology, scoring framework, model results, and representative test cases.

This is the frozen record of the June 2026 benchmark round. Its figures are historical and are not recalculated when new evaluations are published.

9
Systems tested
272
Nominal cases
6
Trust domains
21
Controls

Focused evidence, published with limits.

Published · 2026-08-18

ACE-RN-2026-019 · Data handling safeguards

Refusal Is Not Unlearning

A model's refusal to answer a probe is behavioral output evidence; it does not prove removal from parameters, adapters, retrieval stores, caches, memories, checkpoints, or derivative datasets

Published · 2026-08-18

ACE-RN-2026-013 · Human approval integrity

The Approval Button Is Not Authorization

A click records an interface event but does not prove that the reviewer was authorized, saw the final action and evidence, understood the scope, or that the backend enforced the approved object

Published · 2026-08-18

ACE-RN-2026-011 · Decision evidence completeness

Logs Are Not Proof

Ordinary logs can omit relevant events, accept mutable free text, lack actor or policy context, and be rewritten by the same system whose conduct they are meant to establish

Published · 2026-08-18

ACE-RN-2026-009 · Decision evidence completeness

A Decision Without Its Evidence

A record that stores only approve or deny and a free-text reason cannot prove which inputs, policy version, alternatives, evidence artifacts, and authorized approver existed at decision time

Published · 2026-08-18

ACE-RN-2026-007 · Tool & data authorization

The Over-Tooled Agent

An agent can expose too many tools, overly broad tool functions, or credentials whose effective permission closure exceeds the current task

Published · 2026-08-18

ACE-RN-2026-006 · Tool & data authorization

Tool Access Is Not Data Authority

A tool being visible, schema-valid, and technically able to reach a record does not prove that the current principal authorized this concrete resource, parameter, purpose, and destination

Published · 2026-08-18

ACE-RN-2026-005 · AI identity attribution

One API Key, Many Agents

Multiple agents using one API key collapse distinct software identities, tasks, principals, and authority boundaries into a single credential holder

Published · 2026-08-18

ACE-RN-2026-004 · AI identity attribution

Who Did the Agent Act For?

An action can identify the immediate workload yet fail to preserve the human or service principal, delegation purpose, and actor chain on whose behalf the agent acted

Published · 2026-08-18

ACE-RN-2026-003 · Delegated authority containment

Replay Without Authority

A bearer artifact can be copied from an authorized exchange and replayed by a different process, session, audience, or time window without re-establishing the authority that justified the original use

Published · 2026-08-18

ACE-RN-2026-002 · Delegated authority containment

Revoked Here, Active There

A revocation accepted by the issuer can remain invisible to a cached resource server, regional gateway, derived credential, or already-running agent after the declared containment deadline

Published · 2026-08-18

ACE-RN-2026-001 · Delegated authority containment

Authority Must Shrink, Not Grow

A child agent can receive a credential whose effective resource, action, audience, tenant, time, or budget scope is broader than the authority its parent was allowed to delegate

Four connected research programs.

01

Failure Taxonomy

Classifying repeatable enterprise trust failures across data, regulation, agents, and evidence.

02

Audit-to-Training

Testing whether audit findings can become targeted training and measurable regression controls.

03

Continual Trust Regression

Tracking behavior changes across endpoint, provider, policy, and harness updates.

04

Agent & Harness Reliability

Separating model behavior from routing, tool execution, provider controls, and evaluation infrastructure.

Research claims stay inside the evidence.

Publication safety

Private prompts, holdout IDs, and raw responses remain non-public and are excluded from public research artifacts.

Versioned corrections

Material changes to data, method, or interpretation receive a dated version and correction record.

Organizational disclosure

ACE publishes evaluation limits and discloses when benchmark authors and maintainers share an affiliation.

Public evidence

Start with the published results.