Anthropic gives METR employee-like access for independent safety reviews

Sunday, 18 October 2026By Sridhar Mukkandi1 min read

Anthropic said on 15 October that it has given a team from METR, a nonprofit that evaluates frontier AI models, employee-like access: six METR employees now have company hardware, office space and internal tools roughly on par with Anthropic's own risk assessment teams. METR will publish its analysis of Anthropic's risk levels, incidents or practices; Anthropic cannot veto publication but can require certain categories of information to be redacted.

Anthropic describes three tiers of evaluator access. SecureBio is reviewing the chemical and biological weapons chapter of its August Risk Report, and Anthropic says it is working towards a partnership with Accenture and Faculty on evaluation and red-teaming. It compares the arrangement to bank regulators placing resident examiners inside large banks.

So what

Outside evaluators with real access and the right to publish are a stronger check than self-reported safety claims. If your product depends on a frontier model, these published reviews are worth reading alongside the vendor's own reports.

SourceAnthropicwww.anthropic.com/news/an-update-on-independent-evaluators Go deeper · NewsletterThe Sunday Letter

Drafted with AI from the original source, then checked and edited by Sridhar Mukkandi. Spotted a mistake? Write to hello@tarkika.com and we'll correct it here.

More from The Signal

Research Microsoft’s ThinkingBox turns database checks into rewards for training agentsChecking the state an agent leaves behind is a more honest test than reading its transcript, and the same check doubles as a training reward. Start with the three actions your agent takes most often. Microsoft and Hugging Face Agents Bayer Crop Science runs 22 read-only agents over its ML decision engine on AWSRead-only agents with narrowly scoped tools, launched to a small group first, is a pattern worth copying. So is testing a new model against your own tool calls before you switch: newer isn't always compatible. AWS Machine Learning Blog Tools AWS lets you write your own model-training loop on SageMaker without managing GPUsCustom reinforcement learning used to mean renting and babysitting GPUs. If you can write a check for a good outcome, you can now train on it without running the infrastructure yourself. AWS Machine Learning BlogAll stories