Partnering with Accenture on embedded evaluation

Anthropic has partnered with Accenture, led by its AI business Faculty, to conduct independent evaluation of frontier AI models. This initiative aims to embed evaluators within AI companies, providing them with employee-level access to assess safety, verify commitments, and report findings. Both companies plan to invest at least $1 billion over five years. Embedded evaluation is a new approach, and standards are still being developed. Currently, Anthropic is funding Accenture's work directly, with plans to collaborate with other evaluators like METR in the future. The partnership is non-exclusive, and Anthropic will work with multiple organizations to build an ecosystem of evaluators.

(Source：Anthropic)