This is a linkpost for https://arxiv.org/abs/2403.13793

To understand the risks posed by a new AI system, we must understand what it can and cannot do. Building on prior work, we introduce a programme of new “dangerous capability” evaluations and pilot them on Gemini 1.0 models. Our evaluations cover four areas: (1) persuasion and deception; (2) cyber-security; (3) self-proliferation; and (4) self-reasoning. We do not find evidence of strong dangerous capabilities in the models we evaluated, but we flag early warning signs. Our goal is to help advance a rigorous science of dangerous capability evaluation, in preparation for future models.

At last, DeepMind talks about its dangerous capability evals. Yay!

(DeepMind hasn't yet made RSP-like commitments — that is, specific commitments about risk assessment (for extreme risks), safety and security practices as a function of risk assessment results, and training and deployment decisions as a function of risk assessment results. Indeed [...]

---

First published:
March 21st, 2024

Source:
https://www.lesswrong.com/posts/CCBaLzpB2qvwyuEJ2/deepmind-evaluating-frontier-models-for-dangerous

Linkpost URL:
https://arxiv.org/abs/2403.13793

---

Narrated by TYPE III AUDIO.

[Linkpost] “DeepMind: Evaluating Frontier Models for Dangerous Capabilities” by Zach Stein-Perlman

LessWrong (30+ Karma)