It's tempting to define safety research as research that enables developers to deploy an AI system more safely without making the deployment much more expensive or much less useful.

You can visualize this definition of safety research as pushing out the safety-usefulness Pareto frontier.

At any given level of usefulness, there's greater safety available.

Awkwardly, this definition counts basically all capabilities research as safety research. For example, consider performance optimization for inference. By making inference more efficient you can use weaker, safer models more extensively than you would otherwise be able to, pushing out the Pareto frontier. Likewise, any successful research whatsoever pushes out this Pareto frontier because research can only ever create more options.

It seems like something has gone wrong with our definition of safety research if it includes seemingly all capabilities research.

Here, I spell out one reason why enabling improved safety without hurting usefulness is an insufficient standard for safety research. The core observation is that developers have to choose a particular point on the Pareto frontier, and some technological improvements incentivize them to sacrifice safety. Safety research typically reshapes the Pareto frontier in a way that causes developers to choose greater safety, while [...]

---

Outline:

(02:50) How does research affect the Pareto frontier?

(06:50) RLVR research that mainly enables improved usefulness, at the expense of safety

(08:50) Inference research that enables somewhat substantial safety improvements

(11:04) A plausible case in which capabilities research would be an effective safety intervention

(14:01) Conclusion

(15:23) Appendix A: Reasons why capabilities research might be bad when "burning the lead"

(17:26) Appendix B: Further notes about ways in which this model is wrong

The original text contained 4 footnotes which were omitted from this narration.

---

First published:
October 2nd, 2026

Source:
https://www.lesswrong.com/posts/nwrx9DHpZfW2Q6zLW/capabilities-research-expands-the-safety-usefulness-pareto

---

Narrated by TYPE III AUDIO.

---

Images from the article:

Line graph showing Usefulness versus Safety with two curves and outward arrows.

Apple Podcasts and Spotify do not show images in the episode description. Try Pocket Casts, or another podcast app.

“Capabilities research expands the safety-usefulness Pareto frontier too” by Alex Mallen

LessWrong (30+ Karma)

“Capabilities research expands the safety-usefulness Pareto frontier too” by Alex Mallen