Summary.

This is a brain dump of some for-profit AI alignment organization ideas, along with context for why I believe a for-profit alignment organization can make a big contribution to AI safety. This is far from a complete list, and I welcome ideas and feedback. Also, if anyone wants to or is working on any of these ideas, I’d be happy to support in any way I can!

Context

I'm Eric, formerly co-founder of RippleMatch, an AI recruiting company with ~$80M raised, millions of users, and ~10% of the Fortune 500 as customers. I made the difficult decision to leave RippleMatch this year because I'm concerned about catastrophic risk from AI, and have been spending the last year thinking about ways to help. Given my background, I’ve been thinking a lot about for-profit ideas to help with alignment – many that can be VC-backed. Some of these ideas [...]

---

Outline:

(00:29) Context

(01:09) Why I believe for-profit alignment orgs are valuable

(02:24) Robustness approaches

(02:28) Testing / benchmarking software

(03:11) Red-teaming as a service

(04:12) Evals / auditing

(05:24) Monitoring

(06:40) AI agents approaches

(07:38) Agent testing environments

(08:32) Deterministic framework for agents

(09:42) Cybersecurity approaches

(09:46) Security agent

(10:55) Endpoint and application monitoring

(11:29) Research approaches

(11:33) Build capabilities, do research

(12:20) Interpretability software

(13:09) High quality human data labeling

(14:16) Other thoughts about building a for-profit alignment org

(16:00) Please reach out!

---

First published:
December 14th, 2023

Source:
https://www.lesswrong.com/posts/PcTLHamp236afJxxT/some-for-profit-ai-alignment-org-ideas

---

Narrated by TYPE III AUDIO.

“Some for-profit AI alignment org ideas” by Eric Ho

LessWrong (30+ Karma)