I just left a comment on PIBBSS' Manfund grant request (which I funded $25k) that people might find interesting. PIBBSS needs more funding!

Main points in favor of this grant

My inside view is that PIBBSS mainly supports “blue sky” or “basic” research, some of which has a low chance of paying off, but might be critical in “worst case” alignment scenarios (e.g., where “alignment MVPs” don’t work, or “sharp left turns” and “intelligence explosions” are more likely than I expect). In contrast, of the technical research MATS supports, about half is basic research (e.g., interpretability, evals, agent foundations) and half is applied research (e.g., oversight + control, value alignment). I think the MATS portfolio is a better holistic strategy for furthering AI safety and reducing AI catastrophic risk. However, if one takes into account the research conducted at AI labs and supported by MATS, PIBBSS’ strategy makes [...]

---

Outline:

(00:03) I just left a comment on PIBBSS Manfund grant request (which I funded $25k) that people might find interesting. PIBBSS needs more funding!

(00:18) Main points in favor of this grant

(04:21) Donors main reservations

(05:44) Process for deciding amount

(06:15) Conflicts of interest

---

First published:
September 15th, 2024

Source:
https://www.lesswrong.com/posts/Yjiw5rnu4mJsYN8Xc/why-i-funded-pibbss-1

---

“Why I funded PIBBSS ” by Ryan Kidd

LessWrong (30+ Karma)