"OK, let's get this meeting started. We're all responsible for development of this new advanced intelligence 'John'. We want John to have some kids with our genes, instead of just doing stuff like philosophy or building model trains, and this meeting is to discuss how we can ensure John tries to do that."

"It's just a reinforcement learning problem, isn't it? We want kids to happen, so provide positive reinforcement when that happens."

"How do we make sure the kids are ours?"

"There's a more fundamental problem than that: without intervention earlier on, that positive reinforcement will never happen."

"OK, so we need some guidance earlier on. Any suggestions?"

"To start, having other people around is necessary. How about some negative reinforcement if there are no other humans around for some period of time?"

"That's a good one, also helps with some other [...]

---

First published:
May 24th, 2024

Source:
https://www.lesswrong.com/posts/SN3BjoizdbvZG5J6a/minutes-from-a-human-alignment-meeting

---

Narrated by TYPE III AUDIO.

“minutes from a human-alignment meeting” by bhauth

LessWrong (30+ Karma)