Crossposted from the AI Alignment Forum. May contain more technical jargon than usual.

I'd like to put forward another description of a basic issue that's been around for a while. I don't know if there's been significant progress on a solution, and would be happy to pointed to any such progress. I've opted to go for a relatively rough and quick post that doesn't dive too hard into the details, to avoid losing the thought at all. I may be up for exploring details further in comments or follow-ups.

The Question: How do you respect the wishes (or preferences) of a subject over whom you have a lot of control?

The core problem: any indicator/requirement/metric about respecting their wishes is one you can manipulate (even inadvertently).

For example, think about trying to respect the preferences of the child you're babysitting when you simply know from experience what they will [...]

---

First published:
July 9th, 2024

Source:
https://www.lesswrong.com/posts/CZpZFYPqtk6wMTQwR/consent-across-power-differentials

---

Narrated by TYPE III AUDIO.

“Consent across power differentials” by Ramana Kumar

LessWrong (30+ Karma)

“Consent across power differentials” by Ramana Kumar