There's an admirable LW post with (currently) zero net upvotes titled Goodhart's Law and Emotions where a relatively new user re-invents concepts of related to super-stimuli. In the comments, noggin-scratch explains in more detail:

The technical meaning is a stimulus that produces a stronger response than the stimulus for which that response originally evolved.

So for example a candy bar having a carefully engineered combination of sugar, fat, salt, and flavour in proportions that make it more appetising than any naturally occurring food. Or outrage-baiting infotainment "news" capturing attention more effectively than anything that one villager could have said to another about important recent events.

In my opinion, there's a danger that arises when applying the dictum to know thyself, where one can do this so successfully that one begins to perceive the logical structure of the parts of yourself that generate subjectively accessible emotional feedback signals.

In the [...]

---

First published:
August 16th, 2024

Source:
https://www.lesswrong.com/posts/X4S2mMG2bpWwPYGgu/principled-satisficing-to-avoid-goodhart

---

Narrated by TYPE III AUDIO.

“Principled Satisficing To Avoid Goodhart ” by JenniferRM

LessWrong (30+ Karma)

“Principled Satisficing To Avoid Goodhart ” by JenniferRM