Audio note: this article contains 94 uses of latex notation, so the narration may be difficult to follow. There's a link to the original text in the episode description.

Crossposted from the AI Alignment Forum. May contain more technical jargon than usual.

This post walks through the math for a theorem. It's intended to be a reference post, which we’ll link back to as-needed from future posts. The question which first motivated this theorem for us was: “Redness of a marker seems like maybe a natural latent over a bunch of parts of the marker, and redness of a car seems like maybe a natural latent over a bunch of parts of the car, but what makes redness of the marker ‘the same as’ redness of the car? How are they both instances of one natural thing, i.e. redness? (or ‘color’?)”. But we’re not going to explain in [...]

---

Outline:

(02:22) Trivial Version

(03:10) Nontrivial Version

(03:40) Redundancy

(05:01) Mediation

---

First published:
August 22nd, 2024

Source:
https://www.lesswrong.com/posts/jig8yRHuwhgxN35ue/a-robust-natural-latent-over-a-mixed-distribution-is-natural

---

Narrated by TYPE III AUDIO.

“A Robust Natural Latent Over A Mixed Distribution Is Natural Over The Distributions Which Were Mixed ” by johnswentworth, David Lorell

LessWrong (30+ Karma)

“A Robust Natural Latent Over A Mixed Distribution Is Natural Over The Distributions Which Were Mixed ” by johnswentworth, David Lorell