“Mode collapse” is a few things. First it was an observation about how early image generating AIs often collapsed to producing just the modal output from their training distribution (something very common, like a house with a white picket fence and a tree in the garden). Then it was the observation that this effect seemed to occur extremely quickly when AIs were trained on AI-generated inputs. After that, it became the copium du jour of AI-is-hitting-a-wall folks for a while, who thought that the AI industry would ouroboros itself out of existence (and that there was, therefore, no need to confront any of the issues that smarter than human AIs might bring up). And then it was forgotten, because it turns out you can train on AI-generated inputs just fine, if you know what you’re doing.

It's also the reason why grant-making organisations have such strong inertia, why all of your favourite band's songs sound the same after the third album, and why you should specialise even if there are no gains from trade.

The Image Generator

Imagine an image generating AI, which gets something like this as input:

Original image: https://commons.wikimedia.org/wiki/File:Dog_Breeds.jpg

And suppose it's being trained [...]

---

Outline:

(01:05) The Image Generator

(03:43) Grantmakers

(04:37) Your Favourite Band

(05:18) Division of Labour

(06:48) Slack

---

“You Are Not Immune To Mode Collapse” by J Bostock

LessWrong (30+ Karma)

“You Are Not Immune To Mode Collapse” by J Bostock