This is a linkpost for https://www.arxiv.org/pdf/2508.16245

With Marcus Hutter, Jan Leike (@janleike), and Jessica Taylor (@jessicata) , I have revisited Leike et al.'s paper "A Formal Solution to the Grain of Truth Problem" (AFSGOTP) which studies games between reflective AIXI agents and... further formalized it.

The result is "Limit-Computable Grains of Truth for Arbitrary Computable Extensive-Form (Un)Known Games" (LCGOTACEFUG) which perhaps could have been called "A Formal Formal Solution to the Grain of Truth Problem." Our new paper has some new results, including:

An application to Self-AIXI which suggests an embedded version of AIXI. Since we have had these results unpublished for awhile, I have been implicitly leaning on these ideas for e.g. coming up with AEDT w.r.t. rOSI.
Reflective oracles with non-binary alphabets and explicit types for symbols

...but mostly we just expand on various definitions and algorithms that were previously left implicit in AFSGOTP. [...]

---

First published:
August 26th, 2025

Source:
https://www.lesswrong.com/posts/PuGxDb27xhRPBPbiv/new-paper-on-reflective-oracles-and-grain-of-truth

---

Narrated by TYPE III AUDIO.

“New Paper on Reflective Oracles & Grain of Truth” by Cole Wyeth

LessWrong (30+ Karma)

“New Paper on Reflective Oracles & Grain of Truth” by Cole Wyeth