This is a linkpost for https://lukasfinnveden.substack.com/p/project-ideas-epistemics

This is part of a series of lists of projects. The unifying theme is that the projects are not targeted at solving alignment or engineered pandemics but still targeted at worlds where transformative AI is coming in the next 10 years or so. See here for the introductory post.

If AI capabilities keep improving, AI could soon play a huge role in our epistemic landscape. I think we have an opportunity to affect how it's used: increasing the probability that we get great epistemic assistance and decreasing the extent to which AI is used to persuade people of false beliefs.

Before I start listing projects, I’ll discuss:

Why AI could matter a lot for epistemics. (Both positively and negatively.)
Why working on this could be urgent. (And not something we should just defer to the future.) Here, I’ll separately discuss:
- That it's [...]

---

Outline:

(01:15) Why AI matters for epistemics

(05:05) Why working on this could be urgent

(08:34) Categories of projects

(09:26) Differential technology development \[ML\] \[Forecasting\] \[Philosophical/conceptual\]

(10:58) Important subject areas

(12:24) Methodologies

(17:00) Related/previous work.

(17:13) Get AI to be used and (appropriately) trusted

(17:32) Develop technical proposals for how to train models in a transparently trustworthy way \[ML\] \[Governance\]

(21:14) Survey groups on what they would find convincing \[survey/interview\]

(22:53) Create good organizations or tools \[ML\] \[Empirical research\] \[Governance\]

(28:11) Investigate and publicly make the case for why/when we should trust AI about important issues \[Writing\] \[Philosophical/conceptual\] \[Advocacy\] \[Forecasting\]

(30:02) Developing standards or certification approaches \[ML\] \[Governance\]

(30:28) Develop and advocate for legislation against bad persuasion \[Governance\] \[Advocacy\]

(32:51) End

The original text contained 13 footnotes which were omitted from this narration.

---

First published:
January 5th, 2024

Source:
https://www.lesswrong.com/posts/sYdT44uzMwoNXs2Lq/project-ideas-epistemics-1

Linkpost URL:
https://lukasfinnveden.substack.com/p/project-ideas-epistemics

---

Narrated by TYPE III AUDIO.

[Linkpost] “Project ideas: Epistemics” by Lukas Finnveden

LessWrong (30+ Karma)