Crossposted from the AI Alignment Forum. May contain more technical jargon than usual.This is a link post.

Last year, we showed that supposedly superhuman Go AIs can be beaten by human amateurs playing specific “cyclic” patterns on the board. Vulnerabilities have previously been observed in a wide variety of sub- or near-human AI systems, but this result demonstrates that even far superhuman AI systems can fail catastrophically in surprising ways. This lack of robustness poses a critical challenge for AI safety, especially as AI systems are integrated in critical infrastructure or deployed in large-scale applications. We seek to defend Go AIs, in the process developing insights that can make AI applications in various domains more robust against unpredictable threats.

We explored three defense strategies: positional adversarial training on handpicked examples of cyclic patterns, iterated adversarial training against successively fine-tuned adversaries, and replacing convolutional neural networks with vision transformers. We found [...]

---

First published:
June 19th, 2024

Source:
https://www.lesswrong.com/posts/2iALhBnMpcjbWJJ3w/beyond-the-board-exploring-ai-robustness-through-go

---

Narrated by TYPE III AUDIO.

“Beyond the Board: Exploring AI Robustness Through Go” by AdamGleave

LessWrong (30+ Karma)