This is a linkpost for https://blog.google/technology/ai/google-gemini-ai/

Google just announced Gemini, and Hassabis claims that "in each of the 50 different subject areas that we tested it on, it's as good as the best expert humans in those areas"

State-of-the-art performance

We've been rigorously testing our Gemini models and evaluating their performance on a wide variety of tasks. From natural image, audio and video understanding to mathematical reasoning, Gemini Ultra's performance exceeds current state-of-the-art results on 30 of the 32 widely-used academic benchmarks used in large language model (LLM) research and development.

With a score of 90.0%, Gemini Ultra is the first model to outperform human experts on MMLU (massive multitask language understanding), which uses a combination of 57 subjects such as math, physics, history, law, medicine and ethics for testing both world knowledge and problem-solving abilities.

Our new benchmark approach to MMLU enables Gemini to use [...]

---

First published:
December 6th, 2023

Source:
https://www.lesswrong.com/posts/9Xh2PyMzNDu3yEHqR/google-gemini-announced

Linkpost URL:
https://blog.google/technology/ai/google-gemini-ai/

---

Narrated by TYPE III AUDIO.

[Linkpost] “Google Gemini Announced” by g-w1

LessWrong (30+ Karma)

[Linkpost] “Google Gemini Announced” by g-w1