Alex Kardos-Nyheim is the founder of SafeSign Technologies and now co-lead of AI research at Thomson Reuters. Alex built a legal-specific large language model while still a trainee at A&O Shearman, ultimately selling the company in 2024. He explains why Safe Sign focused on building the “engine” rather than the interface and how a legal LLM was able to outperform some of the biggest AI labs on legal tasks.

A central thread of the conversation is how the competitive landscape in legal AI has shifted. What began as a wave of “wrapper” products around foundation models is now evolving into a deeper contest over models, data and defensibility. Alex argues that the real moat lies not in user interface features, but in training models on high-quality legal data and building robust retrieval systems that reduce hallucinations and improve reasoning.

We also explore how Thomson Reuters is thinking about the full stack: combining proprietary legal data, live market intelligence and a legal-trained model into a cohesive platform.

Finally, Alex shares what he’s seeing inside law firms. Smaller firms should be using AI as a force multiplier to “punch above their weight”, while larger firms face a strategic imperative to convert their institutional know-how into machine-readable data to power their AI tools. His advice to managing partners is direct: hire data engineers, structure your data and lean into expertise.

The Non-Billable Podcast is sponsored by Legora. To find out more about Legora, visit: https://legora.com/

Chapters

00:01 Introduction

01:20 Building a legal LLM while at A&O

03:40 Engine vs wrapper: why Safe Sign focused on the model

04:41 Life after the Thomson Reuters acquisition

06:24 Inside Thomson Reuters’ “skunk works” AI team

08:42 From point solutions to platform wars in legal AI

11:49 The perfect stack: models, data and RAG

15:07 Why retrieval engines matter more than you think

18:33 Data as the moat

23:56 Can small data beat big data?

27:14 Making legal AI “market aware”

31:05 The evolution of Co-Counsel

33:57 What law firms are getting right and wrong about AI

36:50 “Hire 30 data engineers tomorrow”

38:22 Productising law firm know-how

43:10 Tips if you started a legal AI company today

About Non-Billable

Non-Billable is the media company for modern legal professionals across private practice, in-house and legal tech.

Visit our website: ⁠⁠https://www.nonbillable.co.uk

How law firms win the AI race: Alex Kardos-Nyheim on data, defensibility and staying power

The Non-Billable Podcast

How law firms win the AI race: Alex Kardos-Nyheim on data, defensibility and staying power