YouTube23 Jul 2024
7m

How to serve 10,000 fine-tuned LLMs from a single GPU

Podcast cover

Baseten

Open in Podwise to generate AI notes

Sign in to process this episode and unlock summaries, transcripts, highlights and translations.

Open in Podwise

Shownotes are not generated by Podwise.

How to serve 10,000 fine-tuned LLMs from a single GPU