How can you measure ROI on GenAI for your team? 🤔

Internal evaluations and intentionality.

We've helped thousands of orgs put LLMs to work and ACTUALLY save time. On today's show, we're dishing the 7 steps you need to follow.

What’s the best LLM for your team? 7 Steps to evaluate and create ROI for AI -- An Everyday AI chat with Jordan Wilson

Newsletter: Sign up for our free daily newsletter
More on this Episode: Episode Page
Join the discussion on LinkedIn: Thoughts on this? Join the convo on LinkedIn and connect with other AI leaders.

Upcoming Episodes: Check out the upcoming Everyday AI Livestream lineup
Website: YourEverydayAI.com
Email The Show: info@youreverydayai.com
Connect with Jordan on LinkedIn

Topics Covered in This Episode:

Choosing the Right Large Language Model
Evaluating LLMs for Business ROI
Front-End AI Operating Systems Explained
Common Traps in AI Model Evaluation
Public Benchmarks for LLM Evaluation
Seven-Step LLM Evaluation Framework
Measuring Pre-GenAI Human Baselines
Building Realistic AI Test Datasets
Calculating ROI for GenAI Implementation
Monthly Retesting and AI Model Updates

Timestamps:

00:00 Choosing the Right AI Model

07:02 Adapting Workflows for AI Integration

10:58 "Gemini's Versatile Modes Overview"

14:30 Avoiding AI Shiny Object Syndrome

15:36 AI Evaluation for Reliability and Improvement

20:36 "Data Testing Guide Essentials"

25:15 Realistic and Messy Data Essentials

26:06 "Building Effective AI Workspaces"

31:08 AI Evaluation and ROI Calculation

34:11 Human Oversight in AI Testing

35:52 Evaluating GenAI Use Cases

39:00 "NotebookLM: AI-Powered Idea Organizer"

Keywords:

Large Language Model, LLM, generative AI, AI operating system, front end AI models, AI evaluation, model ROI, model evaluation steps, AI benchmarks, scientific benchmarks, API connection, enterprise AI, ChatGPT, Claude, Gemini, Copilot, team AI adoption, knowledge worker AI, operating system choice, productivity modes, connectors, deep research mode, agent mode, image generation, web search, Canvas mode, advanced voice mode, business process automation, workflow evaluation, change management, AI training,

Send Everyday AI and Jordan a text message. (We can't reply back unless you leave contact info)

Make NotebookLM your personal expert. Try it at notebooklm.google.com

Make NotebookLM your personal expert. Try it at notebooklm.google.com

EP 628: What’s the best LLM for your team? 7 Steps to evaluate and create ROI for AI

Everyday AI Podcast – An AI and ChatGPT Podcast