Diving into the Rise of On-Prem AI and Cloud Security

In this episode of Cyber Sentries, host John Richards is joined by Doron Caspin, a Senior Manager of Product Management at Red Hat, and Christopher Nuland, a Technical Marketing Manager at Red Hat. They explore the growing trend of on-premise open source models for running AI and the unique benefits and challenges that come with it. The conversation also touches on how DeepSeek has challenged the big players and validated the value of smaller agentic models.

John, Doron, and Christopher dive into the shifting landscape of AI and cloud security. They discuss the trends Red Hat is seeing in the industry, such as the move towards smaller, domain-specific language models and the importance of securing AI workloads in hybrid cloud environments. The guests share insights on the key considerations organizations face when deciding to run AI models on-premises, including compliance requirements and the need to treat AI models with the same level of security as databases.

Questions we answer in this episode:

What are the benefits and challenges of running AI on-premises?
How can organizations secure their AI workloads in hybrid cloud environments?
What impact has DeepSeek had on the AI industry?

Key Takeaways:

On-prem AI offers unique advantages for industries with strict compliance requirements
Treating AI models like databases is crucial for ensuring robust security
The future of AI is likely to be open source, with smaller, domain-specific models gaining traction

This episode is a must-listen for anyone interested in the intersection of AI and cloud security. John, Doron, and Christopher provide valuable insights and practical advice for organizations navigating this rapidly evolving landscape. Whether you're a security professional, data engineer, or business leader, you'll come away with a deeper understanding of the trends shaping the future of AI and the steps you can take to secure your AI workloads.

Links & Notes

(00:00) - Welcome to Cyber Sentries
(00:31) - Red Hat
(01:04) - Meet Christopher and Doron
(05:26) - Past to Present
(07:54) - Trends in the Approach
(12:24) - The Security Side
(16:15) - Key Considerations
(19:26) - Training and Models
(22:33) - Iterations and Shifts
(25:36) - Importance of Security Foundations
(28:35) - Security in Agent Space
(30:00) - Wrap Up

On-Prem AI Uprising: Navigating the Future of Cloud Security

Cyber Sentries: AI Insight to Cloud Security