TechVoices

VIDEO PODCAST

Nutanix's Lee Caswell on GPT-in-a-Box, LLMs, and Managing Data

James Maguire

July 20, 2025

In a fast-evolving AI landscape, enterprises are racing to harness the power of large language models (LLMs) while managing the complex realities of data privacy, infrastructure, and operational flexibility. In this TechVoices interview, Lee Caswell, Senior Vice President of Product and Solutions Marketing at Nutanix, discusses “GPT in a Box”—an enterprise-ready solution designed to simplify AI deployment across on-prem, cloud, and edge environments.

Caswell explores how agentic AI is reshaping enterprise use cases, why data is the real differentiator in generative AI, among other AI-focused issues.

Core Takeaways

GPT-in-a-Box

connecting to ChatGPT via API, GPT-in-a-Box offers infrastructure-ready support for multiple LLMs(like LLaMA 2, and Hugging Face models), enabling enterprise-grade customization and control.

KEY QUOTES

The value of data over models:

The model based on your data—trained on your data—is actually more sensitive than the data itself. Now you have a trained model on all of the data you have from all of the tests and procedures you've done. That becomes a core IP of how you're synthesizing the data you have in this new model, and the models are becoming increasingly refined.

The infrastructure behind GPT-in-a-Box:

GPT-in-a-Box is a way to basically bring all the pieces together for customers who were worried about the infrastructure implications of AI. We're giving you a single endpoint integration into all of the LLMs that you can now bring into your on-prem environment and run just like any other enterprise application.

The rise of agentic AI and infrastructure demands:

The agentic cycle is this: you get that first model and the first results, and then you'll put it into another model—that's your agent—saying, 'Now I'm going to go and look at something like guardrails.' You could do re-ranking, refine the results, and apply policies. That's why IT infrastructure is growing in importance—because you need the processing power, storage, and flexibility to support this refinement across environments.

ABOUT THE AUTHOR

James Maguire

Executive Director

An award-winning journalist, James has held top editorial roles in several leading technology publications, covering enterprise trends in cloud computing, AI, data analytics, cybersecurity and more. He regularly communicates with industry analysts and experts and has interviewed hundreds of technology executives.

Cloudera's Venkat Rajaji: advantages of open source AI

Snowflake's Christian Kleinerman: AI and the speed of data access

David Linthicum: LLM trends

Extreme Networks' Nabil Bukhari: how AI democratizes technology

Komprise's Krishna Subramanian: an AI model for every task

The value of data over models:

The infrastructure behind GPT-in-a-Box:

The rise of agentic AI and infrastructure demands:

Ahead of the curve, every week.

Get in touch with us.

Ahead of the curve, 
every week.