Super Data Science: ML & AI Podcast with Jon Krohn avatar

Dexa/Super Data Science: ML & AI Podcast with Jon Krohn

Learn more
Published Dec 6, 2024

842: Flexible AI Deployments Are Critical — with Chris Bennett and Joseph Balsamo

Jon Krohn converses with Chris Bennett and Joseph Balsamo about the pivotal role of flexible AI deployments in modern business, focusing on Dell's strategic approach and the balance of hype versus reality in generative AI. They delve into how adaptability and strategic partnerships can deliver comprehensive AI solutions while enhancing business outcomes.
Episode Highlights
Super Data Science: ML & AI Podcast with Jon Krohn logo

Topics covered

Popular Clips

Questions from this episode

Episode Highlights

  • Deployment

    Flexible AI deployment strategies are crucial for modern businesses, offering options like on-prem, cloud, or hybrid solutions. emphasizes the importance of portability in AI applications, allowing businesses to move their workloads between different environments without being locked into a single vendor or platform 1. This flexibility helps avoid costly refactoring and ensures that AI applications can be run where they make the most sense for the business.

    We're all about flexibility. We obviously have a strong bias toward on prem, but we interoperate pretty much where our customers live.

    ---

    and Chris discuss how data is increasingly being generated at the edge, necessitating adaptable deployment strategies that meet customers where they are 2.

       

    Vendor Choice

    Vendor flexibility plays a significant role in AI deployment, allowing businesses to choose the best tools and platforms for their needs. Chris highlights that Dell's infrastructure supports a wide range of software and hardware, enabling seamless integration with various cloud environments 1. This adaptability ensures that businesses can optimize their AI deployments without being constrained by proprietary systems.

    If I use a bunch of proprietary tooling and it leaves me stuck in a particular consumption model, that's going to require refactoring, which is going to significantly increase the cost to move and it decreases your flexibility.

    ---

    By offering open and interoperable solutions, Dell helps businesses bring AI to their data, regardless of where it resides.

       

    Success Stories

    Dell's internal success stories illustrate the challenges and triumphs of AI deployment. Chris shares an example of an early AI application within Dell, which initially struggled due to data access limitations 3. The application was designed to facilitate augmented workflows but faced issues when users lacked access to necessary data, leading to inaccurate responses.

    If I, as the user had access to that paywall, I could ask it anything I wanted to and it would answer me authoritatively. But if I didn't, it would literally hallucinate a response.

    ---

    This experience underscores the importance of understanding user access rights and data availability when deploying AI applications.

Related Episodes