853: Generative AI for Business — with Kirill Eremenko and Hadelin de Ponteves

Lifecycle

Foundation models are the backbone of many AI applications, offering a structured approach from inception to deployment. Kirill Eremenko explains that these models undergo an eight-step lifecycle, starting with data preparation and model architecture selection, followed by the intensive pre-training phase 1. This process, while costly and resource-intensive, is crucial for developing models like ChatGPT, which serve as a foundation for further applications 2. Hadelin de Ponteves highlights the accessibility of these models through platforms like AWS Bedrock, which simplifies their application in various domains 3.

Foundation models, once developed, can be used as a basis to build your own applications.

--- Kirill Eremenko

These models are not only foundational but also adaptable, allowing businesses to leverage them for specific needs.

   

Customization

Customizing foundation models is essential for aligning them with specific business requirements. Kirill Eremenko discusses the importance of fine-tuning, which involves adjusting models during training to better fit particular use cases 4. This process can be cost-effective, especially when using techniques like domain-specific fine-tuning or instruction-based fine-tuning, as Hadelin de Ponteves shares from his experience 5.

Fine-tuning is like a type of modification during training, closer than to inference.

--- Kirill Eremenko

These modifications ensure that the models deliver precise and relevant outputs, enhancing their utility in business applications.

   

Selection

Selecting the right foundation model involves evaluating multiple criteria, including cost, performance, and environmental impact. Jon Krohn emphasizes the importance of considering long-term costs and the potential scalability of models 6. Kirill Eremenko adds that compliance, licensing, and environmental considerations are also crucial factors in the decision-making process 7.

There are 12 considerations that businesses tend to look out for when selecting a foundation model.

--- Kirill Eremenko

By understanding these factors, businesses can make informed decisions that align with their strategic goals and operational needs.