Why AI Apps Don't Work in Prod: AI Reliability Survey
33 min

Why AI Apps Don't Work in Prod: AI Reliability Survey

MLOps World - MLOps World & Generative AI World 2024
Shreya Rajpal
ai artificial-intelligence mlops machine-learning-operations reliability ai-engineering llm large-language-models
How to Run Your Own LLMs, From Silicon to Service
31 min

How to Run Your Own LLMs, From Silicon to Service

MLOps World - MLOps World & Generative AI World 2024
Charles Frye
llms large-language-models mlops machine-learning-operations inference gpu quantization tensorrt-llm vllm modal-labs model-serving ai-engineering
Mastering Enterprise-Grade LLM Deployment: Overcoming Production Challenges
5 min

Mastering Enterprise-Grade LLM Deployment: Overcoming Production Challenges

MLOps World - MLOps World & Generative AI World 2024
Jaeman An
llm deployment enterprise-ai machine-learning-operations mlops gpu-management model-optimization data-security compliance ai-infrastructure latency-reduction