Evaluation Engineering: Iterative Strategies to Testing Prompts
29 min

Evaluation Engineering: Iterative Strategies to Testing Prompts

MLOps World - MLOps World & Generative AI World 2024
Jared Zoneraich
evaluation-engineering backtesting regression-testing prompt-engineering testing test-driven-development ai machine-learning llm natural-language-processing
LLMs From Dream to Deployed
29 min

LLMs From Dream to Deployed

MLOps World - MLOps World & Generative AI World 2024
Josh Goldstein
chatbots seldon llm large-language-models machine-learning mlops deployment retrieval-augmented-generation rag kubernetes openai hugging-face gpu
Mitigating RAG Hallucinations with Aporia Guardrails
25 min

Mitigating RAG Hallucinations with Aporia Guardrails

MLOps World - MLOps World & Generative AI World 2024
rag retrieval-augmented-generation llm large-language-models ai artificial-intelligence hallucinations guardrails data-quality natural-language-processing
Introducing Arize-Phoenix and OpenInference
43 min

Introducing Arize-Phoenix and OpenInference

MLOps World - MLOps World & Generative AI World 2024
Mikyo King
ai-observability llama-index openai generative-ai llm rag open-source tracing language-models python
Towards Robust GenAI: Techniques for Evaluating Enterprise LLM Applications
46 min

Towards Robust GenAI: Techniques for Evaluating Enterprise LLM Applications

MLOps World - MLOps World & Generative AI World 2024
Dhruv Singh
ai-applications llm-evaluators generative-ai genai llm large-language-models testing enterprise-ai reliability guardrails human-evaluation
Running Multiple Models on the Same GPU, on Spot Instances
33 min

Running Multiple Models on the Same GPU, on Spot Instances

MLOps World - MLOps World & Generative AI World 2024
Oscar Rovira
ml-inference spot-instances gpu-fractionalization gpu cost-optimization generative-ai llm cloud-computing aws gcp azure mlops
The Secret Sauce for Deploying LLM Applications into Production
32 min

The Secret Sauce for Deploying LLM Applications into Production

MLOps World - MLOps World & Generative AI World 2024
Josh Reini
evaluation-frameworks truelens ai-adoption llm generative-ai production-deployment rag langchain evaluation-data model-monitoring observability enterprise-ai
The Journey of Building a Leading Open Source LLM Security Toolkit
32 min

The Journey of Building a Leading Open Source LLM Security Toolkit

MLOps World - MLOps World & Generative AI World 2024
Oleksandr Yaremchuk
protect-ai llm-guard jailbreak cybersecurity machine-learning-security llm llm-security open-source prompt-injection data-leakage prompt-engineering ai-security
The Power of Local AI
37 min

The Power of Local AI

MLOps World - MLOps World & Generative AI World 2024
Christian Crowley
local-ai private-ai open-source-models personalization sanctum-ai artificial-intelligence large-language-models llm privacy security hugging-face data-privacy
Enhance Cost Efficiency in Domain Adaptation with PruneMe
17 min

Enhance Cost Efficiency in Domain Adaptation with PruneMe

MLOps World - MLOps World & Generative AI World 2024
Shamane Siri
domain-adaptation continual-pretraining ai-research llm large-language-models pruning cost-efficiency model-optimization transformer nlp
Empowering Data Science Teams: Harnessing AI with Appen
31 min

Empowering Data Science Teams: Harnessing AI with Appen

MLOps World - MLOps World & Generative AI World 2024
Sasha McGrath Geoffrey LaPorte
training-data ai data-science machine-learning llm generative-ai data-annotation data-quality collaboration model-building
Evaluating LLMs and RAG Pipelines at Scale
36 min

Evaluating LLMs and RAG Pipelines at Scale

MLOps World - MLOps World & Generative AI World 2024
Eric Korman
valor llm rag mlops llm-ops pipelines language-models natural-language-processing data-management model-training model-deployment