Introducing Arize-Phoenix and OpenInference
43 min

Introducing Arize-Phoenix and OpenInference

MLOps World - MLOps World & Generative AI World 2024
Mikyo King
ai-observability llama-index openai generative-ai llm rag open-source tracing language-models python
Towards Robust GenAI: Techniques for Evaluating Enterprise LLM Applications
46 min

Towards Robust GenAI: Techniques for Evaluating Enterprise LLM Applications

MLOps World - MLOps World & Generative AI World 2024
Dhruv Singh
ai-applications llm-evaluators generative-ai genai llm large-language-models testing enterprise-ai reliability guardrails human-evaluation
Running Multiple Models on the Same GPU, on Spot Instances
33 min

Running Multiple Models on the Same GPU, on Spot Instances

MLOps World - MLOps World & Generative AI World 2024
Oscar Rovira
ml-inference spot-instances gpu-fractionalization gpu cost-optimization generative-ai llm cloud-computing aws gcp azure mlops
The Secret Sauce for Deploying LLM Applications into Production
32 min

The Secret Sauce for Deploying LLM Applications into Production

MLOps World - MLOps World & Generative AI World 2024
Josh Reini
evaluation-frameworks truelens ai-adoption llm generative-ai production-deployment rag langchain evaluation-data model-monitoring observability enterprise-ai
The Journey of Building a Leading Open Source LLM Security Toolkit
32 min

The Journey of Building a Leading Open Source LLM Security Toolkit

MLOps World - MLOps World & Generative AI World 2024
Oleksandr Yaremchuk
protect-ai llm-guard jailbreak cybersecurity machine-learning-security llm llm-security open-source prompt-injection data-leakage prompt-engineering ai-security
The Power of Local AI
37 min

The Power of Local AI

MLOps World - MLOps World & Generative AI World 2024
Christian Crowley
local-ai private-ai open-source-models personalization sanctum-ai artificial-intelligence large-language-models llm privacy security hugging-face data-privacy
The Who, What, and Why of Data Lake Table Formats
48 min

The Who, What, and Why of Data Lake Table Formats

MLOps World - MLOps World & Generative AI World 2024
Alex Merced
data-lakehouse table-formats apache-hudi delta-lake data-partitioning z-order-sorting schema-evolution data-lake apache-iceberg data-management data-engineering metadata
Efficiently Fine-Tune And Serve Your Own LLMs
42 min

Efficiently Fine-Tune And Serve Your Own LLMs

MLOps World - MLOps World & Generative AI World 2024
Alex Sherstinsky
llm-fine-tuning predibase ludwig lorax large-language-models lora parameter-efficient-fine-tuning peft transformer-models mistral-7b model-serving inference
Building ML and GenAI Systems with Metaflow
48 min

Building ML and GenAI Systems with Metaflow

MLOps World - MLOps World & Generative AI World 2024
Ville Tuulos
ai-systems ml machine-learning genai generative-ai metaflow data-engineering model-training inference python mlops
Data Versioning in Generative AI: A Pathway to Cost-effective ML
36 min

Data Versioning in Generative AI: A Pathway to Cost-effective ML

MLOps World - MLOps World & Generative AI World 2024
Dmitry Petrov
dataset-sharing annotations generative-ai ml data-versioning machine-learning dvc cost-optimization collaboration embeddings
Enhance Cost Efficiency in Domain Adaptation with PruneMe
17 min

Enhance Cost Efficiency in Domain Adaptation with PruneMe

MLOps World - MLOps World & Generative AI World 2024
Shamane Siri
domain-adaptation continual-pretraining ai-research llm large-language-models pruning cost-efficiency model-optimization transformer nlp
Better Chatbots with Advanced RAG Techniques
50 min

Better Chatbots with Advanced RAG Techniques

MLOps World - MLOps World & Generative AI World 2024
Zain Hasan
vector-databases weaviate chatbots hybrid-search query-generation semantic-search rag retrieval-augmented-generation llms language-models machine-learning ai