How Do You Scale to Billions of Fine-Tuned LLMs
5 min

How Do You Scale to Billions of Fine-Tuned LLMs

MLOps World - MLOps World & Generative AI World 2024
James Dbiorin
cuda batching llm large-language-models fine-tuning lora inference scalability parameter-efficient-fine-tuning gpu mlops ai
Lessons Learned Productionizing LLMs for Stripe Support
29 min

Lessons Learned Productionizing LLMs for Stripe Support

MLOps World - MLOps World & Generative AI World 2024
Sophie Daly
support-operations data-strategy llm large-language-models nlp natural-language-processing ai machine-learning retrieval-augmented-generation rag fine-tuning
Applying Responsible AI with the Open-Source LangTest Library
32 min

Applying Responsible AI with the Open-Source LangTest Library

MLOps World - MLOps World & Generative AI World 2024
David Talby
langtest ai-bias ai responsible-ai llm nlp testing data-leakage mlops python open-source
QA in ML
28 min

QA in ML

MLOps World - MLOps World & Generative AI World 2024
Serg Masis
quality-assurance secops machine-learning mlops data-science qa ai artificial-intelligence explainable-ai data-engineering devops reliability
Making ChatGPT Funny with Prompt Optimization
33 min

Making ChatGPT Funny with Prompt Optimization

MLOps World - MLOps World & Generative AI World 2024
Mike Taylor
writing-assistance chatgpt ai artificial-intelligence prompt-engineering natural-language-processing nlp large-language-models llm generative-ai
Secure Open Source MLOps - Ubuntu Principles
18 min

Secure Open Source MLOps - Ubuntu Principles

MLOps World - MLOps World & Generative AI World 2024
Andreea Munteanu Maciej Mazur
ubuntu data-tokenization privacy-enhancing-technologies mlops kubernetes kubeflow confidential-computing security compliance open-source machine-learning ai
Evaluation Techniques for Large Language Models
1h 41m

Evaluation Techniques for Large Language Models

MLOps World - MLOps World & Generative AI World 2024
Rajiv Shah
functional-correctness similarity-metrics large-language-models llm ai machine-learning benchmarking nlp natural-language-processing hugging-face prompt-engineering
Evaluation Engineering: Iterative Strategies to Testing Prompts
29 min

Evaluation Engineering: Iterative Strategies to Testing Prompts

MLOps World - MLOps World & Generative AI World 2024
Jared Zoneraich
evaluation-engineering backtesting regression-testing prompt-engineering testing test-driven-development ai machine-learning llm natural-language-processing
Mitigating RAG Hallucinations with Aporia Guardrails
25 min

Mitigating RAG Hallucinations with Aporia Guardrails

MLOps World - MLOps World & Generative AI World 2024
rag retrieval-augmented-generation llm large-language-models ai artificial-intelligence hallucinations guardrails data-quality natural-language-processing
Better Chatbots with Advanced RAG Techniques
50 min

Better Chatbots with Advanced RAG Techniques

MLOps World - MLOps World & Generative AI World 2024
Zain Hasan
vector-databases weaviate chatbots hybrid-search query-generation semantic-search rag retrieval-augmented-generation llms language-models machine-learning ai
Empowering Data Science Teams: Harnessing AI with Appen
31 min

Empowering Data Science Teams: Harnessing AI with Appen

MLOps World - MLOps World & Generative AI World 2024
Sasha McGrath Geoffrey LaPorte
training-data ai data-science machine-learning llm generative-ai data-annotation data-quality collaboration model-building
Function Calling for LLMs: RAG without a Vector Database
40 min

Function Calling for LLMs: RAG without a Vector Database

MLOps World - MLOps World & Generative AI World 2024
Jim Dowling
feature-store llm rag function-calling vector-database ai data-modeling natural-language-processing retrieval-augmented-generation api machine-learning