Mixing reliability with Celery for delicious async tasks
25 min

Mixing reliability with Celery for delicious async tasks

DjangoCon - DjangoCon US 2023
Flรกvio Juvenal
django python async-tasks task-queues prefetch temporal mage celery reliability data-pipelines airflow dagster
Apache Airflow: Where Data Engineers and ML Engineers Meet
47 min

Apache Airflow: Where Data Engineers and ML Engineers Meet

MLOps World - MLOps World & Generative AI World 2024
Tamara Fingerlin
apache-airflow data-engineering mlops generative-ai python orchestration pipelines docker retrieval-augmented-generation llm machine-learning data-pipelines
Learning from Extremes: What Fraud-Fighting at Scale Can Teach Us About MLOps Across Domains
30 min

Learning from Extremes: What Fraud-Fighting at Scale Can Teach Us About MLOps Across Domains

MLOps World - MLOps World & Generative AI World 2024
Greg Kuhlmann
fraud-prevention training-serving-consistency mlops machine-learning real-time-ml data-modeling feature-engineering observability agile-development data-pipelines inference scalability
From Idea to Production: AI Infra for Scaling LLM Apps
39 min

From Idea to Production: AI Infra for Scaling LLM Apps

MLOps World - MLOps World & Generative AI World 2024
Guy Eshet
llm ai ai-infrastructure llm-ops prompt-engineering model-deployment gpu data-pipelines rag cost-optimization generative-ai llm-applications
Fast Data Loading for Deep Learning Workloads with LakeFS Mount
30 min

Fast Data Loading for Deep Learning Workloads with LakeFS Mount

MLOps World - MLOps World & Generative AI World 2024
Amit Kesarwani
data-versioning lakefs data-loading git-like data-consistency data-lake deep-learning mlops data-management object-storage data-pipelines tensorflow
Supercharging Pipeline Efficiency with ML Performance Prediction
26 min

Supercharging Pipeline Efficiency with ML Performance Prediction

PyCon - PyCon US 2023
Boaz Wiesner Keren Meron
python celery kubernetes machine-learning pipeline-optimization data-pipelines performance-prediction autoscaling cloud-cost-optimization aws-spot-instances svms data-processing
Too Big for DAG Factories?
30 min

Too Big for DAG Factories?

PyCon - PyCon US 2023
Calvin Hendryx-Parker
apache-airflow python dag-factories workflow-orchestration etl big-data ci-cd data-pipelines scheduling automation