Swiss Army Django: Small Footprint ETL

December 15, 2023 20 min Free

Description

This talk explores a single-application ETL system designed to scrape and enrich complex nested data, then expose it via GraphQL and Discord. It dives into how to effectively use various async-based libraries within a small footprint application, focusing on techniques for efficient data extraction, transformation, and loading, all within the Django framework.