Paying for it in 2022

3 sessions

PodcastBuilding ML/Data Platform on Top of KubernetesJulien Bisconti · 48:13 · Mar 2022 · 1,004 views · MLOps Coffee Sessions

ClaimCompanies often underestimate the total cost of building and maintaining their own platform, including finding the right abstractions, training people, staffing on-call rotations, and keeping the system running.10:26

PodcastReal-time Model Inference in a Video Streaming EnvironmentBrannon Dorsey, Runway · 58:02 · May 2022 · 616 views · MLOps Coffee Sessions
PodcastBringing DevOps Agility to MLLuis Ceze, OctoML · 1:04:27 · Sept 2022 · 1,217 views · MLOps Coffee Sessions

ClaimLuis Ceze argues that efficient inference matters because successful models may be used an extremely large number of times, making inference costs and energy use significant.43:24