model-serving

112 talks

Fast & Asynchronous: Drift Your AI, Not Your GPU BillArtem Yushkovskiy, Delivery Hero · 33:30 · Feb 2026 · 99 views · Coding Agents Conference 2026PodcastIs Open Source Software Actually Secure?Hudson Buzby, JFrog · 59:23 · Sept 2025 · 133 views · MLOps PodcastHow to Self-Host an AI Agent · 26:57 · Aug 2025 · 427 viewsThe Hidden Infrastructure Behind Every AI AgentErica Hughberg, Tetrate · 16:16 · Aug 2025 · 201 viewsPodcastThe Truth About LLM TrainingPaul van der Boor & Zulkuf Genc, Prosus Group · 55:47 · Aug 2025 · 822 views · Agents in Production SeriesPodcastInside Uber's AI Revolution: Everything About How They Use AI/MLKai Wang, Uber · 45:24 · Jul 2025 · 2,863 views · MLOps PodcastPodcastMLOps with DatabricksMaria Vechtomova, Ahold Delhaize | Marvelous MLOps · 52:44 · May 2025 · 813 views · MLOps PodcastBuilding Robust AI Systems with Battle-tested FrameworksVaibhav Gupta, Boundary ML & Charles Frye, Modal · 1:08:10 · Apr 2025 · 280 views · MLOps Mini Summit 2025PodcastGenAI Traffic: Why API Infrastructure Must Evolve... AgainErica Hughberg, Tetrate · 1:06:25 · Mar 2025 · 408 views · MLOps PodcastPodcastKubernetes, AI Gateways, and the Future of MLOpsAlexa Griffith, Bloomberg · 50:12 · Mar 2025 · 890 views · MLOps PodcastCommon ML Serving Architectures ExplainedRebecca Taylor, Lidl e-commerce · 17:33 · Oct 2024 · 443 viewsReal-Time Event Processing for AI/ML with NumaflowSri Harsha Yayi, Intuit · 22:38 · Oct 2024 · 601 views · DE4AI 2024The Next Revolution in AI: LLMs and Beyond · 13:47 · Oct 2024 · 187 viewsPodcastMLOps for GenAI ApplicationsHarcharan Kabbay, World Wide Technology · 1:05:02 · Aug 2024 · 743 views · MLOps PodcastPodcastUber's Michelangelo: Strategic AI Overhaul and Impact · 35:36 · Jun 2024 · 840 views · MLOps PodcastNavigating the Emerging LLMOps StackHien Luu, DoorDash · 12:51 · May 2024 · 534 views · AI in Production 2024PodcastRetrieval Augmented GenerationSyed Asad, KiwiTech · 44:10 · May 2024 · 1,070 views · MLOps PodcastProductionizing AI: How to Think From the EndAnnie Condon · 11:11 · May 2024 · 348 views · AI in Production 2024PodcastFedML Nexus AI: Your Generative AI Platform at ScaleSalman Avestimehr, FedML · 52:34 · May 2024 · 451 views · MLOps PodcastStreamlining Model DeploymentDaniel Lenton, Unify · 21:39 · May 2024 · 334 views · AI in Production 2024Introducing DBRX: The Future of Language ModelsDavis Blalock, Bandish Shah, Abhi Venigalla & Ajay Saini, Databricks · 48:36 · Apr 2024 · 496 views · MLOps Coffee SessionsProductionizing Health Insurance Appeal GenerationHolden Karau, Netflix · 27:11 · Apr 2024 · 594 views · AI in Production 2024Building a Python-Centric Feature Platform to Power Production AI ApplicationsMatt Bleifer, Tecton · 27:11 · Apr 2024 · 296 viewsGraduating from Proprietary to Open Source Models in ProductionPhilip Kiely, Baseten · 23:16 · Apr 2024 · 147 views · AI in Production 2024Vision Pipelines in Production: Serving & OptimisationsBiswaroop Bhattacharjee, Prem AI · 13:24 · Apr 2024 · 281 views · AI in Production 2024PodcastDesigning ML Infra for ML & LLM Use CasesAmritha Arun Babu, Klaviyo & Abhik Choudhury, IBM · 1:00:18 · Mar 2024 · 876 views · MLOps PodcastPodcastAds Ranking Evolution at PinterestAayush Mudgal, Pinterest · 52:38 · Feb 2024 · 601 views · MLOps PodcastPodcastMLOps at the CrossroadsPatrick Barker, Kentauros AI & Farhood Etaati, AIMedic · 49:02 · Jan 2024 · 345 views · MLOps PodcastPodcastDesigning for Forward Compatibility in Gen AIRohit Agarwal, Portkey.ai · 1:00:18 · Nov 2023 · 382 views · MLOps PodcastBuilding RAG-based LLM Applications for ProductionPhilipp Moritz & Yifei Feng, Anyscale · 30:23 · Nov 2023 · 3,003 views · LLMs in Production 2023Efficient Serving of LLMs for Experimentation and Production with Fireworks.aiDmytro Dzhulgakov, Fireworks.ai · 11:43 · Oct 2023 · 1,085 viewsFireside Chat with LLM StartupsPaul van der Boor & Sandeep Bakshi, ProsusGroup & Shriyash Upadhyay, Martian & Lars Maaløe, Corti & Pietro Gagliano, Transitional Forms · 30:46 · Oct 2023 · 584 views · LLMs in Production 2023PodcastMLOps at GetYourGuideJean Machado, Meghana Satish, Olivia Houghton & Theodore Meynard, GetYourGuide · 1:03:53 · Oct 2023 · 327 views · MLOps PodcastPodcastBuilding an ML Platform: Insights, Community, and AdvocacyStephen Batifol, Wolt · 45:49 · Oct 2023 · 568 views · MLOps PodcastLLMs vs LMs in ProductionDenys Linkov, Voiceflow · 24:44 · Aug 2023 · 1,337 views · LLMs in Production 2023Preemption Chaos and Optimizing Server StartupBradley Heilbrun, Replit · 12:42 · Aug 2023 · 215 views · LLMs in Production 2023Considerations and Optimizations for Deploying Open Source LLMs at Your CompanyOscar Rovira, Mystic AI · 11:31 · Aug 2023 · 474 viewsEnabling Defense Missions with Local LLMsGerred Dillon, Defense Unicorns · 23:07 · Aug 2023 · 408 views · LLMs in Production 2023End-to-end Modern Machine Learning in ProductionOmar Sanseviero, Hugging Face · 10:30 · Aug 2023 · 753 views · LLMs in Production 2023Unleashing Code Completion with LLMsMonmayuri Ray, GitLab · 17:41 · Aug 2023 · 602 views · LLMs in Production 2023Challenges in Providing LLMs as a ServiceHemant Jain, Cohere AI · 11:43 · Jul 2023 · 466 views · LLMs in Production 2023LLMs For the Rest of UsVikram Sreekanti, Aqueduct & Joseph Gonzalez, UC Berkeley and Aqueduct · 24:33 · Jul 2023 · 349 views · LLMs in Production 2023Build and Customize LLMs in Less than 10 Lines of YAMLTravis Addair, Predibase · 34:05 · Jul 2023 · 820 views · LLMs in Production 2023Scalable Evaluation and Serving of Open Source LLMsWaleed Kadous, Anyscale · 34:57 · Jul 2023 · 1,336 views · LLMs in Production 2023Taking ImgFlip's 'This Meme Does Not Exist' to the Next Level with a LLMStefan Ojanen, Genesis Cloud · 14:49 · Jul 2023 · 307 viewsPodcastThe Long Tail of ML DeploymentTuhin Srivastava, Baseten · 50:37 · Jun 2023 · 618 views · MLOps PodcastPodcastClean Code for Data ScientistsMatt Sharp, Shopify · 46:13 · Jun 2023 · 1,301 views · MLOps PodcastPodcastWhy is MLOps Hard in an Enterprise?Maria Vechtomova & Basak Eskili, Ahold Delhaize · 55:06 · May 2023 · 756 views · MLOps PodcastCost Optimization and PerformanceLina Weichbrodt & Luis Ceze, OctoML & Jared Zoneraich, Prompt Layer & Daniel Campos, Neeva & Mario Kostelac, Intercom · 36:06 · May 2023 · 930 views · LLMs in Production 2023MeetupDeclarative MLOps: Streamlining Model Serving on KubernetesRahul Parundekar, A.I. Hero, Inc. · 58:58 · Apr 2023 · 2,634 views · MLOps MeetupMeetupVertex AI WorkshopSascha Heyer, DoiT · 1:24:30 · Dec 2022 · 1,017 views · MLOps MeetupPodcastWhat is Data / ML Like on League?Ian Schweer, Riot Games · 1:00:39 · Nov 2022 · 478 views · MLOps Coffee SessionsPodcastDatabricks Model Serving V2Rafael Pierre, Databricks · 43:17 · Sept 2022 · 866 views · MLOps Coffee SessionsPodcastMLOps at DoorDashHien Luu & DoorDash Leads, DoorDash · 45:20 · Aug 2022 · 1,115 views · MLOps Coffee SessionsPodcastML Platforms, Where to Start?Olalekan Elesin, HRS Product Solutions GmbH · 52:52 · Aug 2022 · 849 views · MLOps Coffee SessionsPodcastTurning Redis into a Composable, ML Data PlatformSamuel Partee, Redis · 48:21 · Jul 2022 · 638 views · MLOps Coffee SessionsPodcastMLflow vs Kubeflow 2022Byron Allen, Contino · 1:05:40 · Jul 2022 · 6,435 views · MLOps Coffee SessionsPodcastWhy and When to Use Kubeflow for MLOpsRyan Russon, Maven Wave Partners · 58:57 · Jul 2022 · 1,619 views · MLOps Coffee SessionsMeetupFLOps with Scaleout's Open-core PlatformMarco Capuccini, Scaleout Systems · 44:36 · Jun 2022 · 533 views · MLOps MeetupMeetupThe Post Modern StackJacopo Tagliabue, Coveo · 1:04:58 · Jun 2022 · 857 views · MLOps MeetupMeetupBuilding a Movie Recommendation System on Tecton with SnowflakeDavid Hershey, Tecton · 54:08 · Jun 2022 · 1,059 views · MLOps MeetupScaling Real-time Machine Learning at ChimePeeyush Agarwal, Chime · 24:22 · May 2022 · 1,385 views · MLOps Lightning SessionsPodcastGPU For Machine LearningRonen Dar & Gijsbert Janssen van Doorn, Run:ai · 1:03:33 · May 2022 · 440 views · MLOps Coffee SessionsPodcastReal-time Model Inference in a Video Streaming EnvironmentBrannon Dorsey, Runway · 58:02 · May 2022 · 616 views · MLOps Coffee SessionsPodcastDon't Listen Unless You Are Going to Do ML in ProductionKyle Morris, banana.dev · 51:30 · Mar 2022 · 768 views · MLOps Coffee SessionsMeetupApplications of Data ScienceConnie Yang, Pallet · 50:35 · Mar 2022 · 641 views · MLOps MeetupPodcastLessons from Studying FAANG ML SystemsErnest Chan, Duo Security · 45:32 · Mar 2022 · 1,051 views · MLOps Coffee SessionsPodcastPlatform Thinking: A Lemonade Case StudyOrr Shilon, Lemonade · 51:42 · Feb 2022 · 1,551 views · MLOps Coffee SessionsPodcastCalibration for ML at EtsyErica Greene & Seoyoon Park, Etsy · 49:34 · Jan 2022 · 381 views · MLOps Coffee SessionsMeetupJust Build It! Tips for Making ML Engineering and MLOps RealAndy McMahon, NatWest Group · 48:17 · Jan 2022 · 1,382 views · MLOps MeetupPodcast2021 MLOps Year in ReviewVishnu Rachakonda, Tesseract Health & Demetrios Brinkmann, MLOps Community · 51:20 · Jan 2022 · 434 views · MLOps Coffee SessionsMeetupSetting up an ML Platform on GCP: Lessons LearnedMefta Sadat, Loblaw Digital · 39:54 · Dec 2021 · 729 views · MLOps MeetupPodcastWikimedia MLOpsChris Albon, Wikimedia Foundation · 1:05:34 · Dec 2021 · 804 views · MLOps Coffee SessionsPodcastI Don't Like Jupyter NotebooksJoel Grus, Capital Group · 55:41 · Nov 2021 · 3,008 views · MLOps Coffee SessionsPodcastThe Future of ML and Data PlatformsMichael Del Balso, Tecton · 55:17 · Oct 2021 · 1,205 views · MLOps Coffee SessionsMeetupSystem Design for Recommendations and SearchEugene Yan, Amazon · 58:23 · Sept 2021 · 95K views · MLOps MeetupMeetupBuilding Machine Learning Models into Docker ImagesLuke Marsden, MLOps Consulting · 1:06:27 · Aug 2021 · 6,276 views · MLOps Meetupmlctl and Hydrosphere Open Source MLOps Libraries DemoAlex Chung, Intuit · 36:24 · Aug 2021 · 137 views · Social Good Tech Working Group 2021PodcastAggressively Helpful Platform TeamsStefan Krawczyk, Stitch Fix · 51:52 · Aug 2021 · 381 views · MLOps Coffee SessionsPodcastTour of Upcoming Features on the Hugging Face Model HubJulien Chaumond, Hugging Face · 52:05 · Jul 2021 · 322 views · MLOps Coffee SessionsMeetupBuilding ML Blocks with Kubeflow Orchestration with Feature StoreAniruddha Choudhury, Publicis Sapient · 1:26:03 · Jul 2021 · 2,160 views · MLOps MeetupPodcastLearning from 150 Successful ML-enabled Products at Booking.comPablo Estevez, Booking.com · 56:32 · Jul 2021 · 890 views · MLOps Coffee SessionsHow Pinterest Powers Image SimilarityShaji Chennan Kunnummel, Pinterest · 57:32 · Jun 2021 · 2,340 views · ML System Design ReviewsSGT Model Deployment Working Group June 22, 2021 Meeting · 40:55 · Jun 2021 · 65 views · Social Good Tech Model Deployment Working GroupPodcastMaturing Machine Learning in EnterpriseKyle Gallatin, Etsy · 47:09 · Jun 2021 · 465 views · MLOps Coffee SessionsMeetupBuilding an ML Platform from Scratch: Live Coding SessionAlon Gubkin, Aporia · 1:57:24 · Jun 2021 · 16K views · MLOps MeetupSGT Model Deployment Working Group May 19, 2021 Meeting · 52:00 · May 2021 · 146 viewsPodcastMachine Learning at AtlassianGeoff Sims, Atlassian · 58:23 · Apr 2021 · 1,163 views · MLOps Coffee SessionsPodcastMLOps Engineering Labs Recap, Part 2Laszlo Sranger & Artem Yushkovsky, Neuro & Paulo Maia, Nilgai · 1:04:16 · Mar 2021 · 297 views · MLOps Coffee SessionsPodcastMLOps Engineering Labs Recap, Part 1John Savage, Overstock & Alexey Naiden & Varuna Jayasiri & Michel Vasconcelos, Bank of Nordeste · 59:26 · Feb 2021 · 571 views · MLOps Coffee SessionsMeetupMachine Learning Design Patterns for MLOpsValliappa Lakshmanan, Google Cloud · 56:42 · Feb 2021 · 5,242 views · MLOps MeetupMeetupReal-time Feature Pipelines, A Personal HistoryHendrik Brackmann, Tide · 58:07 · Jan 2021 · 774 views · MLOps MeetupPodcastSRE for ML InfraTodd Underwood, Google · 1:11:50 · Dec 2020 · 1,325 views · MLOps Coffee SessionsPodcastMonzo Bank - An MLOps Case StudyNeal Lathia, Monzo Bank · 1:03:54 · Dec 2020 · 1,686 views · MLOps Coffee SessionsMeetupOperationalize Open Source Models with SAS Open Model ManagerIvan Nardini, SAS · 56:53 · Oct 2020 · 814 views · MLOps MeetupPodcastMLOps + Machine LearningJames Sutton, Algorithmia · 1:01:50 · Oct 2020 · 244 views · MLOps Coffee SessionsPodcastAnalyzing "Continuous Delivery and Automation Pipelines in ML", Part 3David Ponte, Benevolent AI · 1:06:28 · Oct 2020 · 294 views · MLOps Coffee SessionsMeetupBring Your On-Prem ML Use Cases to Production on Google Cloud using KubeflowChanchal Chatterjee, Google · 20:28 · Sept 2020 · 325 views · MLOps MeetupMeetupStreaming Machine Learning with Apache Kafka and Tiered StorageKai Waehner, Confluent · 52:50 · Sept 2020 · 487 views · MLOps MeetupMeetupBuilding Say Less: An AI-Powered Summarization AppYoav Zimmerman, Model Zoo · 53:08 · Sept 2020 · 144 views · MLOps MeetupMLOps Cubonacci workshop · 53:05 · Aug 2020 · 140 viewsMeetupScaling ML Capabilities in Large OrganizationsBertjan Broeksema & Axel Goblet, BigData Republic · 1:02:47 · Aug 2020 · 191 views · MLOps MeetupMeetupHow to Leverage ML Tooling EcosystemMariya Davydova, Neu.ro · 55:57 · Jul 2020 · 204 views · MLOps MeetupPodcastMLOps: Isn't That Just DevOps?Ryan Dawson, Seldon · 1:06:32 · Jul 2020 · 485 views · MLOps Coffee SessionsMeetupDeep Dive on Paperspace ToolingMisha Kutsovsky, Paperspace · 1:07:15 · Jul 2020 · 263 views · MLOps MeetupPodcastDifferent Ways of Serving ML ModelsByron Allen · 1:04:46 · Jul 2020 · 530 views · MLOps Coffee SessionsMeetupRunning a Fintech on Machine LearningCaique Lima & Cristiano Breuel, Nubank · 53:19 · Jun 2020 · 1,050 views · MLOps MeetupPodcastServing Models with Kubeflow · 49:57 · Jun 2020 · 3,479 views · MLOps Coffee SessionsMeetupFury Platform and Fury Data Apps at Mercado LibreCarlos de la Torre, Mercado Libre · 10:30 · May 2020 · 2,963 views · MLOps MeetupMeetupMachine Learning at Scale in Mercado LibreCarlos de la Torre, Mercado Libre · 59:28 · May 2020 · 513 views · MLOps MeetupMeetupTrueLayer's MLOps PipelineAlex Spanos, TrueLayer · 56:17 · Apr 2020 · 217 views · MLOps MeetupMeetupBuilding an ML Platform at SurveyMonkeyShubhi Jain, SurveyMonkey · 55:42 · Apr 2020 · 811 views · MLOps Meetup