latency

43 talks

MCP 2.0: What Changes, What Breaks, and What You Need to Do About ItMateo Torres, Arcade.dev · 21:47 · Aug 2026 · 79 viewsPodcastVoice Agent Use CasesAnurag Beniwal, ElevenLabs · 51:05 · Jun 2026 · 326 views · MLOps PodcastWhy Emotion Matters More Than SoundAnoop Dawar, Deepgram & Ajeet Grewal, Sierra · 26:44 · Feb 2026 · 109 viewsContext Engineering pitfalls for our e-commerce agentNishikant Dhanuka & Chiara Carateli, Prosus · 28:06 · Jan 2026 · 401 views · Agents in Production 2025Real-Time Voice Agents in ProductionPanos Stravopodis, Elyos AI · 42:16 · Jan 2026 · 439 views · Agents in Production 2026Tool definitions are the new Prompt EngineeringChiara Caratelli, Prosus Group & Alex Salazar, Arcade.dev · 57:12 · Jan 2026 · 379 viewsPodcastVoice AI's Biggest Weakness ExposedBrooke Hopkins, Coval · 38:22 · Dec 2025 · 262 views · MLOps PodcastThe Latency Problem Nobody Talks AboutAnoop Dawar, Deepgram · 20:38 · Nov 2025 · 951 viewsFine-Tuning is BrokenTanmay Chopra, Neeva · 25:27 · Oct 2025 · 291 views · AI in Production 2025An AI Company By AccidentRuss d'Sa, LiveKit · 32:35 · Sept 2025 · 281 viewsSmart Agents Start with Smart LLM ChoicesShai Rubin, Studel AI · 25:01 · Aug 2025 · 203 views · Agents in Production 2025Voice model performance optimizationMadison Kanna, Baseten · 16:32 · Aug 2025 · 282 views · Agents in Production 2025I Built A Trustworthy Voice Assistant · 12:17 · Aug 2025 · 142 views · Agents in Production 2025Traditional vs LLM Recommender Systems: Are They Worth It?Arpita Vats, LinkedIn · 47:40 · Aug 2025 · 2,390 viewsReading groupMem0: Building Production-Ready AI Agents with Scalable Long-Term MemoryNehil Jain, Stealth AI Startup & David DeStefano, Adonis · 58:25 · Jun 2025 · 3,612 views · MLOps Reading GroupPodcastGenAI Traffic: Why API Infrastructure Must Evolve... AgainErica Hughberg, Tetrate · 1:06:25 · Mar 2025 · 408 views · MLOps PodcastAI in Production 2025 | Keynote · 2:07:08 · Mar 2025 · 935 views · AI in Production 2025PodcastThe Challenge with AI Voice AgentsPaul van der Boor & Floris Fok, Prosus Group · 47:38 · Feb 2025 · 15K views · Agents in Production SeriesGoal Oriented Retrieval AgentsZoe Weil, Faber Labs · 25:09 · Dec 2024 · 750 views · Agents in Production 2024The Coming Revolution of AI AgentsJazmia Henry, Iso AI & Rogerio Bonatti, Microsoft & Julia Kroll, Deepgram & Joshua Alphonse, PremAI · 28:59 · Nov 2024 · 336 viewsPodcastHow Agentic Workflows Will Change EverythingRaj Rikhy, Microsoft · 49:13 · Oct 2024 · 705 views · MLOps PodcastCommon ML Serving Architectures ExplainedRebecca Taylor, Lidl e-commerce · 17:33 · Oct 2024 · 443 viewsStreamlining Model DeploymentDaniel Lenton, Unify · 21:39 · May 2024 · 334 views · AI in Production 2024Building Conversational AI Agents with VoiceMichelle Chan, Deepgram · 11:55 · Apr 2024 · 390 views · AI in Production 2024Shipping LLMs: Buckle Up & Enjoy the RideRex Harris · 12:51 · Apr 2024 · 212 views · AI in Production 2024Vision Pipelines in Production: Serving & OptimisationsBiswaroop Bhattacharjee, Prem AI · 13:24 · Apr 2024 · 281 views · AI in Production 2024Building the Next Generation of Reliable AIShreya Rajpal, Guardrails AI · 30:27 · Mar 2024 · 763 views · AI in Production 2024Current State of LLMs in ProductionApurva Misra, Truckstop · 11:46 · Nov 2023 · 686 views · LLMs in Production 2023Exploring the Latency/Throughput & Cost Space for LLM InferenceTimothée Lacroix, Mistral · 30:25 · Oct 2023 · 29K viewsLLMs vs LMs in ProductionDenys Linkov, Voiceflow · 24:44 · Aug 2023 · 1,337 views · LLMs in Production 2023UX of an LLM UserMisty Free, Jasper & Davis Treybig, Innovation Endeavors & Dina Yerlan, Adobe Firefly & Artem Harutyunyan, Bardeen AI · 31:48 · Aug 2023 · 742 views · LLMs in Production 2023Large Model Training and Inference with DeepSpeedSamyam Rajbhandari, Microsoft DeepSpeed · 36:23 · Jun 2023 · 9,517 views · LLMs in Production 2023No Rose Without a Thorn - Obstacles to Successful LLM DeploymentsTanmay Chopra, Neeva · 10:24 · May 2023 · 606 views · LLMs in Production 2023PodcastCohere Large Language Model at ScaleNils Reimers, Cohere · 1:14:53 · May 2023 · 672 views · MLOps PodcastLarge Language Models in Production Round-table ConversationDiego Oppenheimer, Factory HQ & David Hershey, Unusual Ventures & Hannes Hapke, Digits & James Richards, Bountiful & Rebecca Qian, Facebook AI Research · 57:21 · Mar 2023 · 14K views · LLMs in Production 2023MeetupThe 7 Lines of Code You Need to Run Faster Real-time InferenceAdrian Boguszewski, Intel · 49:21 · Mar 2023 · 608 views · MLOps MeetupPodcastMLOps for Ad PlatformsAndrew Yates, promoted.ai · 49:24 · Oct 2022 · 439 views · MLOps Coffee SessionsMeetupBuilding a Movie Recommendation System on Tecton with SnowflakeDavid Hershey, Tecton · 54:08 · Jun 2022 · 1,059 views · MLOps MeetupMeetupOn Juggling, Dr. Seuss and Feature Stores for Real-time AI/MLNava Levy, Redis · 48:16 · May 2022 · 712 views · MLOps MeetupPodcastReal-time Model Inference in a Video Streaming EnvironmentBrannon Dorsey, Runway · 58:02 · May 2022 · 616 views · MLOps Coffee SessionsPodcastReal-Time Processing with Apache Flink, Kafka, and PinotJacob Tsafatinos, Elemy · 53:41 · May 2022 · 1,986 views · MLOps Coffee SessionsPodcastDon't Listen Unless You Are Going to Do ML in ProductionKyle Morris, banana.dev · 51:30 · Mar 2022 · 768 views · MLOps Coffee SessionsMeetupLaw of Diminishing Returns for Running AI Proof-of-ConceptsOguzhan Gencoglu, Top Data Science · 56:19 · May 2021 · 599 views · MLOps Meetup