Paying for it in 2025

14 sessions

PodcastReal World AI Agent StoriesZach Wallace, Nearpod Inc. · 47:08 · Jan 2025 · 903 views · MLOps Podcast

ClaimNearpod began using agents to generate questions for teachers and reduce the time teachers spend creating them.12:42

PodcastThe Agent Landscape - Lessons Learned Putting Agents Into ProductionPaul van der Boor & Floris Fok, Prosus Group · 1:08:41 · Feb 2025 · 2,326 views · Agents in Production Series

Pushed backThe speakers reject the idea that declining cost per token automatically means that agent systems are becoming cheaper overall, because cost per answer can rise as agents use more tokens and calls.21:33

PodcastStreaming Ecosystem Complexities and Cost ManagementRohit Agrawal, Tecton · 47:39 · Apr 2025 · 291 views · MLOps Podcast

ClaimOrganizations often struggle to provide different freshness and latency levels for different use cases while controlling infrastructure costs.7:04

Testing AI Intelligence: The Benchmarking BattleGreg Kamradt, Arc Prize · 48:31 · Jun 2025 · 358 views
How Agents Changed Vibe Coding ForeverBeyang Liu, Sourcegraph · 49:49 · Aug 2025 · 370 views

Pushed backBeyang Liu argues against keeping coding-agent costs low as the primary goal when higher costs save substantial human labor.33:37

Smart Agents Start with Smart LLM ChoicesShai Rubin, Studel AI · 25:01 · Aug 2025 · 203 views · Agents in Production 2025

ClaimFor code understanding, a useful model should produce concise, accurate, low-latency, and cost-effective answers.3:58

Advancing the Cost-Quality Frontier in Agentic AIKrista Opsahl-Ong, Databricks · 12:45 · Sept 2025 · 196 views · Agents in Production 2025

ClaimKrista Opsahl-Ong works on productionizing agents for enterprises at Databricks and on improving the cost-quality frontier.0:00

Cutting Costs with Artificial Intelligence · 12:36 · Sept 2025 · 104 views

ClaimMulti-agent systems make cost tracking harder because agents communicate with one another and with users while input and output sizes vary.0:52

Reading groupSmall Language Models are the Future of Agentic AIAdam Becker, MLOps Community & Nehil Jain, Stealth AI Startup & Sonam Gupta, AICamp · 58:13 · Sept 2025 · 807 views · MLOps Reading Group

Pushed backNehil Jain disputes the idea that smaller models are always cheaper by pointing to endpoint utilization, talent, and management costs.29:26

The Future of Compute: How AI Agents Are Reshaping InfrastructureDiego Oppenheimer, Guardrails AI · 38:34 · Sept 2025 · 372 views · Agents in Production 2025

ClaimAgentic workflows consume resources according to task complexity rather than simply clock time, which affects cost, timing, and downstream compute.8:05

AI Needs Memory: Here's How It WorksBen Labashian, Workhelix · 29:02 · Sept 2025 · 683 views

ClaimStoring an entire conversation can be economically and computationally costly, so agents need to be selective about what they retain.9:48

The Cost of AI: FinOps Strategies for Intelligent AgentsAdvait Patel, Broadcom · 31:05 · Sept 2025 · 245 views · Agents in Production 2025

ClaimAdvait Patel says autonomous AI agents are not necessarily optimized and can increase cloud costs when deployed incorrectly.2:26

How to Optimize AI Agents in Production · 27:06 · Sept 2025 · 521 views · Agents in Production 2025

Pushed backNimrod disputes the idea that the model alone determines accuracy, arguing that configuration choices can produce better accuracy-cost tradeoffs.10:54

What It Takes to Run Multi-Agent SystemsDipanwita Mallick, HP · 18:42 · Sept 2025 · 256 views

ClaimCost and privacy and security concerns are the two main roadblocks preventing enterprises from scaling AI.3:37