Agents in production in 2023

18 sessions

PodcastThe Birth and Growth of Spark: An Open Source Success StoryMatei Zaharia, Databricks and Stanford · 57:42 · Apr 2023 · 2,014 views · MLOps Podcast

ClaimMatei Zaharia says Spark began as a PhD project focused on programming with large-scale data and was motivated by the limitations of existing tools for machine learning and interactive queries.9:13

Age of Industrialized AIDan Jeffries, AI Infrastructure Alliance · 29:56 · Apr 2023 · 1,005 views · LLMs in Production 2023

ClaimDan Jeffries says large thinking models will orchestrate tools and other models throughout software workflows, including game development.2:42

LangChain: Enabling LLMs to Use ToolsHarrison Chase, LangChain · 11:43 · Apr 2023 · 2,609 views · LLMs in Production 2023

ClaimLangChain has mainly focused on prototyping, but is starting to think about what it takes to run chains and agents in production.0:59

Generative Interfaces Beyond ChatLinus Lee, Notion · 24:49 · May 2023 · 18K views · LLMs in Production 2023

ClaimA conversation includes shared context, the speaker's intent, the recipient's interpretation or internal thinking, and an action.4:05

Agentic Relationship ManagementAshe Magalhaes, Hearth AI · 10:01 · May 2023 · 1,141 views · LLMs in Production 2023

ClaimHearth AI is developing agentic relationship management products that use AI agents to learn from, understand, and act on behalf of users.0:28

Reasoning MachinesJustin Uberti, Fixie.ai & Jon Turow, Madrona Venture Group · 14:11 · May 2023 · 386 views · LLMs in Production 2023

ClaimManually supplying information to an LLM does not scale, so tools can retrieve the necessary data from data stores.9:47

Guiding LLMs While Staying in the Driver's SeatJacob van Gogh, Adept AI · 10:02 · May 2023 · 350 views · LLMs in Production 2023

ClaimAdept AI is building a natural-language software collaborator that controls software tools such as Airbnb and Salesforce through mouse and keyboard actions.0:31

LLMs as Intelligent AssistantsSarah Aerni, Salesforce · 28:45 · Jun 2023 · 967 views · LLMs in Production 2023

Pushed backSarah Aerni rejects replacing human review with fully autonomous generated output and argues that human review remains critical.23:40

Building Production CopilotsTristan Zajonc, Continual · 19:44 · Jul 2023 · 496 views · LLMs in Production 2023

Pushed backTristan Zajonc says autonomous agents do not work reliably yet, while the host expresses doubt based on what has been implemented so far.17:18

Building Reliable AI AgentsTravis Fischer · 17:43 · Jul 2023 · 541 views · LLMs in Production 2023

Pushed backFully autonomous agents are not yet the right default for production; more deterministic, code-driven agents should be used instead.9:12

Guardrails for LLMs: A Practical ApproachShreya Rajpal, Guardrails AI · 11:51 · Aug 2023 · 6,697 views · LLMs in Production 2023

ClaimShreya Rajpal says a failed verification can trigger a new prompt containing context about what went wrong, so the model can try to correct its output.5:17

Using LLMs to Power Consumer Search at ScaleAravind Srinivas, Perplexity AI · 37:04 · Aug 2023 · 867 views · LLMs in Production 2023

Pushed backAravind Srinivas rejects describing Perplexity as merely an LLM wrapper, arguing that the product requires substantial orchestration and software engineering around the models.18:18

PodcastBuilding Cody, an Open Source AI Coding AssistantBeyang Liu, Sourcegraph · 1:02:13 · Aug 2023 · 812 views · MLOps Podcast

Pushed backDemetrios Brinkmann questioned whether low-code and no-code tools already addressed the problem, while Beyang Liu argued that their abstractions limit expressivity when requirements go beyond the platform's anticipated use cases.45:03

LLM SecurityRaahul Dutta, Elsevier & Uri Shamay, Null & Sankalp Gilda, DevelopYours · 1:00:17 · Oct 2023 · 607 views · MLOps Mini Summit 2023

Pushed backThe idea that language models can soon operate autonomously in production was qualified by Uri Shamay, who said current models still fail at simple multi-step instructions.25:10

What Drives GenAI Development in the Next 3 YearsEuro Beinat, Prosus · 18:54 · Oct 2023 · 612 views · LLMs in Production 2023

Pushed backEuro Beinat says that reliable agents at scale are still difficult and suggests that near-term agents will focus on specific niches, while leaving room for the audience to disagree.10:12

The Truth About AI AgentsSilen Naihin, AutoGPT · 31:40 · Oct 2023 · 769 views · LLMs in Production 2023

Pushed backSilen Naihin disputes the idea that current AI agents are ready for reliable commercial use, saying that they often loop, become confused, or fail to complete tasks correctly.6:26

MeetupLLMs Mini Summit // MLOps Mini Summit Meetup #3Thomas Capelle, Weights & Biases & Boris Dayma, Craiyon & Jonathan Whitaker & Robbie McCorkell, Leap Labs · 1:45:28 · Nov 2023 · 1,335 views · MLOps Meetup

ClaimThomas Capelle says local LLM assistants can combine speech recognition, language models, tool calls, and text-to-speech.5:32

PodcastBuilding the Future of AI in Software DevelopmentVarun Mohan, Codeium · 1:04:35 · Dec 2023 · 1,085 views · MLOps Podcast

ClaimCodeium uses off-the-shelf tools such as Prometheus and Grafana for general monitoring but builds core LLM systems itself when self-hosting and tight integration require it.50:14