跳到正文
原文
Tomasz Tunguz 博客·· 27 天前精选AI 评分76

How to Automate Inbound

How to Automate Inbound

文章要点
  • 1Vercel COO 详解 inbound 销售智能体搭建,起步仅一名工程师投入约 20% 时间,现运行销售漏斗顶部
  • 2首版提示词约 125 行,由团队最强 SDR 撰写,6 月上线、8 月撤出人工审核
  • 3提示词增至 1000 行后模型不再总守规则,团队拆分规则与判断,inbound 收敛为 14 条规则
  • 4Jeanne 称整套功能每年推理与基础设施成本约 1000 美元,SDR 团队全员晋升 outbound
决策要点

生产级智能体的成熟方向是规则化,把确定性环节交给代码,模型只保留人原本做判断的部分,搭建投入可以很小。

  • 影响:销售漏斗顶部这类流程确定的功能可用极小投入自动化,一名兼职工程师加每年约 1000 美元即可跑通;岗位会向上移动,SDR 提前转向 outbound 对话;业务扩张会推高提示词复杂度,规则与判断的边界需要持续维护。
  • 参考:可考虑先盘点自家线索处理中的确定性环节,把规则交给代码、只把判断留给模型;试点期可借鉴其做法,先全量复核再过渡到按比例抽检;值得同步测算自动化与人工的成本对比。
  • 依据:搭建过程、14 条规则与每年 1000 美元成本均为 Vercel COO 访谈自述口径,暂无独立验证;65% 纯代码节点的结论出自作者对 14 个生产级智能体工作流的分析。
正文 · 原文

In short : Jeanne DeWitt Grosser, COO of Vercel, walks through the construction of the company's inbound sales agent: one GTM engineer at 20% time, a prompt written by the top SDR, six weeks of human-in-the-loop QA, & the eventual migration from a 1,000-line prompt to 14 deterministic rules with the model reserved for judgment.

Jeanne DeWitt Grosser, COO of Vercel, joined me on Office Hours to walk through how she & her team actually built the agent that now runs the top of Vercel’s sales funnel.

It started with one engineer.

Vercel founded a go-to-market engineering team & handed the problem to a single engineer spending roughly 20% of his time on it. The first version of the agent was a prompt of about 125 lines, written by the best SDR on the team, encoding Vercel’s rules for qualification.

“We kicked it off in June, kept human in the loop from our top SDRs, & by August pulled the human out. So that was sort of what I think succeeded at first, was picking a problem that was reasonably deterministic & then throwing all of our unique context around how do you get the model to behave within Vercel’s four walls.”

Then the SDR managed the agent like a new rep. For the first phase, the agent did everything except send messages. It researched, qualified, & drafted.

“I almost think about this the way you would think about a human QA. If I’m its manager, I probably read 100% of that person’s first hundred emails while I’m teaching him or her the job. And that was our human in the loop phase on this. Then afterwards, I assume that person is now generally competent. And so maybe I do a simple random sample of like one out of every 100 outreaches they do.”

Six weeks of that produced a enough data & improvement to complete the effort. Rather than reviewing many posts, the effort shifted to sampling a few.

The business grew & evolved. So did the prompt - to 1000 lines.

Over the following year Vercel added product surface area & moved upmarket into enterprise, enticing a greater diversity of companies.

“The model actually won’t always follow some of the rules that are embedded in that prompt. And again, there are a bunch of things in qualification & sales that are actually pretty deterministic. It’s really a rule.”

The team divided the prompt into two parts : rules & judgment. Engineers encoded the rules & left the model the work that required judgment.

Inbound now runs on 14 rules. When a lead arrives, the system performs a Salesforce lookup to determine whether there is an open opportunity associated with the account, & if so, routes it to the account executive.

“The model shouldn’t get to decide, we just want that to occur. So now actually, our inbound is 14 rules. And we’re really only using the model for thinking exactly where a human would have thought previously.”

This is the same pattern I found in 14 production agent workflows & wrote about in Is AI Doing Less & Less?. 65% of the nodes in those workflows run as pure code, & only 14% remain fully agentic.

Because the rules are explicit, Vercel runs a second agent that watches for breaches. When the system breaks one of the 14 rules, the escalation agent determines whether the breach should have occurred & fixes it or blesses the exception.

The team changed, too. The SDR team all received promotions to outbound, skipping the customary year.

“The value of humans is talking to humans. And so the more that I can get folks out of email marketing & back into having a conversation, the more value I think we’ll get out of the BDR function.”

Jeanne provides the clearest template yet for the future of inbound, running the entire function for a unicorn for about $1,000 per year in inference & infrastructure.

Apple Podcasts | YouTube

Get the next one in your inbox

The 1-minute read that turns tech data into strategic advantage.
Read by 150k+ founders & operators.

GP at Theory Ventures. Former Google PM. Sharing data-driven insights on AI, web3, & venture capital.

Bloomberg • WSJ • Economist

来源:Tomasz Tunguz 博客 · tomtunguz.com