🏢 公司NewsroomDOCNCodex · 实盘不做把握 8/10
北京时间·🕒 发布 04:03:12时区推断·⟳ 抓取 04:09:32·⚡ 决策 07-24 04:10:52 +1m20s·95.6 天前
DigitalOcean发布Inference Engine模型合成功能并披露自测基准
这是DigitalOcean官方博客介绍模型合成工具和自测DRACO基准,方向上有助于其AI云产品叙事。
📄 原文DOCN↗ 原文
Anyone building with AI eventually hits the same tradeoff: how to get the most intelligence per dollar, the right model…
不做 DigitalOcean(DOCN.US)
公司官方博客式产品发布和自测benchmark,未披露客户、订单、收入或利润增量,短线edge不足,不做。
展开详情(成交明细 / 研究档案 / 原文全文 / 决策记录链)
研究档案
🔎 新鲜度:最早出现 2026-07-23 · 扩散 low · price-in 风险 medium ↗
关键理由
- 这是DigitalOcean官方博客介绍模型合成工具和自测DRACO基准,方向上有助于其AI云产品叙事。
- 正文未披露新增客户、订单金额、收入分成、使用量或对公司收入利润的量化影响,短线重定价依据不足。
主要风险
- 公司自家产品宣传和benchmark结果容易被市场视为营销材料,缺少外部客户选型或商业化数据验证。
原文全文
展开原文 · 7,999 字
Anyone building with AI eventually hits the same tradeoff: how to get the most intelligence per dollar, the right model at the right cost for each task. That’s what DigitalOcean Inference Engine is built for. On the hardest deep-research tasks, synthesizing several models’ outputs outperforms relying on one: an all-open-source panel (GLM 5.2 + Kimi K2.6) scored higher than every single model we tested, including Fable 5, at about half its cost per task.
Model synthesis , a new server-side tool on DigitalOcean Inference Engine , does that orchestration for you. It runs from a model configuration you define: a panel of models that process each request in parallel, and a synthesizer model that reviews the panel’s outputs and combines them into one response… Start from an optimized preset or define the panel and synthesizer yourself.
It pays off. We benchmarked model synthesis on DRACO, a 100-task deep-research benchmark, across 15 open-source and frontier model configurations. The key results:
GLM 5.2 + Kimi K2.6 panel scored 65.65% on quality at $0.83 per task, outperforming Fable 5 at 62.21% at $1.59 per task and every other single model score.
Four open-source combinations land in the ideal quadrant, offering higher quality at lower cost.
Fable 5 + GPT-5.6 frontier panel scored 69.01% on quality at $4.76 per task, the highest quality and highest cost of any model configuration tested.
We evaluated model synthesis across a series of research queries to measure both its response quality and cost efficiency, measured as Quality Score (where higher is better) and cost per task (the inference cost to run one task, where lower is better). The chart below plots each configuration’s quality against its cost per task: the ideal quadrant would be the top left, where quality is highest and cost per task is lowest. The best open-source configurations land in the ideal quadrant, with higher quality at a lower cost per task than frontier single models. (The open-source single models sit lower and further left: cheaper, but at lower quality.)
Figure 1. Quality versus cost per task in USD (up and to the left is better; the horizontal axis is log scale, so each gridline doubles the cost). The shaded area marks configurations that beat Fable 5 on both counts, higher quality and lower cost. The open-source GLM 5.2 + Kimi K2.6 panel is the standout: it scores higher than every single model, including Fable 5, at about half of Fable 5’s cost. The frontier Fable 5 + GPT-5.6 pairing tops quality but at a premium cost, and the cheap open-source single models sit lower and to the left, cheapest but at lower quality. In each panel, the first model listed is the synthesizer.
How we tested it
We benchmarked model synthesis against single models on DRACO, a public deep-research benchmark. DRACO is built for exactly the kind of question a single quick answer cannot handle; it poses 100 demanding research tasks across ten real-world domains, from law and medicine to finance and product comparison. Each task is open-ended and evidence-heavy, questions where a strong answer has to gather facts from many angles, weigh them, and lay out a thorough, well-cited response rather than a one-line reply. Every task comes with a detailed rubric of the specific points a good answer should cover, and an independent judge scores each answer on how many of those points it includes and supports. Because the same judge grades every configuration against the same rubric, the scores are directly comparable. That breadth and evidence work is precisely what the synthesis tool is designed to improve, which is why we chose DRACO. For each configuration, we recorded a quality score and cost per task. We compared 15 configurations: 4 single models (the frontier GPT-5.6 and Fable 5, plus open-source DeepSeek V4 Pro and GLM 5.2) and 11 model configurations that vary the panel and the synthesizer, 1 frontier pairing and 10 open-source. The full set appears in Tables 1 and 2.
Results
The best open-source model configuration scored higher than every single model tested on this benchmark, and most model configurations beat the strongest single model. Compared with frontier single models, the best open-source multi-model (GLM 5.2 + Kimi K2.6) configuration delivers higher quality than both Fable 5 and GPT-5.6 at a lower cost per task. The trade-off is cost against the cheapest single open models: GLM 5.2 and DeepSeek V4 Pro run for less per task, but at much lower quality. Table 1 ranks the configurations we measured end-to-end by quality, with cost per task.
Table 1. Higher quality score is better; lower cost per task is better. The GLM 5.2 + Kimi K2.6 panel and the DeepSeek V4 Pro + Kimi K2.6 panel synthesized by DeepSeek were scored on the same benchmark but not separately metered for cost in this run, so they appear in Table 2 by score. Their per-task cost sits in the same range as the other two-model panels. Note: Costs and cost per task are based on token pricing and usage rates at the time of testing (July 2026).
Two patterns stand out. First, the synthesizer choice drives quality . On every panel, GLM 5.2 synthesized best, DeepSeek V4 Pro next, and Kimi K2.6 last. Second, the best two-model panel is as strong as the three-model panel . Table 2 shows every panel and synthesizer combination by quality.
Table 2. Every open-source model configuration by quality score. Rows are the panel; columns are the synthesizer. Green cells beat the strongest single model (GPT-5.6 at 64.32). Single models for reference: GPT-5.6 64.32, Fable 5 62.21, DeepSeek V4 Pro 58.15, GLM 5.2 58.12. Frontier panel for reference: Fable 5 + GPT-5.6 69.01.**
Figure 2. Every model configuration is ranked by quality score (DRACO, 100 tasks; higher is better). Open-source model configurations are shown in green, single models in gray, and the frontier configuration in black. Most open-source configurations clear the best single model.
The synthesizer you choose drives the quality
Across every panel, GLM 5.2 was the strongest synthesizer, DeepSeek V4 Pro was second, and Kimi K2.6 was last. Swapping only the synthesizer moved a model configuration by 3 to 5 points, more than the difference between a two-model and a three-model panel. In fact the best two-model panel (65.65) beat the three-model panel (65.21), so adding a third open model was roughly a wash on quality. The practical lesson is to pick a strong synthesizer first and keep the panel lean.
Efficiency: high quality for about half the cost
For the quality it delivers, the best model configuration wins on cost. GLM 5.2 with Kimi K2.6 scores 65.65 at $0.83 per task, higher than every single model while costing about half of Fable 5 ($1.59) and roughly 40 percent less than GPT-5.6 ($1.39). You get better quality than a frontier model and pay less for it. The only cheaper option is a bare single open model (GLM 5.2 at $0.25 or DeepSeek V4 Pro at $0.31), several times cheaper but also the lowest quality. So if all you need is rock-bottom cost, a single open model is hard to beat; but for the best quality per dollar, an open-source panel with a GLM 5.2 synthesizer beats the single models outright at about half the cost of the strongest ones.
Cost per task (USD) is based on the specific pricing available at the time of testing (July 2026) and is subject to change based on third-party API rate adjustments. (lower is better)
What this means for you
The through-line here is intelligence per dollar: matching the amount of intelligence you use to what each task actually needs. Model synthesis gives you a dial for that, not a tradeoff to solve from scratch. For high-volume, cost-sensitive work (bulk classification, routine summarization), a single open model like GLM 5.2 gets you the lowest cost per task. For research-heavy work where answer quality matters more than the bill (due diligence, competitive analysis, legal or medical research), pair GLM 5.2 and Kimi K2.6 in a
Model synthesis , a new server-side tool on DigitalOcean Inference Engine , does that orchestration for you. It runs from a model configuration you define: a panel of models that process each request in parallel, and a synthesizer model that reviews the panel’s outputs and combines them into one response… Start from an optimized preset or define the panel and synthesizer yourself.
It pays off. We benchmarked model synthesis on DRACO, a 100-task deep-research benchmark, across 15 open-source and frontier model configurations. The key results:
GLM 5.2 + Kimi K2.6 panel scored 65.65% on quality at $0.83 per task, outperforming Fable 5 at 62.21% at $1.59 per task and every other single model score.
Four open-source combinations land in the ideal quadrant, offering higher quality at lower cost.
Fable 5 + GPT-5.6 frontier panel scored 69.01% on quality at $4.76 per task, the highest quality and highest cost of any model configuration tested.
We evaluated model synthesis across a series of research queries to measure both its response quality and cost efficiency, measured as Quality Score (where higher is better) and cost per task (the inference cost to run one task, where lower is better). The chart below plots each configuration’s quality against its cost per task: the ideal quadrant would be the top left, where quality is highest and cost per task is lowest. The best open-source configurations land in the ideal quadrant, with higher quality at a lower cost per task than frontier single models. (The open-source single models sit lower and further left: cheaper, but at lower quality.)
Figure 1. Quality versus cost per task in USD (up and to the left is better; the horizontal axis is log scale, so each gridline doubles the cost). The shaded area marks configurations that beat Fable 5 on both counts, higher quality and lower cost. The open-source GLM 5.2 + Kimi K2.6 panel is the standout: it scores higher than every single model, including Fable 5, at about half of Fable 5’s cost. The frontier Fable 5 + GPT-5.6 pairing tops quality but at a premium cost, and the cheap open-source single models sit lower and to the left, cheapest but at lower quality. In each panel, the first model listed is the synthesizer.
How we tested it
We benchmarked model synthesis against single models on DRACO, a public deep-research benchmark. DRACO is built for exactly the kind of question a single quick answer cannot handle; it poses 100 demanding research tasks across ten real-world domains, from law and medicine to finance and product comparison. Each task is open-ended and evidence-heavy, questions where a strong answer has to gather facts from many angles, weigh them, and lay out a thorough, well-cited response rather than a one-line reply. Every task comes with a detailed rubric of the specific points a good answer should cover, and an independent judge scores each answer on how many of those points it includes and supports. Because the same judge grades every configuration against the same rubric, the scores are directly comparable. That breadth and evidence work is precisely what the synthesis tool is designed to improve, which is why we chose DRACO. For each configuration, we recorded a quality score and cost per task. We compared 15 configurations: 4 single models (the frontier GPT-5.6 and Fable 5, plus open-source DeepSeek V4 Pro and GLM 5.2) and 11 model configurations that vary the panel and the synthesizer, 1 frontier pairing and 10 open-source. The full set appears in Tables 1 and 2.
Results
The best open-source model configuration scored higher than every single model tested on this benchmark, and most model configurations beat the strongest single model. Compared with frontier single models, the best open-source multi-model (GLM 5.2 + Kimi K2.6) configuration delivers higher quality than both Fable 5 and GPT-5.6 at a lower cost per task. The trade-off is cost against the cheapest single open models: GLM 5.2 and DeepSeek V4 Pro run for less per task, but at much lower quality. Table 1 ranks the configurations we measured end-to-end by quality, with cost per task.
Table 1. Higher quality score is better; lower cost per task is better. The GLM 5.2 + Kimi K2.6 panel and the DeepSeek V4 Pro + Kimi K2.6 panel synthesized by DeepSeek were scored on the same benchmark but not separately metered for cost in this run, so they appear in Table 2 by score. Their per-task cost sits in the same range as the other two-model panels. Note: Costs and cost per task are based on token pricing and usage rates at the time of testing (July 2026).
Two patterns stand out. First, the synthesizer choice drives quality . On every panel, GLM 5.2 synthesized best, DeepSeek V4 Pro next, and Kimi K2.6 last. Second, the best two-model panel is as strong as the three-model panel . Table 2 shows every panel and synthesizer combination by quality.
Table 2. Every open-source model configuration by quality score. Rows are the panel; columns are the synthesizer. Green cells beat the strongest single model (GPT-5.6 at 64.32). Single models for reference: GPT-5.6 64.32, Fable 5 62.21, DeepSeek V4 Pro 58.15, GLM 5.2 58.12. Frontier panel for reference: Fable 5 + GPT-5.6 69.01.**
Figure 2. Every model configuration is ranked by quality score (DRACO, 100 tasks; higher is better). Open-source model configurations are shown in green, single models in gray, and the frontier configuration in black. Most open-source configurations clear the best single model.
The synthesizer you choose drives the quality
Across every panel, GLM 5.2 was the strongest synthesizer, DeepSeek V4 Pro was second, and Kimi K2.6 was last. Swapping only the synthesizer moved a model configuration by 3 to 5 points, more than the difference between a two-model and a three-model panel. In fact the best two-model panel (65.65) beat the three-model panel (65.21), so adding a third open model was roughly a wash on quality. The practical lesson is to pick a strong synthesizer first and keep the panel lean.
Efficiency: high quality for about half the cost
For the quality it delivers, the best model configuration wins on cost. GLM 5.2 with Kimi K2.6 scores 65.65 at $0.83 per task, higher than every single model while costing about half of Fable 5 ($1.59) and roughly 40 percent less than GPT-5.6 ($1.39). You get better quality than a frontier model and pay less for it. The only cheaper option is a bare single open model (GLM 5.2 at $0.25 or DeepSeek V4 Pro at $0.31), several times cheaper but also the lowest quality. So if all you need is rock-bottom cost, a single open model is hard to beat; but for the best quality per dollar, an open-source panel with a GLM 5.2 synthesizer beats the single models outright at about half the cost of the strongest ones.
Cost per task (USD) is based on the specific pricing available at the time of testing (July 2026) and is subject to change based on third-party API rate adjustments. (lower is better)
What this means for you
The through-line here is intelligence per dollar: matching the amount of intelligence you use to what each task actually needs. Model synthesis gives you a dial for that, not a tradeoff to solve from scratch. For high-volume, cost-sensitive work (bulk classification, routine summarization), a single open model like GLM 5.2 gets you the lowest cost per task. For research-heavy work where answer quality matters more than the bill (due diligence, competitive analysis, legal or medical research), pair GLM 5.2 and Kimi K2.6 in a
决策记录链 · 只追加
每次领取产生一条记录,重新决策追加一条并以 supersedes 指向被替代的记录(ADR 0014)。
这条决策早于决策账本(2026-10-08 起逐条追加),没有追加记录。