Nobody knows what a used GPU cluster is worth
- URL: https://ciphertalk.substack.com/p/nobody-knows-what-a-used-gpu-cluster
- Source: newsletter
- Author: Unknown
- Local evidence: OpenClaw定时任务/ClawFeed24小时高价值一览/2026-07-23-ClawFeed24小时高价值一览.md
- Fetch method: opencli web read
- Added: 2026-07-23
中文摘要
GPU 债和飞机、船舶不同：面值、清算价、持续运营价是三套数，而持续运营价取决于拓扑知识、散热 quirk 和静默数据损坏处置能力，这些通常不在贷款合同可见范围。文章用 H100 租金波动和 CoreWeave 类 GPU 抵押贷溢价说明，市场给出的高收益本质上是在给“看不清风险”定价。
One-liner
AI 基建债的难点不只是 GPU 会贬值，而是没人能精确定价一座二手集群。
Obsidian evidence excerpt
量产后再补 eval 会进入“用户说变差了却无法验证”的盲飞。文章给出 code / model / human 三类 grader 的取舍，并用 Claude Code、Descript、Bolt 的演进说明：早期靠 dogfood，上线后要靠窄场景到复杂行为的回归集。
链接：https://www.anthropic.com/engineering/demystifying-evals-for-ai-agents
2. 标题：Nobody knows what a used GPU cluster is worth
评分：8.8/10
推荐语：把 AI 基建融资讲到“抵押品会不会跟着运维团队一起走”这一层，数字扎实。引用 Meta Llama 3 训练中断统计：16,384 张 H100、54 天、419 次意外中断，其中 GPU 故障 148、HBM3 72；外推 20 万卡大约每天 50 次 GPU 故障。
摘要：GPU 债和飞机、船舶不同：面值、清算价、持续运营价是三套数，而持续运营价取决于拓扑知识、散热 quirk 和静默数据损坏处置能力，这些通常不在贷款合同可见范围。H100 租金从约 $8/h 掉到 $1.70 再反弹到 $2.35，CoreWeave 类 GPU 抵押贷相对基准约 +8.5pt，溢价就是“看不清风险”的价格。
链接：https://ciphertalk.substack.com/p/nobody-knows-what-a-used-gpu-cluster
3. 标题：Can a MUD evaluate LLMs?（CrucibleBench）
评分：8.7/10
推荐语：$99 的 persistent-world 行为评测原型，核心发现不是榜单第一，而是“LLM judge 会把排名打乱”。去掉依赖对话分类器的维度后，Gemini 3.1 Pro 从 #3 掉到 #9，DeepSeek R1 从 #7 升到 #2；分类器与独立 judge 的 per-model 一致率跨 21.7%–84.8%，而汇总 κ=0.04 完全看不出问题。
摘要：MUD 用可枚举动作空间（7 类命令、12 房间、14 物品）、NPC 信任/怀疑状态和局内持久化，把幻觉动作、对话死循环、错误房间交互变成可算法检测的失败模式。frontier 模型对话 looping 仍占 14%–66% 的 run。作者明确声明：这不是通用社交智能标尺，而是可解释行为测量的 POC。
链接：https://cruciblebench.ai/
4. 标题：Everyone Should Know SIMD
评分：8.6/10
推荐语：Mitchell Hashimoto 用 GhosttyFetched source / metadata
Nobody knows what a used GPU cluster is worth
作者: Meg McNulty
发布时间: 2026-05-05T18:45:06.281Z
原文链接: https://ciphertalk.substack.com/p/nobody-knows-what-a-used-gpu-cluster
Discover more from CipherTalk
Decoding deeptech's biggest trends.
Already have an account? Sign in
Nobody knows what a used GPU cluster is worth
[
](https://substack.com/@megmcnulty)
May 06, 2026
34
6
11
Share
If xAI defaults on its debt, Apollo Global Management ends up in the GPU rental business. That is in the contract, signed in June 2025, on a five billion dollar debt facility arranged by Morgan Stanley. The lenders have the right to take over Colossus, the company’s 200,000 GPU cluster outside Memphis, and rent it to other AI companies until the loan is repaid.
It’s interesting whether Apollo, or Diameter Capital Partners, or any of the other lenders now financing the AI buildout this way, would want to exercise that right.
The _harder_ question is what they would actually be holding if they did.
A GPU cluster bears little resemblance to a building. Its value at any given moment depends on how it has been provisioned, how it is currently performing, and whether the team that knows its quirks is still there. All of that sits off the lender's balance sheet, beyond the reach of anyone they can call.
This is one of the center problems of the AI infrastructure boom. I cannot determine why no one is talking about it. Tens of billions of dollars in debt is now collateralized by chips whose value depends on operational state, and the operational state is invisible to the people pricing the debt.
This week’s CipherTalk is about what happens to a specific kind of debt when the collateral itself can walk out the door with the operations team.
CipherTalk is a reader-supported publication. To receive new posts and support my work, consider becoming a free or paid subscriber.
The cluster does not run itself
At the scale these GPU clusters operate, hardware and systems break constantly. Keeping them productive is a craft.
Modern data center GPUs fail at roughly 9% annually. The number traces to Meta’s Llama 3 technical report, which documented 419 unforeseen disruptions across 16,384 H100s over 54 days of training, of which 148 were GPU failures and 72 were HBM3 memory failures. At 200,000 GPUs, that annualized rate works out to approximately 50 GPU failures every day. At xAI’s stated million-GPU target, Epoch AI projects a failure roughly every three minutes. These are not catastrophic events. They are the steady state.
The failure modes that matter for a credit person are the ones that do not look like failures. Silent data corruption (SDC) is the most expensive, where a faulty GPU produces wrong answers without crashing anything, which means a multi-day training run can complete normally and the resulting model weights are quietly poisoned. Cascading failures are the second category, where one bad GPU crashes a training job spread across thousands of others, costing days of compute. Then there are the routine ones: thermal throttle, ECC memory errors, NVLink flap, GPUs falling off the bus.
NVIDIA built NVSentinel because traditional monitoring detects these problems but rarely fixes them. Crusoe built AutoClusters because queue wait time is the largest controllable variable in cluster goodput. Without these tools, remediation timelines run hours to days.
The job of an operations team is to keep all of this in steady state. They know which racks run hot in summer, which cooling loops have been flaky since the last firmware update, which jobs to re-route when a node degrades but has not failed yet. None of that knowledge is written down. It lives in the team.
This is the asset that serves as collateral for tens of billions of dollars in debt and counting.
How the chips became the collateral
In the last eighteen months, AI infrastructure went from being financed by corporate debt, to being financed by the chips themselves.
The xAI Colossus 2 SPV is the cleanest example. The structure is roughly $7.5 billion in equity, with up to $2 billion of that contributed by NVIDIA itself, and $12.5 billion in debt. The special purpose vehicle (SPV) purchases NVIDIA GPUs and leases them to xAI on a five-year term. Apollo and Diameter sit on the debt tranche. Valor Equity Partners leads the equity. The debt is collateralized by the chips, not by xAI’s broader balance sheet.
Look at the pricing: xAI’s $5B round was priced at up to 12.5%. CoreWeave's GPU-backed deals priced at roughly 8.5% above the benchmark rate, before terms tightened as lenders got more comfortable with the structure.
If we assume here these are not unsophisticated lenders, then we have to assume they are charging what they think the risk costs. The premium is then, the price of guessing.
The scope is wider than one company. CoreWeave alone holds $18.8 billion in GPU-collateralized debt across multiple SPVs. FluidStack’s $50 billion deal with Anthropic uses a different wrapper, with Google providing a backstop on the lease payments, but the underlying logic is the same.
Every neocloud and most major AI labs are now financed this way.
[
What real collateral looks like
Every other major asset class that gets used as collateral at this scale has decades of price discovery infrastructure behind it. GPUs have almost none of it.
Aircraft have ISTAT-certified appraisers, a global registry, standardized maintenance logs, ferry pilots, and an active secondary market dating back to the 1970s. Ships have BICA. Cars have NADA. Class A office space has standardized cap rates and vacancy comps. Oil has had a forward curve since the early 1980s.
GPUs have Silicon Data’s H100 Rental Index on Bloomberg terminals, which launched in 2024, and Ornn AI, which raised $5.7 million in October 2025 to build the first regulated exchange for GPU compute derivatives. That is the entire price discovery infrastructure for an asset class now backing tens of billions of dollars in debt.
The price moves underneath all of this are wild. H100 hourly rental rates went from roughly $8 per hour in early 2024 to $1.70 by October 2025, then surged 40% back up to $2.35 by March 2026 on a wave of inference demand nobody had priced in. SemiAnalysis put it bluntly: lenders who used six-year depreciation schedules now look smarter than the analysts who chastised them for being too generous. They were guessing, and they happened to land closer to the right answer than the people calling them reckless. No aircraft lender or shipping lender would underwrite five-year debt against an asset whose price swings like that without a way to hedge it. _They would not be allowed to_.
CoreWeave’s GPU-backed loans price at roughly 8.5 percentage points above the benchmark rate. For comparison, a typical aircraft loan prices at 1 to 2 points above benchmark, and a commercial mortgage usually sits below that. The extra 6 to 7 points is what lenders charge to bear a risk they cannot measure. There is no GPU futures market, no standardized residual value curve, and no way to lock in a forward rental rate. The premium is is the price of underwriting in the dark.
Thanks for reading CipherTalk! This post is public so feel free to share it.
[
That spread should compress as the market matures. Hedging instruments will appear. Residual value curves will get more standardized. Secondary markets for used GPUs will deepen. When that happens, the cost of capital for AI infrastructure drops meaningfully, which changes who can build at scale. The companies that benefit are not the ones with the cheapest GPUs today. They are the ones positioned to access cheap debt once the financing infrastructure catches up to the asset class.
Six years, four years, or somewhere worse
The public fight over how fast GPUs depreciate is a tell about how confident the people writing the books actually are.
CoreWeave depreciates GPUs over six years. Nebius, with the same business model and the same hardware, depreciates the same chips over four. AWS, Microsoft, and Google all moved their server useful-life assumptions from three to four years up to six years in 2023, a change that reduced reported depreciation expense by roughly $18 billion annually across $300 billion of combined capex. CoreWeave made the same accounting change in January 2023, before going public, lowering reported expense by hundreds of millions of dollars per year.
NVIDIA announced in 2025 that it is moving from a two-year product cycle to a one-year cycle. The chips backing all of this debt are about to become previous-generation twice as fast.
[Michael Burry’s claim](https://www.cnbc.com/2025/11/11/big-short-investor-michael-burry-accuses-ai-hyperscalers-of-artificiall