Skip to content
Artwork for SemiAnalysis Weekly
BusinessExplicit

SemiAnalysis Weekly

Jordan Nanos, Doug O'Laughlin

Everything semiconductors and AI

Covering the spectrum

Play
  • 40 episodes
  • Avg 47 min
  • English
Counted on this page — what you have heard stays on this device, so it is not something the list can be paged by.
  • S1 · E44
    Thursday · 51 min

    Ep. 044 - Is NVIDIA Over? Emergency Pod with ChinaTalk | Dylan Patel, Jordan Nanos, Jordan Schneider (ChinaTalk)

    Emergency pod. Hours after NVIDIA announced that Jensen Huang has resigned as CEO, with CFO Colette Kress named interim CEO, Jordan Nanos (@JordanNanos) sits down with Dylan Patel (@dylan522p) and ChinaTalk's Jordan Schneider (@jordanschnyc). They get into why the MATCH Act matters more than RASA, how much compute China should be allowed to rent abroad, the smuggling cases around NVIDIA's supply chain, China's push onto domestic accelerators, whether NVIDIA can execute without its founder, and who should run it next. Then it goes off the rails. Read the article: https://newsletter.semianalysis.com/p/nvidia-and-the-world-without-jensen ChinaTalk: https://www.chinatalk.media 0:00 Jensen Is Out 2:04 MATCH Act vs RASA 5:06 Why Not Ban Everything 9:21 Will China Retaliate 15:54 The Smuggling Evidence 21:09 China's Domestic Chips 23:08 Flip the Table 29:03 Open Models and Talent 31:10 NVIDIA Without Jensen 41:46 Who Runs NVIDIA Next 45:48 Closing Thoughts 47:56 The Nationalization Debate The indictments discussed are allegations; defendants are presumed innocent. Opinions are the speakers' own. Not financial advice.

  • S1 · E43
    November 4 · 42 min

    Ep. 043 - The Midterms and the 2028 Datacenter Buildout (Datacenters) | Jeremie Eliahou Ontiveros, Jordan Nanos, Maya Barkin, Wayne Ma

    Recorded Election Day morning, before any results: SemiAnalysis’s model has about 62 GW of US datacenter additions in 2028, most not yet under construction and sitting in states electing a governor. Texas alone is close to 30%. Jordan Nanos (@JordanNanos) sits down with Maya Barkin (@mayabarkin), Wayne Ma (@waynema) and Jeremie Eliahou Ontiveros (@JeremieEO) on why 2027 is largely locked in, why the backlash crosses party lines, and how developers can win over their neighbors. Since recording: the AP called Texas for Gina Hinojosa, who would pause datacenter permitting, and Georgia for Keisha Lance Bottoms, and Democrats took a 3-2 majority on Georgia’s Public Service Commission, which sets power rates. (As of Nov 4, 2:35 PM ET.) Read the article: https://newsletter.semianalysis.com/p/the-datacenter-backlash-goes-bipartisan 0:00 Intro 0:54 The 2028 Buildout 5:32 Pause vs. Conditions 10:03 Bipartisan Backlash 14:37 Grid Risk 16:30 Tax Incentives 19:51 Texas 24:34 Risks to 2027 30:23 Georgia 32:31 Federal Outlook 35:20 Winning Over Neighbors 42:04 What We're Watching

  • S1 · E42
    November 3 · 51 min

    Ep. 042 - GDPx: The Benchmark for Frontier AI

    SemiAnalysis just launched GDPx, a benchmark built with 14 specialized data partners across 11 domains where frontier intelligence earns the highest returns. Even the best model scores just 12%. Jordan Nanos (@JordanNanos) sits down with Max Kan (@maxkan) and Andrew Megalaa (@AndrewMegalaa) to explain why most popular benchmarks are broken, the difference between difficult and unfair tasks, how a real private equity deal room became a finance environment, why binary grading still matters, and what the leaderboard says about Opus 5.5, GPT-6 Astra and Gemini 4 Carbon. Explore GDPx: https://gdpx.semianalysis.com Read the article: https://newsletter.semianalysis.com/p/gdpx-measuring-frontier-model-capabilities Want your model evaluated or to partner on a future version? gdpx@semianalysis.com 0:00 Cold Open 0:10 Launch Week Chaos 4:02 Broken Benchmarks 5:15 Difficult vs. Unfair 7:33 Building GDPx 9:25 Frontier Domains 11:02 The 11 Domains 14:12 Domain Experts 15:00 Models vs. Experts 19:36 Model Behavior 20:44 The Leaderboard 22:33 Cyber and Safety 24:32 Frontier vs. Day-to-Day 27:13 The Finance Task 31:27 Binary vs. Partial Grading 36:48 AI and Jobs 42:43 Quick Takes 43:44 Google's Comeback 47:25 Public vs. Private Tasks 49:52 What's Next

  • S1 · E41
    October 27 · 55 min

    Ep. 041 - EMERGENCY: Anthropic’s S-1 Is Here (Tokenomics/ Markets) | Doug O’Laughlin, Jeremie Eliahou Ontiveros, Joey Brookhart, Jordan Nanos

    Anthropic filed its S-1: revenue per dollar of compute is up 5.2x since Q1 2025, a customer who spent $1 last year now spends $9, and incremental gross margins are running near 90%. Jordan Nanos (@JordanNanos), Doug O'Laughlin (@fabknowledge), Jeremie Eliahou Ontiveros (@JeremieEO) and Joey Brookhart (@SaasquatchC) break down profitability, the half trillion in compute commitments, customer concentration, the 2027 compute roadmap, and whether OpenAI can keep up. 0:00 Cold Open 0:53 Profitability 2:10 The Datacenter View 4:14 Compute Commitments 6:28 Incremental Margins 8:19 Customer Concentration 12:00 Top Customers 16:53 New Funding 18:54 Underpromise, Overdeliver 20:25 Elon and Neoclouds 25:14 Compute Efficiency 29:40 Can Anyone Catch Up? 33:26 Surprises and Runway 37:47 Market Reaction 39:02 Holiday Usage 42:56 Is OpenAI Cooked? 48:44 Government Revenue 50:45 Wrap-Up

  • S1 · E40
    October 23 · 34 min

    Ep. 040 - ASML Is Building a Hybrid Bonding Tool, and Its Patents Show How (AI Supply Chain) | Jordan Nanos, Howie, Sherry Zhang

    Every hybrid bonder on the market today brings the die to the wafer. ASML's patents bring the wafer to the die.Sherry Zhang and Howie join Jordan Nanos (@jordananos) to dig into the patents behind ASML's die-to-wafer hybrid bonder, why a track-based design could beat Besi on alignment and particle control, and why HBM won't adopt die-to-wafer hybrid bonding before 2029. The team also looks at how China is using hybrid bonding to keep scaling past its lithography limits, and what larger photomasks mean for High-NA EUV.Chapters:0:00 The Patent Tip-Off1:53 Hybrid Bonding 1014:06 Die-to-Wafer vs Wafer-to-Wafer5:43 Back End vs Front End8:05 Why HBM Waits Until 202913:45 Everything Comes to the Die18:26 Alignment and Cleanliness22:48 Bonding Instead of Shrinking25:49 China's Toolmakers Step Up28:25 Bigger Masks for High-NA33:29 Two Tool Stacks?Read the full article: ASML Is Building a Hybrid Bonding Tool!https://newsletter.semianalysis.com/p/asml-is-building-a-hybrid-bonding

  • S1 · E39
    October 20 · 34 min

    Ep. 039 - [EMERGENCY] Our Numbers Are "Insane." Here's the Proof. (Datacenters) | Jeremie Ontiveros, Reyk Knuhtsen, Jordan Nanos

    Brad Gerstner put our 43 gigawatt forecast for 2027 on All-In, then again in his BG2 sit-down with Jensen, and called it too aggressive. The consensus counter sits near 25 GW, built on moratorium headlines and grid connection fears. Jordan Nanos (@JordanNanos) sits down with Jeremie Ontiveros (@JeremieEO) and Reyk Knuhtsen (@robotknower), who have been tracking the same capacity curve since March 2024, and it has barely moved across every model revision. So they aren't cutting it. They're raising it. Read the article: https://newsletter.semianalysis.com/p/datacenters-2027-the-year-of-acceleration 0:00 Cold Open 1:17 The 2027 Forecast Debate 2:21 Model Track Record 5:27 Where the Pushback Comes From 8:16 Delays and Haircuts 12:31 The Top 40 Sites 15:23 Leading Indicators 20:40 Modular Builds 25:41 Chips vs Datacenters 27:53 Responding to Brad Gerstner

  • S1 · E38
    October 14 · 44 min

    Ep. 038 - GLM 5.3 on AMD, NVIDIA, and Chinese Chips From Day One (InferenceX) | Kimbo Chen, Wenyao Gao, Jordan Nanos

    GLM 5.3 only attends to the tokens that matter. It still has to keep every one of them. Kimbo Chen (@kimbochen) and Wenyao Gao (@gao_wenyao) join Jordan Nanos (@JordanNanos) to dig into AMD catching NVIDIA on InferenceX, how post-training alone pushed an open-weight model within reach of Mythos, and whether Z.ai quietly tuned it for Chinese chips. The team also looks at how GLM 5.3 became a fallback when Claude and GPT refuse security work. Chapters: 0:00 Cold Open 0:37 Sparse Attention 101 4:46 HiCache and HiSparse 10:13 AMD Catches NVIDIA 12:54 Capacity vs Bandwidth 18:44 The Frankenstein Flash 20:09 Mythos-Class From China? 22:52 Post-Training Pipeline 32:32 Chinese Chips, Day One 39:54 GLM 5.4 and Beyond Read the full article: How GLM 5.3 Sparse Attention Affects HBM Memory Usage https://newsletter.semianalysis.com/p/sparse-savings-persistent-demand-inside-glm53

  • S1 · E37
    October 9 · 1 hr 23 min

    Ep. 037 - Who's Funding the $11 Trillion AI Buildout? (Capital Markets) | Dan Nishball, Jordan Nanos

    H100 rental prices went up, on a GPU that should be sliding down its depreciation curve. That curve is what lenders underwrite. Daniel Nishball (@dnishball) kicks off our new Compute Capital Markets group by following the money through Nvidia's $497B backstops, ClusterMAX as a credit signal, and whether each token is profitable. Jordan Nanos (@JordanNanos) brings the rental data. AI debt is about to pass auto loans. 0:00 Opening 1:48 Nvidia's Backstop Universe 6:22 The $11T Funding Wall 17:25 Balance Sheet as a Service 26:27 ClusterMAX as Credit Risk 31:51 Why H100 Prices Rose 43:09 Token Profitability 58:05 You Can't Go Back 1:07:25 AI Debt vs Auto Loans 1:11:14 Inside Nvidia's Backstops

  • S1 · E36
    October 7 · 50 min

    Ep. 036 - $200 Buys $12,000 of Opus Tokens, We Bought Every Plan (AI Cloud TCO) | Max Kan, Jordan Nanos, Andrew Megalaa

    Pay Anthropic $200 a month and you can pull $12,000 of Opus 5.5 tokens at API pricing. Max Kan (@maxkan) and Andrew Megalaa bought every plan, OpenAI, Meta, xAI, MiniMax, Moonshot, Z.ai, Cursor, and measured every token type to find the ceiling. The catch isn't subsidy. Anthropic still books 50 to 60% gross margins on these plans, which means the API itself is the price gouge. 0:00 Cold Open 1:03 Subsidies and Credits 5:23 Token Types and Cache 14:08 Model Value Charts 20:51 Test Methodology 26:54 Other Plans 31:26 Utilization and Limits 36:24 Token Efficiency 41:24 Open Models 44:22 Cyber and Capture Read More: https://newsletter.semianalysis.com/p/anthropic-subscriptions-offer-5x

  • October 5 · 34 min

    Ep. 035 - Tech DD’s, Performance Projections, Benchmarks, Supply Chain, Investment Thesis (Consulting)| Abhilash Jain, Jordan Nanos

    Jordan (@JordanNanos) and Abhilash (@AbhilashJain17) discuss the clients SemiAnalysis consulting serves, custom projects like the inference simulator, how client work turns into research products, neocloud due diligence, and why SLAs decide who gets funded. They also discuss Feynman specs, de-specced memory, and a 20-trillion-parameter OpenAI model. 0:00 Intro and Overview 2:27 Client Types 5:24 Custom Projects 9:47 Strategy Work 12:27 Consulting to Products 14:33 Neocloud Due Diligence 18:40 SLAs and Insurance 22:32 Risk Assessments 26:45 Build vs Buy 29:19 Favorites and Outlook

  • S1 · E34
    October 2 · 1 hr 3 min

    Ep. 034 - Engrams: How DeepSeek Offloads KV Cache to DRAM and SSD (Core Research) | Jordan Nanos, Cam Quilici, Alec Ibarra, Bryan Shan

    The InferenceX team is back after two months. Jordan Nanos (@JordanNanos) is joined by Cam Quilici (@noslawextratost), Bryan Shan, and Alec Ibarra to discuss Engram and DRAM offloading, the AgentX benchmark and its profit calculator, TPU v7 on InferenceX, Vera Rubin vs Blackwell, fast tokens, and TileRT on NVIDIA GPUs. 0:00 Intro 0:31 Engrams 12:27 AgentX Benchmark 16:36 Profit Calculator 23:40 TPU v7 32:03 Vera Rubin 40:49 Fast Tokens 49:33 TileRT 54:00 Chip Startups 1:01:31 Wrap Up

  • S1 · E33
    September 23 · 1 hr 8 min

    Ep. 033 - ClusterMAX 3.0 Is Here! Neoclouds Ranked (Neoclouds, GPUs) | Sam Harshe, Pratt Bhatt, Jordan Nanos

    ClusterMAX 3.0 is here. Sam Harshe (@sharshe02) and Pratt Bhatt (@PrathmeshBhat19) join Jordan Nanos (@jordannanos) after months of testing 77 GPU clouds. Some moved up, some moved down. Health checks, cache hit rates, NCCL recipes, agentic coding on clusters, a Linux kernel bug, neocloud security, SLAs and financing, NVIDIA's backstops, five-year-old H100s, and hosted RL training. Read the full ClusterMAX 3.0 report: https://newsletter.semianalysis.com/p/clustermax-30-the-industry-standard ClusterMAX inquiries: clustermax@semianalysis.com 0:00 Cold Open 1:32 The Rankings 6:58 Health Checks 13:26 Endpoint Cache Misses 16:40 Networking and NCCL 22:52 Vibe-Coded Infra 31:27 Bug Hunting 38:36 Security 45:43 Financing Neoclouds 56:33 Hosted Training and RL

  • S1 · E33
    September 18 · 53 min

    Ep. 032 - 300 Datacenter Bans, 3 Projects Delayed: Moratoriums Explained (Datacenter, Energy) | Maya Barkin, Reyk Knühtsen, Jordan Nanos

    More than 300 towns, cities, and counties have voted to pause data centers in the past 18 months. Maya Barkin (@mayabarkin) and Reyk Knühtsen (@robotknower) from the SemiAnalysis Data Center, Energy, and Industrials team join Jordan Nanos (@jordannanos) to explain what a moratorium actually is, how they mapped every one of them against the US project pipeline, and why only three projects are being delayed. Plus: the SpaceX de-annexation in Brownsville, New York vs Texas, why politicians love a moratorium, and the surprising amount of alpha in anti-data center Facebook groups. Jeremie Eliahou Ontiveros (@JeremieEO) drops in from Bangkok. Read More: https://newsletter.semianalysis.com/p/everyone-says-datacenter-moratoriums 0:00 Intro 0:36 What Is a Moratorium 4:34 300 Moratoriums, 3 Projects 10:18 Behind the Meter Wins 14:04 Eight Conditions to Delay 17:06 The SpaceX De-Annexation 20:03 Cheap Political Signaling 32:03 New York vs Texas 41:14 City Council Alpha 46:32 Advice for Developers

  • S1 · E31
    September 16 · 1 hr 2 min

    Ep. 031 - EMERGENCY EPISODE: Are We Doomed? | Jordan Nanos, Doug O'Laughlin, Max Kan, Joey Brookhart

    Emergency episode. Doug O'Laughlin (@Fabknowledge) , Joey Brookhart (@SaasquatchC), and Max Kan (@maxkan) join Jordan (@JordanNanos) to talk through Dario's "We Must Pace the Frontier" blog and the responses from Sam Altman and David Sacks. Does pacing actually mean less compute, or a lot more? Plus the Hugging Face incident, Moonshot serving Claude, and the security behaviour that keeps them up at night. 0:00 Cold Open 2:50 Glorified Neoclouds 8:21 Pacing the Frontier 12:53 Safety Eats Compute 20:38 Hugging Face Lessons 30:52 Moonshot Serving Claude 36:37 The Coxson Resignation 38:27 Two-Year Predictions 49:19 Regulation Under Trump 57:21 Hotter or Cooler

  • S1 · E30
    September 14 · 38 min

    Ep. 030 - Long Live the Short King: Why 4-HI HBM Wins (Memory) | Myron Xie, Jordan Nanos

    NVIDIA previewed Rubin Ultra at 1TB of HBM per package. The part that ships will carry 192GB. Myron Xie and Jordan Nanos get into how the design fell that far, why the reason is supply and not performance, and why shipping less memory per chip might be the right call anyway. For the first time in recent memory, NVIDIA's next flagship will have less capacity than the one it replaces. Read More: https://newsletter.semianalysis.com/p/long-live-the-short-king-why-4-hi

  • S1 · E29
    September 11 · 46 min

    Ep. 029 - Modular Data Centers Cut Build Time to 12 Months (Datacenter, Energy) | Nico Bontigui, Jordan Nanos, Nigel Chiang, Eric Wen

    Traditional data center builds ran 18 to 24 months, sometimes past three years. Modular construction cuts that to 12. Jordan Nanos (@JordanNanos) sits down with Eric Wen, Nigel Chiang, and Nico Bontigui to map what modular actually means, from MEP heavy skids to full containerized builds. They break down why the bottleneck moved from construction time to labor, why welders and electricians are the real constraint in Abilene, and how time to power translates directly into tokens at 40 to 100 million dollars per megawatt. Subscribe for weekly SemiAnalysis coverage on data center construction, prefabrication, and AI infrastructure. 0:00 Cold Open 1:09 What Is Modular 4:03 Why Go Modular 5:55 Time to Power Math 9:04 Labor Wage Data 13:51 Two Kinds of Bottlenecks 18:24 Site, Shell, System 22:31 Who Owns the Risk 26:59 Trucks and Insurance 30:53 Who Supplies the Modules 35:50 Commissioning Reality 41:39 Vendor Map and Wrap Read More: The Wild Wild West Of LEGO Datacenters: https://newsletter.semianalysis.com/p/the-wild-wild-west-of-lego-datacenters

  • S1 · E28
    September 2 · 50 min

    Ep. 028 - Most Neoclouds Suck At Security: How Agents Hacked Hugging Face (Neoclouds, Security) | Doug O'Laughlin, Sam Harshe, Jordan Nanos

    This week Doug, Sam and Jordan discuss the OpenAI vs HuggingFace security incident and our recent article on Neocloud security ahead of ClusterMAX 3.0 Full article: https://newsletter.semianalysis.com/p/most-neoclouds-suck-at-security 0:00 Cold Open 0:57 Neocloud Security 4:38 The Hugging Face Hack 11:47 Agent Swarm Behavior 14:47 Obliterated Models 20:37 Security as a Service 24:30 What the Data Shows 33:08 Attacker Asymmetry 40:55 Nothing Ever Happens 45:22 CMAX Audit

  • August 30 · 1 hr 3 min

    Ep. 027 - OpenAI Jalapeño: Better Than Nvidia Blackwell (Accelerators)

    This week Bryan, Myron and Jordan discuss our recent article on OpenAI Jalapeño. They cover the performance, architecture, programming model, implications for NVIDIA and more.1:05 Jalapeno Overview4:22 Tokens Per Megawatt9:15 Benchmark Caveats13:48 The CUDA Moat21:12 How OpenAI Did It32:13 Samsung HBM442:10 AI-Designed Silicon49:24 Architecture Deep Dive56:58 Doom and Wrap Full Article: ⁠https://newsletter.semianalysis.com/p/openai-jalapeno-better-than-nvidia

  • S1 · E26
    August 20 · 43 min

    Ep. 026 - PJM's $12B Modeling Mistake Is Hitting Ratepayers Again (Datacenter, Energy) | Robert Boswall, Jordan Nanos

    PJM overpaid $12 billion across two capacity auctions, and the same modeling error is set to repeat in an upcoming emergency auction. Robert Boswall (@RobertBoswall) and Jordan Nanos (@JordanNanos) break down how the largest grid in America, 13 states and 66 million people, inflates demand while constraining supply. The result is scarcity pricing that ratepayers absorb, not the data centers driving the narrative. Of the $63 billion spent across four auctions, Boswell estimates $12 billion was avoidable, split $7 billion and $5 billion across the 2025-26 and 2026-27 auctions. This is the mechanics behind every headline blaming AI for rising power bills. Subscribe for weekly analysis on grid design, capacity markets, and AI energy demand! 0:00 Cold Open1:33 What Is PJM3:13 Capacity Auctions7:39 The $12 Billion12:33 How Plants Get Paid15:15 The Winterization Gap21:17 Data Center Demand26:41 The Emergency Auction30:00 Board Overrules Members40:32 Turning It Around Article: https://open.substack.com/pub/semianalysis/p/12b-of-us-ratepayers-money-wasted

  • S1 · E25
    August 17 · 38 min

    Ep. 25 - DYLAN IS HERE, LIVE! | Dylan Patel & Jordan Nanos

    Dylan joins the pod today, recorded live from our SF office. Jordan and Dylan discuss SemiAnalysis's AI spend, the model that escaped during training, AI rollups eating private equity, new accelerators vs NVIDIA, and whether the pod gives away too much information for free.0:00 Cold Open5:25 SA AI Spend9:29 AI Performance Reviews10:40 AI Rollups13:47 The Agent Moment15:28 The Escaped Model18:11 Model Exponential22:52 Compute and Chips30:18 Open Models32:00 ADHD and AI

Showing 1–20 of 40 episodes