# Not All GPU's Are Deployed The Same

Oliver Kennon · AI Engineer NYC 2026 · October 14

[Watch recording](https://www.youtube.com/watch?v=jiUC6IUMdvc&t=8700s)

[02:25:00](https://www.youtube.com/watch?v=jiUC6IUMdvc&t=8700s) Not all GPUs are deployed the same.

[02:25:03](https://www.youtube.com/watch?v=jiUC6IUMdvc&t=8703s) Thank you everyone for taking the time to be here today.

[02:25:06](https://www.youtube.com/watch?v=jiUC6IUMdvc&t=8706s) My name is Oliver Kennon.

[02:25:07](https://www.youtube.com/watch?v=jiUC6IUMdvc&t=8707s) I'm a research analyst at SemiAnalysis.

[02:25:11](https://www.youtube.com/watch?v=jiUC6IUMdvc&t=8711s) Time and attention are the most valuable things any of us have, unless of course you're an

[02:25:15](https://www.youtube.com/watch?v=jiUC6IUMdvc&t=8715s) early stage investor in open AI or Anthropic.

[02:25:19](https://www.youtube.com/watch?v=jiUC6IUMdvc&t=8719s) With that, let's get into it.

[02:25:21](https://www.youtube.com/watch?v=jiUC6IUMdvc&t=8721s) Not all GPUs are deployed the same.

[02:25:23](https://www.youtube.com/watch?v=jiUC6IUMdvc&t=8723s) A GPU falls to the level of the operator.

[02:25:27](https://www.youtube.com/watch?v=jiUC6IUMdvc&t=8727s) hardware gives you potential.

[02:25:30](https://www.youtube.com/watch?v=jiUC6IUMdvc&t=8730s) capability is what determines how much useful work you actually are able to

[02:25:34](https://www.youtube.com/watch?v=jiUC6IUMdvc&t=8734s) deliver.

[02:25:34](https://www.youtube.com/watch?v=jiUC6IUMdvc&t=8734s) That leads us to the question I will attempt to answer with all of you today.

[02:25:38](https://www.youtube.com/watch?v=jiUC6IUMdvc&t=8738s) Who can produce the intelligence you need at the lowest cost?

[02:25:42](https://www.youtube.com/watch?v=jiUC6IUMdvc&t=8742s) Cost matters.

[02:25:44](https://www.youtube.com/watch?v=jiUC6IUMdvc&t=8744s) today's presentation, I want to show you guys why and how operating capability changes

[02:25:50](https://www.youtube.com/watch?v=jiUC6IUMdvc&t=8750s) that cost and why it matters in the commodity market that is compute.

[02:25:56](https://www.youtube.com/watch?v=jiUC6IUMdvc&t=8756s) matters in a commodity market?

[02:25:58](https://www.youtube.com/watch?v=jiUC6IUMdvc&t=8758s) A lot of tech investors or technologists may not be familiar with this framework, so a

[02:26:04](https://www.youtube.com/watch?v=jiUC6IUMdvc&t=8764s) little crash course.

[02:26:05](https://www.youtube.com/watch?v=jiUC6IUMdvc&t=8765s) In a commodity market, producers compete to deliver comparable output.

[02:26:09](https://www.youtube.com/watch?v=jiUC6IUMdvc&t=8769s) A lower production cost gives more room to compete when prices fall.

[02:26:15](https://www.youtube.com/watch?v=jiUC6IUMdvc&t=8775s) what a cost curve shows.

[02:26:16](https://www.youtube.com/watch?v=jiUC6IUMdvc&t=8776s) producers lined up by what they spend to deliver the same usable work.

[02:26:20](https://www.youtube.com/watch?v=jiUC6IUMdvc&t=8780s) If two producers earn the same price,

[02:26:24](https://www.youtube.com/watch?v=jiUC6IUMdvc&t=8784s) the one spending less to deliver the work gets to keep more of it.

[02:26:27](https://www.youtube.com/watch?v=jiUC6IUMdvc&t=8787s) Pretty simple, right?

[02:26:30](https://www.youtube.com/watch?v=jiUC6IUMdvc&t=8790s) For us, intelligence is the economic output we care about.

[02:26:34](https://www.youtube.com/watch?v=jiUC6IUMdvc&t=8794s) Eventually, our North Star metric will be price per successfully completed task

[02:26:39](https://www.youtube.com/watch?v=jiUC6IUMdvc&t=8799s) at the required quality.

[02:26:40](https://www.youtube.com/watch?v=jiUC6IUMdvc&t=8800s) Unfortunately, we're not quite there yet.

[02:26:42](https://www.youtube.com/watch?v=jiUC6IUMdvc&t=8802s) That's a pretty hard thing to standardize.

[02:26:45](https://www.youtube.com/watch?v=jiUC6IUMdvc&t=8805s) today price per token is a useful practical proxy especially for comparable workloads

[02:26:51](https://www.youtube.com/watch?v=jiUC6IUMdvc&t=8811s) and quality requirements and gets us closer to delivered output much closer than the often quoted

[02:26:57](https://www.youtube.com/watch?v=jiUC6IUMdvc&t=8817s) all you finance bros out here will have heard this a gpu dollar per hour price or as we view it a cost

[02:27:08](https://www.youtube.com/watch?v=jiUC6IUMdvc&t=8828s) We view GPU hours as a measure of input, not output, the cost versus price distinction.

[02:27:15](https://www.youtube.com/watch?v=jiUC6IUMdvc&t=8835s) prices are different from the producer's cost of doing the work.

[02:27:22](https://www.youtube.com/watch?v=jiUC6IUMdvc&t=8842s) GPU hours are the input, intelligence is the output.

[02:27:26](https://www.youtube.com/watch?v=jiUC6IUMdvc&t=8846s) On this slide we can visualize the inputs needed to create useful intelligence.

[02:27:31](https://www.youtube.com/watch?v=jiUC6IUMdvc&t=8851s) We start with hardware and electricity, GPUs, for this presentation.

[02:27:36](https://www.youtube.com/watch?v=jiUC6IUMdvc&t=8856s) Software and operations can be thought of as a multiplier on those first two inputs,

[02:27:41](https://www.youtube.com/watch?v=jiUC6IUMdvc&t=8861s) with the end product being useful intelligence.

[02:27:47](https://www.youtube.com/watch?v=jiUC6IUMdvc&t=8867s) The operator is who chooses and implements the software that serves the model

[02:27:50](https://www.youtube.com/watch?v=jiUC6IUMdvc&t=8870s) and keeps requests moving through the system.

[02:27:54](https://www.youtube.com/watch?v=jiUC6IUMdvc&t=8874s) The machines might be available, but you still need someone to make them deliver responses

[02:27:58](https://www.youtube.com/watch?v=jiUC6IUMdvc&t=8878s) customers can actually use.

[02:28:01](https://www.youtube.com/watch?v=jiUC6IUMdvc&t=8881s) What matters is how much useful work you get and whether it meets your requirements for

[02:28:05](https://www.youtube.com/watch?v=jiUC6IUMdvc&t=8885s) the specified task.

[02:28:07](https://www.youtube.com/watch?v=jiUC6IUMdvc&t=8887s) The conversion can differ with the same kind of chip.

[02:28:11](https://www.youtube.com/watch?v=jiUC6IUMdvc&t=8891s) Let's look at that in the measured example.

[02:28:14](https://www.youtube.com/watch?v=jiUC6IUMdvc&t=8894s) Here's a concrete example from our public inference X calculator.

[02:28:19](https://www.youtube.com/watch?v=jiUC6IUMdvc&t=8899s) You guys can all check it out, semianalysis.com.

[02:28:23](https://www.youtube.com/watch?v=jiUC6IUMdvc&t=8903s) Both estimates use B200 GPUs serving the same model with roughly 8,000 input tokens and

[02:28:30](https://www.youtube.com/watch?v=jiUC6IUMdvc&t=8910s) 1,000 output tokens, a pretty standard ratio.

[02:28:33](https://www.youtube.com/watch?v=jiUC6IUMdvc&t=8913s) P50 target is 100 output tokens per second for each user.

[02:28:37](https://www.youtube.com/watch?v=jiUC6IUMdvc&t=8917s) The serving stack is the software handling the model's responses.

[02:28:41](https://www.youtube.com/watch?v=jiUC6IUMdvc&t=8921s) In the P90 scenario, one of these stacks gives about 200 generated output tokens per second

[02:28:47](https://www.youtube.com/watch?v=jiUC6IUMdvc&t=8927s) while the other one gives about 300.

[02:28:50](https://www.youtube.com/watch?v=jiUC6IUMdvc&t=8930s) That's a big difference and comes down to software, settings, and number of requests running.

[02:28:56](https://www.youtube.com/watch?v=jiUC6IUMdvc&t=8936s) All choices made by the operator.

[02:29:02](https://www.youtube.com/watch?v=jiUC6IUMdvc&t=8942s) Same chip, same target interactivity, about 50% more output.

[02:29:07](https://www.youtube.com/watch?v=jiUC6IUMdvc&t=8947s) That's a lot.

[02:29:08](https://www.youtube.com/watch?v=jiUC6IUMdvc&t=8948s) So what does that mean for the buyer's bill?

[02:29:14](https://www.youtube.com/watch?v=jiUC6IUMdvc&t=8954s) What does that intelligence actually cost the customer?

[02:29:17](https://www.youtube.com/watch?v=jiUC6IUMdvc&t=8957s) For this example, let's assume the hourly bill is the same for both deployments and

[02:29:22](https://www.youtube.com/watch?v=jiUC6IUMdvc&t=8962s) both meet your requirements.

[02:29:24](https://www.youtube.com/watch?v=jiUC6IUMdvc&t=8964s) At roughly one and a half times the output, your rental spend per acceptable token is

[02:29:28](https://www.youtube.com/watch?v=jiUC6IUMdvc&t=8968s) proportionally lower.

[02:29:30](https://www.youtube.com/watch?v=jiUC6IUMdvc&t=8970s) That is to say, the hour buys you more usable and useful output.

[02:29:37](https://www.youtube.com/watch?v=jiUC6IUMdvc&t=8977s) counts as useful intelligence?

[02:29:40](https://www.youtube.com/watch?v=jiUC6IUMdvc&t=8980s) intelligence has to do the job you hired it to do.

[02:29:42](https://www.youtube.com/watch?v=jiUC6IUMdvc&t=8982s) Pretty simple, right?

[02:29:43](https://www.youtube.com/watch?v=jiUC6IUMdvc&t=8983s) it, the answer needs to be good enough for the task, arrive quickly enough, and be available

[02:29:49](https://www.youtube.com/watch?v=jiUC6IUMdvc&t=8989s) when you need it. Your information also needs to stay within the access boundaries you've

[02:29:53](https://www.youtube.com/watch?v=jiUC6IUMdvc&t=8993s) agreed upon, aka it needs to be secure. This is an overlooked requirement that is not

[02:30:00](https://www.youtube.com/watch?v=jiUC6IUMdvc&t=9000s) captured in a chip's performance metrics, but it is essential for a chip to be usable and useful. In our published security work, we found monitoring access that exposed another customer's logs and metrics. This is a case, and an unfortunately common one at that, where the GPs were fast, in the case I'm referencing really, really fast, which makes the whole thing sadder, and the service still failed horrific.

[02:30:25](https://www.youtube.com/watch?v=jiUC6IUMdvc&t=9025s) Basically, ensuring cluster security takes ongoing work just as delivering the promised

[02:30:30](https://www.youtube.com/watch?v=jiUC6IUMdvc&t=9030s) performance does.

[02:30:34](https://www.youtube.com/watch?v=jiUC6IUMdvc&t=9034s) most cases, it is the operator that owns that responsibility.

[02:30:39](https://www.youtube.com/watch?v=jiUC6IUMdvc&t=9039s) Someone has to make the system work in production.

[02:30:42](https://www.youtube.com/watch?v=jiUC6IUMdvc&t=9042s) Suppose a faster serving update becomes available.

[02:30:45](https://www.youtube.com/watch?v=jiUC6IUMdvc&t=9045s) Someone has to test it on the customer's workload, check whether the output still meets the requirements,

[02:30:50](https://www.youtube.com/watch?v=jiUC6IUMdvc&t=9050s) and then decide when, where, and how to deploy it.

[02:30:54](https://www.youtube.com/watch?v=jiUC6IUMdvc&t=9054s) That means checking the actual responses,

[02:30:57](https://www.youtube.com/watch?v=jiUC6IUMdvc&t=9057s) testing it under load,

[02:30:58](https://www.youtube.com/watch?v=jiUC6IUMdvc&t=9058s) and keeping a way to return to previous version

[02:31:01](https://www.youtube.com/watch?v=jiUC6IUMdvc&t=9061s) if the update causes problems once it's deployed.

[02:31:05](https://www.youtube.com/watch?v=jiUC6IUMdvc&t=9065s) Once it is deployed, someone has to maintain it

[02:31:07](https://www.youtube.com/watch?v=jiUC6IUMdvc&t=9067s) and respond when issues come up.

[02:31:11](https://www.youtube.com/watch?v=jiUC6IUMdvc&t=9071s) That work may sit with your provider,

[02:31:14](https://www.youtube.com/watch?v=jiUC6IUMdvc&t=9074s) your own team, or both.

[02:31:17](https://www.youtube.com/watch?v=jiUC6IUMdvc&t=9077s) Irregardless, you need to know who's responsible

[02:31:19](https://www.youtube.com/watch?v=jiUC6IUMdvc&t=9079s) and whether they can actually do it.

[02:31:24](https://www.youtube.com/watch?v=jiUC6IUMdvc&t=9084s) So how do we assess the operator?

[02:31:27](https://www.youtube.com/watch?v=jiUC6IUMdvc&t=9087s) Semi-analysis cluster max, we're on version 3.0 at this point, assesses operating capability

[02:31:32](https://www.youtube.com/watch?v=jiUC6IUMdvc&t=9092s) on managed GPU clusters, a couple hundred growing.

[02:31:38](https://www.youtube.com/watch?v=jiUC6IUMdvc&t=9098s) Please reach out if you want to be on cluster max 4.0.

[02:31:40](https://www.youtube.com/watch?v=jiUC6IUMdvc&t=9100s) We look at provisioning, reliability, monitoring, and security.

[02:31:44](https://www.youtube.com/watch?v=jiUC6IUMdvc&t=9104s) hands-on testing, documentation, and customer feedback help us understand how the service

[02:31:50](https://www.youtube.com/watch?v=jiUC6IUMdvc&t=9110s) runs, not just on a good day, but also when a machine fails.

[02:31:56](https://www.youtube.com/watch?v=jiUC6IUMdvc&t=9116s) I want to take the chance to reiterate that cluster max ratings apply to managed clusters,

[02:32:02](https://www.youtube.com/watch?v=jiUC6IUMdvc&t=9122s) different from bare metal, very different.

[02:32:05](https://www.youtube.com/watch?v=jiUC6IUMdvc&t=9125s) With bare metal, more operating work usually sits with the customer.

[02:32:08](https://www.youtube.com/watch?v=jiUC6IUMdvc&t=9128s) Applying a managed service rating there does not automatically cover every product a provider

[02:32:13](https://www.youtube.com/watch?v=jiUC6IUMdvc&t=9133s) cells. The tiers are relative to peers. A little bit of a tongue twister. I nailed it.

[02:32:21](https://www.youtube.com/watch?v=jiUC6IUMdvc&t=9141s) And pricing and availability are also important factors in this assessment. These are metrics

[02:32:27](https://www.youtube.com/watch?v=jiUC6IUMdvc&t=9147s) that do not directly measure token output but are incredibly important. Assessment helps

[02:32:36](https://www.youtube.com/watch?v=jiUC6IUMdvc&t=9156s) us understand who can deliver. Now we can move on to the next question. What does

[02:32:40](https://www.youtube.com/watch?v=jiUC6IUMdvc&t=9160s) It's not actually cost to produce useful intelligence.

[02:32:42](https://www.youtube.com/watch?v=jiUC6IUMdvc&t=9162s) Let's start with a compute bill and other costs that producers still have to cover.

[02:32:49](https://www.youtube.com/watch?v=jiUC6IUMdvc&t=9169s) price and production costs are different.

[02:32:51](https://www.youtube.com/watch?v=jiUC6IUMdvc&t=9171s) In our example, the GPU provider rents out hours, the inference producer buys those hours

[02:32:58](https://www.youtube.com/watch?v=jiUC6IUMdvc&t=9178s) and sells responses.

[02:33:00](https://www.youtube.com/watch?v=jiUC6IUMdvc&t=9180s) rental bill is revenue to the provider and an input cost to the inference producer.

[02:33:04](https://www.youtube.com/watch?v=jiUC6IUMdvc&t=9184s) The GPU owner pays for the equipment, power, space and support.

[02:33:09](https://www.youtube.com/watch?v=jiUC6IUMdvc&t=9189s) inference producer's full cost includes rent,

[02:33:11](https://www.youtube.com/watch?v=jiUC6IUMdvc&t=9191s) plus whatever software, staff, and other services it pays for beyond that rental.

[02:33:16](https://www.youtube.com/watch?v=jiUC6IUMdvc&t=9196s) If the inference producer owns its equipment instead,

[02:33:19](https://www.youtube.com/watch?v=jiUC6IUMdvc&t=9199s) we spread the equipment investment over its working life and add running costs.

[02:33:23](https://www.youtube.com/watch?v=jiUC6IUMdvc&t=9203s) What the producer charges and what it spends are separate numbers.

[02:33:27](https://www.youtube.com/watch?v=jiUC6IUMdvc&t=9207s) To understand the cost of useful intelligence,

[02:33:29](https://www.youtube.com/watch?v=jiUC6IUMdvc&t=9209s) we need to know how much useful work the spending actually produces.

[02:33:33](https://www.youtube.com/watch?v=jiUC6IUMdvc&t=9213s) Better operations lowers that cost of useful intelligence.

[02:33:37](https://www.youtube.com/watch?v=jiUC6IUMdvc&t=9217s) The B200 comparison showed why the amount of output matters.

[02:33:41](https://www.youtube.com/watch?v=jiUC6IUMdvc&t=9221s) More acceptable responses from the same paid hours

[02:33:44](https://www.youtube.com/watch?v=jiUC6IUMdvc&t=9224s) can spread the inference producer's rental expense over more useful work.

[02:33:48](https://www.youtube.com/watch?v=jiUC6IUMdvc&t=9228s) For a producer that owns its GPUs,

[02:33:50](https://www.youtube.com/watch?v=jiUC6IUMdvc&t=9230s) the same logic spreads the equipment investment and running costs over more output.

[02:33:55](https://www.youtube.com/watch?v=jiUC6IUMdvc&t=9235s) Count all the spending needed to deliver the service over the same period,

[02:33:58](https://www.youtube.com/watch?v=jiUC6IUMdvc&t=9238s) then divide by the output customers can actually use.

[02:34:03](https://www.youtube.com/watch?v=jiUC6IUMdvc&t=9243s) That gives us cost for acceptable token for a comparable workload.

[02:34:11](https://www.youtube.com/watch?v=jiUC6IUMdvc&t=9251s) operations also require investment.

[02:34:14](https://www.youtube.com/watch?v=jiUC6IUMdvc&t=9254s) and update, deploying it safely, and keeping it working take people and money.

[02:34:21](https://www.youtube.com/watch?v=jiUC6IUMdvc&t=9261s) extra output has to justify the extra spending.

[02:34:25](https://www.youtube.com/watch?v=jiUC6IUMdvc&t=9265s) advantage can persist when a team repeats that work as software and workloads change.

[02:34:30](https://www.youtube.com/watch?v=jiUC6IUMdvc&t=9270s) But one good benchmark doesn't establish it.

[02:34:33](https://www.youtube.com/watch?v=jiUC6IUMdvc&t=9273s) You have to earn it every single day.

[02:34:36](https://www.youtube.com/watch?v=jiUC6IUMdvc&t=9276s) Each new workload still needs checking, but a repeatable operating process, from what

[02:34:41](https://www.youtube.com/watch?v=jiUC6IUMdvc&t=9281s) we've observed, can support a lasting cost advantage and a price advantage, too.

[02:34:47](https://www.youtube.com/watch?v=jiUC6IUMdvc&t=9287s) Even if you do keep improving, though, your competitors are not sitting still.

[02:34:53](https://www.youtube.com/watch?v=jiUC6IUMdvc&t=9293s) position on the cost curve is relative.

[02:34:55](https://www.youtube.com/watch?v=jiUC6IUMdvc&t=9295s) This slide, out of all the slides, should make clear the importance of the commodity

[02:35:00](https://www.youtube.com/watch?v=jiUC6IUMdvc&t=9300s) framework in all of this.

[02:35:01](https://www.youtube.com/watch?v=jiUC6IUMdvc&t=9301s) Your position on the cost curve depends on what your competitors can deliver, not just

[02:35:05](https://www.youtube.com/watch?v=jiUC6IUMdvc&t=9305s) yourself.

[02:35:06](https://www.youtube.com/watch?v=jiUC6IUMdvc&t=9306s) It's a relative measure.

[02:35:08](https://www.youtube.com/watch?v=jiUC6IUMdvc&t=9308s) Here's a simple hypothetical.

[02:35:09](https://www.youtube.com/watch?v=jiUC6IUMdvc&t=9309s) We're comparing the same task, the same required quality, using made-up cost units.

[02:35:15](https://www.youtube.com/watch?v=jiUC6IUMdvc&t=9315s) I like to imagine bars of gold.

[02:35:17](https://www.youtube.com/watch?v=jiUC6IUMdvc&t=9317s) Your full cost per successful task falls from 10 to 8.

[02:35:22](https://www.youtube.com/watch?v=jiUC6IUMdvc&t=9322s) In the same period, your competitors fall from 6 to 12.

[02:35:28](https://www.youtube.com/watch?v=jiUC6IUMdvc&t=9328s) improved.

[02:35:29](https://www.youtube.com/watch?v=jiUC6IUMdvc&t=9329s) That's awesome.

[02:35:30](https://www.youtube.com/watch?v=jiUC6IUMdvc&t=9330s) But both of you did.

[02:35:31](https://www.youtube.com/watch?v=jiUC6IUMdvc&t=9331s) And in this example, you started as the cheaper producer and ended as the more expensive one.

[02:35:36](https://www.youtube.com/watch?v=jiUC6IUMdvc&t=9336s) That gives the competitor more room to lower its selling price, provided customers find

[02:35:41](https://www.youtube.com/watch?v=jiUC6IUMdvc&t=9341s) the two services equally acceptable.

[02:35:44](https://www.youtube.com/watch?v=jiUC6IUMdvc&t=9344s) Getting better does not automatically move you ahead.

[02:35:47](https://www.youtube.com/watch?v=jiUC6IUMdvc&t=9347s) Instead, applying the commodity framework makes you realize that you have to compare

[02:35:50](https://www.youtube.com/watch?v=jiUC6IUMdvc&t=9350s) your cost per useful work on a relative basis, comparing your own product with what your

[02:35:56](https://www.youtube.com/watch?v=jiUC6IUMdvc&t=9356s) competitors can deliver.

[02:35:58](https://www.youtube.com/watch?v=jiUC6IUMdvc&t=9358s) That comparison can be easy to overlook in moments like today where demand far outstrips

[02:36:03](https://www.youtube.com/watch?v=jiUC6IUMdvc&t=9363s) supply and will for the foreseeable future.

[02:36:07](https://www.youtube.com/watch?v=jiUC6IUMdvc&t=9367s) to three years.

[02:36:09](https://www.youtube.com/watch?v=jiUC6IUMdvc&t=9369s) Visibility, good.

[02:36:13](https://www.youtube.com/watch?v=jiUC6IUMdvc&t=9373s) can obscure those differences.

[02:36:14](https://www.youtube.com/watch?v=jiUC6IUMdvc&t=9374s) When demand is strong and supply is constrained, producers with very different costs can find customers.

[02:36:21](https://www.youtube.com/watch?v=jiUC6IUMdvc&t=9381s) Strong revenue can make those differences feel less urgent.

[02:36:24](https://www.youtube.com/watch?v=jiUC6IUMdvc&t=9384s) If you're a CEO, why would you focus on your precious time and energy and money,

[02:36:28](https://www.youtube.com/watch?v=jiUC6IUMdvc&t=9388s) shoring up your spot on the cost curve when you can be building a massive new data center?

[02:36:34](https://www.youtube.com/watch?v=jiUC6IUMdvc&t=9394s) In moments like this, it's important to step back and have a little perspective,

[02:36:38](https://www.youtube.com/watch?v=jiUC6IUMdvc&t=9398s) take a little historical perspective.

[02:36:40](https://www.youtube.com/watch?v=jiUC6IUMdvc&t=9400s) Every commodity in the history of humanity has had swings in supply and demand.

[02:36:44](https://www.youtube.com/watch?v=jiUC6IUMdvc&t=9404s) Just because we don't see when that will be yet does not mean that this cycle will be

[02:36:48](https://www.youtube.com/watch?v=jiUC6IUMdvc&t=9408s) any different.

[02:36:50](https://www.youtube.com/watch?v=jiUC6IUMdvc&t=9410s) Unless you're a total AI maxi, which some of us are, so I'm very open to being wrong.

[02:36:54](https://www.youtube.com/watch?v=jiUC6IUMdvc&t=9414s) I'm wrong every day.

[02:36:57](https://www.youtube.com/watch?v=jiUC6IUMdvc&t=9417s) But I would say if you're a business with leverage, you need to be especially conscientious

[02:37:02](https://www.youtube.com/watch?v=jiUC6IUMdvc&t=9422s) of this.

[02:37:02](https://www.youtube.com/watch?v=jiUC6IUMdvc&t=9422s) Being proactive with building your cost advantage might not be as sexy as making your top line

[02:37:09](https://www.youtube.com/watch?v=jiUC6IUMdvc&t=9429s) bigger, but it matters deeply if you want to survive through a business cycle.

[02:37:13](https://www.youtube.com/watch?v=jiUC6IUMdvc&t=9433s) That's why you want to build your operating capability

[02:37:15](https://www.youtube.com/watch?v=jiUC6IUMdvc&t=9435s) and cost advantage while you have the opportunity,

[02:37:19](https://www.youtube.com/watch?v=jiUC6IUMdvc&t=9439s) when the sun is shining, when you can raise capital.

[02:37:22](https://www.youtube.com/watch?v=jiUC6IUMdvc&t=9442s) They matter even more when customers have more choices to make

[02:37:26](https://www.youtube.com/watch?v=jiUC6IUMdvc&t=9446s) and prices come under pressure.

[02:37:27](https://www.youtube.com/watch?v=jiUC6IUMdvc&t=9447s) So how do we make clear what the buyer actually gets?

[02:37:32](https://www.youtube.com/watch?v=jiUC6IUMdvc&t=9452s) Comparable compute needs clear grades.

[02:37:35](https://www.youtube.com/watch?v=jiUC6IUMdvc&t=9455s) Now let's look at the compute that an intelligence producer is buying.

[02:37:40](https://www.youtube.com/watch?v=jiUC6IUMdvc&t=9460s) We've already seen that the same chip

[02:37:41](https://www.youtube.com/watch?v=jiUC6IUMdvc&t=9461s) can deliver different results depending on how it's operated.

[02:37:45](https://www.youtube.com/watch?v=jiUC6IUMdvc&t=9465s) And two offers for B200 GPU hours can include different services and leave different operating

[02:37:51](https://www.youtube.com/watch?v=jiUC6IUMdvc&t=9471s) jobs with the customer.

[02:37:53](https://www.youtube.com/watch?v=jiUC6IUMdvc&t=9473s) A commodity framework needs a way to describe these differences so buyers know which services

[02:37:57](https://www.youtube.com/watch?v=jiUC6IUMdvc&t=9477s) they can treat as comparable.

[02:37:59](https://www.youtube.com/watch?v=jiUC6IUMdvc&t=9479s) That's the job of a grade.

[02:38:03](https://www.youtube.com/watch?v=jiUC6IUMdvc&t=9483s) grade describes a particular compute service and what its buyers can expect.

[02:38:07](https://www.youtube.com/watch?v=jiUC6IUMdvc&t=9487s) It doesn't make intelligence interchangeable across every task.

[02:38:11](https://www.youtube.com/watch?v=jiUC6IUMdvc&t=9491s) Once we've defined that service, we can ask what its rental price tells us.

[02:38:18](https://www.youtube.com/watch?v=jiUC6IUMdvc&t=9498s) What does a rental price benchmark measure?

[02:38:21](https://www.youtube.com/watch?v=jiUC6IUMdvc&t=9501s) A rental price benchmark summarizes the price of GPU hours within its defined market.

[02:38:26](https://www.youtube.com/watch?v=jiUC6IUMdvc&t=9506s) It isn't the producer's production cost or a measure of intelligence delivered.

[02:38:31](https://www.youtube.com/watch?v=jiUC6IUMdvc&t=9511s) We need to know where those prices come from.

[02:38:33](https://www.youtube.com/watch?v=jiUC6IUMdvc&t=9513s) An advertised offer and a completed trade are not the same thing.

[02:38:38](https://www.youtube.com/watch?v=jiUC6IUMdvc&t=9518s) Service scope, contract terms, whose prices are sampled, and how they're combined all shape that reference point.

[02:38:47](https://www.youtube.com/watch?v=jiUC6IUMdvc&t=9527s) Operating quality can influence those prices without the index measuring it separately.

[02:38:52](https://www.youtube.com/watch?v=jiUC6IUMdvc&t=9532s) Running a rental reference doesn't tell you how much useful work your deployment will produce.

[02:38:56](https://www.youtube.com/watch?v=jiUC6IUMdvc&t=9536s) To use it as a hedge, you need to understand how it tracks the rent you actually pay or earn.

[02:39:04](https://www.youtube.com/watch?v=jiUC6IUMdvc&t=9544s) What can compute futures hedge?

[02:39:07](https://www.youtube.com/watch?v=jiUC6IUMdvc&t=9547s) There has been a lot of excitement lately about compute futures.

[02:39:10](https://www.youtube.com/watch?v=jiUC6IUMdvc&t=9550s) For all of you that don't know, a futures contract sets a standardised term for future

[02:39:14](https://www.youtube.com/watch?v=jiUC6IUMdvc&t=9554s) delivery or cash settlement.

[02:39:16](https://www.youtube.com/watch?v=jiUC6IUMdvc&t=9556s) Cash settlement depends on a price reference.

[02:39:19](https://www.youtube.com/watch?v=jiUC6IUMdvc&t=9559s) Buyers and sellers both face uncertainty about rental prices.

[02:39:23](https://www.youtube.com/watch?v=jiUC6IUMdvc&t=9563s) Think back to the serving stacks and the monitoring failure.

[02:39:26](https://www.youtube.com/watch?v=jiUC6IUMdvc&t=9566s) Assessing who runs the system helps describe the service buyers get.

[02:39:30](https://www.youtube.com/watch?v=jiUC6IUMdvc&t=9570s) That helps us to find grades so buyers know which compute services are comparable.

[02:39:35](https://www.youtube.com/watch?v=jiUC6IUMdvc&t=9575s) The benchmark then needs to track the rent they actually pay or earn.

[02:39:39](https://www.youtube.com/watch?v=jiUC6IUMdvc&t=9579s) That's why I make this argument.

[02:39:42](https://www.youtube.com/watch?v=jiUC6IUMdvc&t=9582s) Rating the operator is an essential building block for building a credible compute futures market.

[02:39:48](https://www.youtube.com/watch?v=jiUC6IUMdvc&t=9588s) A rating informs that work.

[02:39:50](https://www.youtube.com/watch?v=jiUC6IUMdvc&t=9590s) It doesn't by itself define a futures grade, establish a sound benchmark,

[02:39:54](https://www.youtube.com/watch?v=jiUC6IUMdvc&t=9594s) or create enough trading to buy and sell easily.

[02:39:57](https://www.youtube.com/watch?v=jiUC6IUMdvc&t=9597s) It also doesn't necessarily make a hedge effective.

[02:40:00](https://www.youtube.com/watch?v=jiUC6IUMdvc&t=9600s) A rental price hedge can help offset rental price changes. It does not fix a failed deployment or ensure that your customer pays.

[02:40:10](https://www.youtube.com/watch?v=jiUC6IUMdvc&t=9610s) Charging more than the index does not by itself make it a bad hedge. What matters is whether changes in the reference track changes in your rent. Unexpected changes in that relationship leave real price risk.

[02:40:22](https://www.youtube.com/watch?v=jiUC6IUMdvc&t=9622s) risk, those tools can help you understand what you're buying and manage the rental price

[02:40:27](https://www.youtube.com/watch?v=jiUC6IUMdvc&t=9627s) risk.

[02:40:27](https://www.youtube.com/watch?v=jiUC6IUMdvc&t=9627s) For an intelligence producer, rent is one part of the cost.

[02:40:31](https://www.youtube.com/watch?v=jiUC6IUMdvc&t=9631s) The operator still has to turn that compute into work that the customer can actually use.

[02:40:37](https://www.youtube.com/watch?v=jiUC6IUMdvc&t=9637s) This brings us full circle.

[02:40:45](https://www.youtube.com/watch?v=jiUC6IUMdvc&t=9645s) a GPU falls to the level of the operator.

[02:40:48](https://www.youtube.com/watch?v=jiUC6IUMdvc&t=9648s) So who can produce the intelligence you need at the lowest cost?

[02:40:53](https://www.youtube.com/watch?v=jiUC6IUMdvc&t=9653s) The producer who can repeatedly meet your requirements at the lowest full cost per successfully completed task.

[02:41:00](https://www.youtube.com/watch?v=jiUC6IUMdvc&t=9660s) Count everything spent to deliver the service, then divide by the output that the customer can actually use.

[02:41:06](https://www.youtube.com/watch?v=jiUC6IUMdvc&t=9666s) Operating capability affects both sides of that equation, what you spend, and how much more useful work you can deliver.

[02:41:13](https://www.youtube.com/watch?v=jiUC6IUMdvc&t=9673s) Also, your position depends on that of your competitors.

[02:41:16](https://www.youtube.com/watch?v=jiUC6IUMdvc&t=9676s) You can improve and still fall behind if your competitors improve faster than you.

[02:41:21](https://www.youtube.com/watch?v=jiUC6IUMdvc&t=9681s) That's why understanding the operator matters through the cycle, not just at one point in time.

[02:41:27](https://www.youtube.com/watch?v=jiUC6IUMdvc&t=9687s) Especially when customers have more choices and prices come under more pressure.

[02:41:32](https://www.youtube.com/watch?v=jiUC6IUMdvc&t=9692s) In conclusion, if you just walked in and want the TLDR, this is it.

[02:41:36](https://www.youtube.com/watch?v=jiUC6IUMdvc&t=9696s) A GPU falls to the level of the operator.

[02:41:41](https://www.youtube.com/watch?v=jiUC6IUMdvc&t=9701s) Help build a better informed compute market.

[02:41:43](https://www.youtube.com/watch?v=jiUC6IUMdvc&t=9703s) Ladies and gentlemen, thank you so much for your time today.

[02:41:45](https://www.youtube.com/watch?v=jiUC6IUMdvc&t=9705s) at SemiAnalysis, we know that markets do not become informed and efficient on their own.

[02:41:50](https://www.youtube.com/watch?v=jiUC6IUMdvc&t=9710s) We seek to be an active, engaged partner in that work. It takes two to tango, though.

[02:41:56](https://www.youtube.com/watch?v=jiUC6IUMdvc&t=9716s) Ideally, more than two, actually. If you'd like to partner with us, contribute, or join the team,

[02:42:02](https://www.youtube.com/watch?v=jiUC6IUMdvc&t=9722s) we would love to hear from you. We are always hiring great people. Please reach out.

[02:42:08](https://www.youtube.com/watch?v=jiUC6IUMdvc&t=9728s) If this resonated, please go ahead and email sales at semianalysis.com

[02:42:13](https://www.youtube.com/watch?v=jiUC6IUMdvc&t=9733s) for partnership opportunities.

[02:42:15](https://www.youtube.com/watch?v=jiUC6IUMdvc&t=9735s) And if you're interested in potentially joining the team,

[02:42:19](https://www.youtube.com/watch?v=jiUC6IUMdvc&t=9739s) my email is kenin at semianalysis.com, K-E-N-N-O-N.

[02:42:23](https://www.youtube.com/watch?v=jiUC6IUMdvc&t=9743s) Thank you all for listening,

[02:42:25](https://www.youtube.com/watch?v=jiUC6IUMdvc&t=9745s) and have a fantastic rest of your day.

[02:42:28](https://www.youtube.com/watch?v=jiUC6IUMdvc&t=9748s) Thank you.