OpenAI's secret weapon just dropped. Jalapeno, the AI-designed chip that beats Rubin on tokens per megawatt, taped out in nine months, and runs Doom.
Myron and Bryan join @JordanNanos on SemiAnalysis Weekly to break it all down:
- Jalapeno vs Rubin and GB300 on InferenceX
- Why tokens per megawatt is the metric that matters
- Samsung's HBM4 comeback
- AI-written RTL and kernels
- Is the CUDA moat draining?
- Anthropic's ASIC is next
Watch Now:
https://t.co/C1p4oguqlt
benchmark — A standard public test set for comparing AI models — the shared scoreboards behind every "model X beats model Y" claim.
token — The chunk of text a model reads and writes in — roughly three-quarters of a word — and the unit AI usage is billed in.
inference — Running a trained model to get answers — the phase where AI is actually used, as opposed to trained.
Why it matters
OpenAI's in-house accelerator reportedly beats Nvidia Rubin on tokenThe chunk of text a model reads and writes in — roughly three-quarters of a word — and the unit AI usage is billed in.Full definition → per megawatt and taped out in nine months — a signal on where inferenceRunning a trained model to get answers — the phase where AI is actually used, as opposed to trained.Full definition → capacity, pricing and the CUDA lock-in are heading over the next cycle.
