In this video I discuss New Cerebras Supercomputer with Cerebras’s CEO Andrew Feldman.
Timestamps:
00:00 – Introduction
02:15 – Why such a HUGE Chip?
02:37 – New AI Supercomputer Explained
04:06 – Main Architectural Advantage
05:47 – Software Stack NVIDIA CUDA vs Cerebras
06:55 – Costs
07:51 – Key Applications & Customers
09:48 – Next Generation – WSE3
10:27 – NVIDIA vs Cerebras Comparison
Mentioned Papers:
Massively scalable stencil algorithm: https://arxiv.org/abs/2204.03775
https://www.cerebras.net/blog/harnessing-the-power-of-sparsity-for-large-gpt-ai-models
https://www.cerebras.net/press-release/cerebras-wafer-scale-cluster-brings-push-button-ease-and-linear-performance-scaling-to-large-language-models/
Programming at Scale:
https://8968533.fs1.hubspotusercontent-na1.net/hubfs/8968533/Whitepapers/Cerebras-Whitepaper-ProgrammingAtScale.pdf
Massively Distributed Finite-Volume Flux Computation: https://arxiv.org/abs/2304.11274
Mentioned Video:
New CPU Technology: https://youtu.be/OcoZTDevwHc
👉 Support me at Patreon ➜ https://www.patreon.com/AnastasiInTech
📩 Sign up for my Deep In Tech Newsletter for free! ➜ https://anastasiintech.substack.com
