6:15

I made a video about what happens when you execute `c = a @ b` in...

Name: I made a video about what happens when you execute `c = a @ b` in...
Uploaded: 2026-08-30T13:03:04.211736+00:00
Duration: 6 min 15 s
Channel: @yunta_tsai
Description: I made a video about what happens when you execute `c = a @ b` in PyTorch, from the code to silicon. Hopefully it will help you appreciate that simple line of code more. Made by Grok @bot. Enjoy! — Thread by @yunta_tsai

Yun-Ta Tsai@yunta_tsai

46 views Aug 30, 2026 ~1 min read

I made a video about what happens when you execute `c = a @ b` in PyTorch, from the code to silicon.

Hopefully it will help you appreciate that simple line of code more.

Made by Grok @bot. Enjoy!

Yun-Ta Tsai@yunta_tsai

It's beneficial for a software engineer to learn chip design so they understand how numerics flow through circuitry each cycle.

An SM (the basic unit of a GPU) is actually quite simple: memory, register files and a bunch of FMAs (fused multiply-adds) along with warp schedulers.

All GPU architecture changes began from SMs. Scaling up is the hard part.

Actions

Related Threads