Inductor Op Lowering about gpt-fast HOT 3 OPEN

I would perhaps suggest this video giving an overview of TorchInductor: https://www.youtube.com/watch?v=p13HpZv2S3Q

Another thing you can check out is TORCH_LOGS="output_code", which'll show you the actual triton kernels that are generated.

Other than that, there is somewhat of a lack of publicly available educational resources on Inductor, hopefully we'll able to release some at some point.

from gpt-fast.

@Chillee
Thanks! I've been using TORCH_LOGS=all to dump the entire compilation process though this is probably overkill.

Would be instructive to have a tutorial that steps through the compilation pipeline for a simple module with a focus on the backend lowering / codegen. Lmk if something like this exists already or would be useful to the community.

Will do some more digging around the inductor tests to gather digestible bits.

Btw, enjoy your blogposts / tweets on gpu performance :) Hope to see more of these.

from gpt-fast.

FYI: I'm developping a walk-through example of torch.compile, although the focus is more on the Dynamo and AOTAutograd side. The detailed working procedure of inductor is harder to describe. Hope someday I can figure it out later.

from gpt-fast.