60-DAY WINDOW: NOV 04, 2026 — JAN 01, 2027
IN-PERSON WORKSHOPPHONE VERIFIED HOSTIntermediate

Attention Is All You Need: Coding a Transformer from Scratch in PyTorch

University of Toronto deep-dive into multi-head attention, positional encodings, and backpropagation

Thursday, December 10, 20261:00 PM - 5:00 PM EDT
MaRS Discovery District101 College St, Toronto, ON M5G 1L7

Syllabus & Session Overview

Taught in the historic cradle of deep learning. We demystify the transformer architecture by implementing multi-head self-attention, causal masking, layer norm, and feed-forward networks line by line.

Topics Covered

PyTorchTransformersDeep LearningAttention

Physical Venue Location

Toronto, Ontario
Loading Venue Map...
MaRS Discovery District101 College St, Toronto, ON M5G 1L7
Open in Google Maps