Nathan Laoué.
LearnBuildRepeat
From my atlas
Last published notes
The latest additions to my personal notebook.
Execution ·
GPU Architecture and CUDA Programming
Trace a CUDA thread to its output, follow warp addresses into memory sectors, drain shared-memory bank queues, reuse matrix tiles, fold reductions and overlap copies with two buffers.
Open note →Training ·Collective Communication
Visualize who sends, who receives, and who owns the result. Broadcast, Reduce, AllReduce, AllGather, ReduceScatter, AllToAll and point-to-point exchanges, with distributed training examples.
Open note →Mathematics ·Mathematical Problem Solving
Model hidden states, probability and guarantees before choosing counting, expectation, arrival processes, information bounds, invariants or rates.
Open note →Note 1 / 3
Selected work
GitHub ↗