Visualizing 3D Attention: Bridging the Gap Between 1D Sequences and 3D Space
An interactive tool to visualize the mapping between 1D token sequences and 3D (T, H, W) sliding windows.
GPU & Network Constants
A quick reference of Dense FLOPS and Unidirectional Bandwidth for A100, H100, H200, and Blackwell.