grid                     values    positions   conv GFLOPs   attention GFLOPs   attention matrix entries
pixels 512x512x3         786,432   262,144     19.33         87960.9            68,719,476,736
latent 64x64x4 (f = 8)   16,384    4,096       0.30          21.5               16,777,216
ratio                    48        64          64            4096               4096

image size    latent shape        positions   attention GFLOPs   relative to 512x512   conv GFLOPs
512x512       [1, 4, 64, 64]      4,096       21.5               1.00                  0.30  (1.00x)
768x768       [1, 4, 96, 96]      9,216       108.7              5.06                  0.68  (2.25x)
1024x1024     [1, 4, 128, 128]    16,384      343.6              16.00                 1.21  (4.00x)
2048x2048     [1, 4, 256, 256]    65,536      5497.6             256.00                4.83  (16.00x)
