AiButLowLevel

A repository where I implement AI models from scratch.

Implemented Models

Attention

• Vanilla Multi-Head Attention (VanillaMHA)
• Sparse Multi-Head Attention (SparseMHA)
• Flash Multi-Head Attention (FlashMHA)

GANs

• Vanilla GAN
• Wasserstein GAN

General

• UNet

VAEs

• Vanilla VAE
• Convolutional VAE (ConvVAE)
• Temporal-Diff VAE (TD-VAE)
• Vector Quantized VAE (VQ-VAE)