First-principles notes on LLMs, GPU kernels, and model training

HOME
CATEGORIES
TAGS
ARCHIVES
ABOUT

Home Categories RL

Category

RL 1

Reinforcement Learning for LLMs May 21, 2026

Recently Updated

Reinforcement Learning for LLMs
Rethink LoRA initializations for faster convergence
Transformer showdown MHA vs MLA vs nGPT vs Differential Transformer
Attention and Transformer Imagined
Understanding multi-GPU Parallelism paradigms

Trending Tags

Math Transformer Fine-tuning Attention FFNN Training GPU LLM LoRA activations

© 2026 Datta Nimmaturi. Some rights reserved.

Built with Jekyll. Source.

Trending Tags

Math Transformer Fine-tuning Attention FFNN Training GPU LLM LoRA activations