A place where I share my thoughts, findings and learnings

HOME
CATEGORIES
TAGS
ARCHIVES
ABOUT

Home Tags Math

Tag

Math 1

Attention and Transformer Imagined Jun 14, 2025

Recently Updated

Attention and Transformer Imagined
Rethink LoRA initialisations for faster convergence
Transformer showdown MHA vs MLA vs nGPT vs Differential Transformer

Trending Tags

activations Attention Differential Transformer FFNN Fine tuning GQA kv cache LLM LoRA Math

© 2025 Datta Nimmaturi. Some rights reserved.

Using the Chirpy theme for Jekyll.

Trending Tags

activations Attention Differential Transformer FFNN Fine tuning GQA kv cache LLM LoRA Math