A place where I share my thoughts, findings and learnings

HOME
CATEGORIES
TAGS
ARCHIVES
ABOUT

Home Tags Tensor Parallelism

Tag

Tensor Parallelism 1

Understanding multi GPU Parallelism paradigms Jul 6, 2025

Recently Updated

The lore behind LoRA
Rethink LoRA initialisations for faster convergence
Exploring the Mixture of Experts
Understanding multi GPU Parallelism paradigms
Attention and Transformer Imagined

Trending Tags

Transformer FFNN Math Attention LoRA activations Data Parallelism Differential Transformer Fine tuning Finetuning

© 2026 Datta Nimmaturi. Some rights reserved.

Using the Chirpy theme for Jekyll.

Trending Tags

Transformer FFNN Math Attention LoRA activations Data Parallelism Differential Transformer Fine tuning Finetuning