https://datta0.github.io/posts/rethink-lora-init/ 2026-03-23T19:20:14+05:30 https://datta0.github.io/posts/transformer-showdown/ 2025-06-14T18:32:02+05:30 https://datta0.github.io/posts/transformer-imagined/ 2025-06-15T20:19:27+05:30 https://datta0.github.io/posts/understanding-multi-gpu-parallelism-paradigms/ 2026-02-24T21:37:53+05:30 https://datta0.github.io/posts/exploring-the-moe/ 2026-02-25T16:28:36+05:30 https://datta0.github.io/posts/the-lore-behind-lora/ 2026-03-25T10:02:50+05:30 https://datta0.github.io/categories/ 2026-03-25T10:03:18+05:30 https://datta0.github.io/tags/ 2026-03-25T10:03:18+05:30 https://datta0.github.io/archives/ 2026-03-25T10:03:18+05:30 https://datta0.github.io/about/ 2026-03-25T10:03:18+05:30 https://datta0.github.io/ https://datta0.github.io/tags/lora/ https://datta0.github.io/tags/fine-tuning/ https://datta0.github.io/tags/llm/ https://datta0.github.io/tags/mla/ https://datta0.github.io/tags/mha/ https://datta0.github.io/tags/gqa/ https://datta0.github.io/tags/multi-latent-attention/ https://datta0.github.io/tags/ngpt/ https://datta0.github.io/tags/differential-transformer/ https://datta0.github.io/tags/kv-cache/ https://datta0.github.io/tags/activations/ https://datta0.github.io/tags/memory/ https://datta0.github.io/tags/trainig/ https://datta0.github.io/tags/nanoformer/ https://datta0.github.io/tags/attention/ https://datta0.github.io/tags/transformer/ https://datta0.github.io/tags/ffnn/ https://datta0.github.io/tags/math/ https://datta0.github.io/tags/gpu/ https://datta0.github.io/tags/parallelism/ https://datta0.github.io/tags/vllm/ https://datta0.github.io/tags/tensor-parallelism/ https://datta0.github.io/tags/pipeline-parallelism/ https://datta0.github.io/tags/data-parallelism/ https://datta0.github.io/tags/mixture-of-experts/ https://datta0.github.io/tags/training/ https://datta0.github.io/tags/finetuning/ https://datta0.github.io/categories/lora/ https://datta0.github.io/categories/fine-tuning/ https://datta0.github.io/categories/llm/ https://datta0.github.io/categories/transformer/ https://datta0.github.io/categories/architectures/ https://datta0.github.io/categories/attention/ https://datta0.github.io/categories/ffnn/ https://datta0.github.io/categories/math/ https://datta0.github.io/categories/gpu/ https://datta0.github.io/categories/parallelism/ https://datta0.github.io/categories/vllm/ https://datta0.github.io/categories/inference/ https://datta0.github.io/categories/mixture-of-experts/ https://datta0.github.io/categories/training/ https://datta0.github.io/categories/finetuning/