https://datta0.github.io/posts/rethink-lora-init/ 2026-05-31T00:58:51+05:30 https://datta0.github.io/posts/transformer-showdown/ 2026-05-31T00:58:51+05:30 https://datta0.github.io/posts/transformer-imagined/ 2026-05-31T00:58:51+05:30 https://datta0.github.io/posts/understanding-multi-gpu-parallelism-paradigms/ 2026-05-31T00:58:51+05:30 https://datta0.github.io/posts/exploring-the-moe/ 2026-05-31T00:58:51+05:30 https://datta0.github.io/posts/the-lore-behind-lora/ 2026-05-31T00:58:51+05:30 https://datta0.github.io/posts/flash-attention/ 2026-05-31T00:58:51+05:30 https://datta0.github.io/posts/rl-for-llms/ 2026-05-31T00:58:51+05:30 https://datta0.github.io/posts/systems-for-llm-rl/ 2026-05-30T00:00:00+05:30 https://datta0.github.io/categories/ 2026-06-01T19:40:56+05:30 https://datta0.github.io/tags/ 2026-06-01T19:40:56+05:30 https://datta0.github.io/archives/ 2026-06-01T19:40:56+05:30 https://datta0.github.io/about/ 2026-06-01T19:40:56+05:30 https://datta0.github.io/ https://datta0.github.io/tags/llm/ https://datta0.github.io/tags/lora/ https://datta0.github.io/tags/peft/ https://datta0.github.io/tags/fine-tuning/ https://datta0.github.io/tags/training/ https://datta0.github.io/tags/transformer/ https://datta0.github.io/tags/attention/ https://datta0.github.io/tags/architecture/ https://datta0.github.io/tags/kv-cache/ https://datta0.github.io/tags/inference/ https://datta0.github.io/tags/math/ https://datta0.github.io/tags/ffn/ https://datta0.github.io/tags/systems/ https://datta0.github.io/tags/gpu/ https://datta0.github.io/tags/parallelism/ https://datta0.github.io/tags/vllm/ https://datta0.github.io/tags/mixture-of-experts/ https://datta0.github.io/tags/kernels/ https://datta0.github.io/tags/rl/ https://datta0.github.io/tags/rlhf/ https://datta0.github.io/tags/ppo/ https://datta0.github.io/tags/dpo/ https://datta0.github.io/tags/grpo/ https://datta0.github.io/categories/lora/ https://datta0.github.io/categories/fine-tuning/ https://datta0.github.io/categories/llm/ https://datta0.github.io/categories/transformer/ https://datta0.github.io/categories/architectures/ https://datta0.github.io/categories/attention/ https://datta0.github.io/categories/ffnn/ https://datta0.github.io/categories/math/ https://datta0.github.io/categories/gpu/ https://datta0.github.io/categories/parallelism/ https://datta0.github.io/categories/vllm/ https://datta0.github.io/categories/inference/ https://datta0.github.io/categories/mixture-of-experts/ https://datta0.github.io/categories/training/ https://datta0.github.io/categories/kernels/ https://datta0.github.io/categories/rl/ https://datta0.github.io/categories/grpo/ https://datta0.github.io/categories/ppo/ https://datta0.github.io/categories/systems/