home projects contact reviews blog experience log now

Blog Posts

Posts per page:
visitor@blog:~$
ZeRO Optimizer · Part 1

ZeRO: Zero Redundancy Optimizer

4/21/2026

Memory optimization for distributed training. The three ZeRO stages explained with math and notation.

Distributed TrainingOptimizationPyTorch

RetNet: Retentive Network

4/6/2026

Math behind the Retention mechanism, recurrent, parallel, and chunkwise forms from the RetNet paper.

LLMAttentionLinear Attention
Backend Infrastructure · Part 2

Kubernetes: A Deep Reference

4/5/2026

Control plane, nodes, pods, services, kubectl, minikube, and the reconciliation loop explained.

KubernetesInfrastructureDevOps

UV Cheatsheet

4/5/2026

Complete UV cheatsheet, the fast Python package manager that replaces pip, virtualenv, and poetry.

PythonUVToolsDevTools
Backend Infrastructure · Part 1

Kafka explained in simple words

11/30/2025

Introduction to Kafka

MessagingDataServicesInfrastructure
Total: 14 blog posts

Tags