/tags/deep-learning/Recent content in Deep-Learning on Hitesh PattanayakHugoen-usSun, 22 Mar 2026 11:43:37 -0700/posts/the-evolution-beyond-transformers/Sun, 22 Mar 2026 11:43:37 -0700/posts/the-evolution-beyond-transformers/A practical walkthrough of how the Transformer architecture evolved from encoder-decoder to decoder-only models, why attention’s quadratic scaling became a hard wall, and how Mamba’s state space machines are being absorbed into hybrid architectures that dominate production today./posts/the-end-of-the-rnn-era-the-query-key-value-revolution/Sat, 21 Mar 2026 12:06:03 -0700/posts/the-end-of-the-rnn-era-the-query-key-value-revolution/A practical walkthrough of why RNNs hit a fundamental wall with sequential processing and long-range dependencies, and how the Query-Key-Value attention mechanism solves both problems in one elegant step./posts/deep-learning/Sat, 12 Oct 2024 00:00:00 +0000/posts/deep-learning/This article breaks down the key mathematical concepts behind neural networks, including weights, biases, and activations, with an example of handwritten digit recognition.