/tags/nlp/Recent content in Nlp on Hitesh PattanayakHugoen-usSun, 29 Mar 2026 21:14:51 -0700/posts/vector-embeddings-similarity-the-foundation-of-rag/Sun, 29 Mar 2026 21:14:51 -0700/posts/vector-embeddings-similarity-the-foundation-of-rag/A practical deep-dive into vector embeddings and cosine similarity — the mathematical foundation that makes retrieval in RAG systems actually work./posts/vector-databases-ann-and-chunking-storing-knowledge-for-retrieval/Sun, 29 Mar 2026 21:11:47 -0700/posts/vector-databases-ann-and-chunking-storing-knowledge-for-retrieval/A practical guide for software engineers covering how vector databases use Approximate Nearest Neighbor algorithms to search millions of embeddings efficiently, and how to chunk documents intelligently so your RAG pipeline actually retrieves useful, precise context./posts/training-for-greatness-speed-bleu-records-and-the-multimodal-vision/Sat, 21 Mar 2026 12:20:48 -0700/posts/training-for-greatness-speed-bleu-records-and-the-multimodal-vision/A practical deep-dive into how the original Transformer model shattered translation benchmarks, slashed training costs, and laid the architectural foundation for every major LLM that followed./posts/inside-the-machine-encoders-decoders-and-masking/Sat, 21 Mar 2026 12:19:38 -0700/posts/inside-the-machine-encoders-decoders-and-masking/A practical deep-dive into how the Transformer’s encoder and decoder stacks work, covering residual connections, positional encoding, masked self-attention, and cross-attention with code examples throughout./posts/the-end-of-the-rnn-era-the-query-key-value-revolution/Sat, 21 Mar 2026 12:06:03 -0700/posts/the-end-of-the-rnn-era-the-query-key-value-revolution/A practical walkthrough of why RNNs hit a fundamental wall with sequential processing and long-range dependencies, and how the Query-Key-Value attention mechanism solves both problems in one elegant step./posts/tokenization/Wed, 02 Oct 2024 00:00:00 +0000/posts/tokenization/Take a detour before diving into transformers and explore sub-word tokenization techniques like Byte-Pair Encoding, WordPiece, and Unigram models. Learn how they handle rare words, reduce vocabulary size, and make models more efficient!