Tag: ai-ml

All the articles with the tag "ai-ml".

• AI/ML - How BPE Tokenization Works in Large Language Models

  22 Jul, 2026

  How Byte Pair Encoding (BPE) tokenization works in large language models: the training algorithm, encoding and decoding, tiktoken and sentencepiece implementations, vocabulary construction, and why subword tokenization strikes the right balance between characters and words.

• AI/ML - How the Transformer Attention Mechanism Works

  18 Apr, 2026

  How the Transformer attention mechanism works: intuition behind queries/keys/values, scaled dot-product attention, multi-head attention, positional encoding, and a source code walkthrough from PyTorch and the original paper.