Byte-Pair Encoding (BPE) Explained Step by Step
How Byte-Pair Encoding builds a subword vocabulary by merging the most frequent character pairs, how it encodes new words, and why GPT uses byte-level BPE.
Code-first AI for production
Learn to build and deploy machine learning, RAG, and AI agent systems through practical, step-by-step projects.
200K+
Learners
IIT KGPIIT Kharagpur
Alumnus
4.8★
Instructor rating

Guided Roadmaps
Follow a sequenced roadmap instead of piecing together disconnected tutorials.
A structured, progressive roadmap for developers seeking to master AI agents, covering Python foundations, LangChain, LangGraph, and private multi-agent RAG.
A comprehensive curriculum taking you from zero programming knowledge to professional data manipulation, mathematical visualization, and core ML model building.
Latest from the library
Start with recent code-first guides, or filter the library by the skill you are building.
How Byte-Pair Encoding builds a subword vocabulary by merging the most frequent character pairs, how it encodes new words, and why GPT uses byte-level BPE.
A verified list of free, browser-based interactive demos that teach LLMs, embeddings, RAG, vector databases, and AI agents across a 40-day learning path.
The four ways to tokenize text, word, character, subword, and byte-level, and the trade-offs in vocabulary size, sequence length, and out-of-vocabulary words.

Meet your instructor
I'm Laxmi Kant Tiwari, IIT Kharagpur alumnus, founder with a successful startup exit, and an engineer with 10+ years across industry and academia. Everything here is taught the way real production systems are built.
Read my storyFree Video Tutorials
Full video walkthroughs, free: new tutorials every week.
Setup Hermes Agent with Google Workspace - Google Gmail, Google Sheets, Google Docs, Calendars
Hermes Agent Gmail Setup - Read, Send & Automate Emails (2026)
Hermes Agent WhatsApp Setup: Control Your AI From Your Phone (2026)
In-Depth Courses
Go deeper with complete projects, private repositories, and certificates.
Master Langchain v1, Local LLM Projects, Ollama, DeepSeek, LLAMA 3.2, Complete Integration Guide.
Agentic RAG and Chatbot, AI Agent, DeepSeek, LLAMA 3.2 Agent, FAISS Vector Database.
Build MCP servers & clients with Python, Streamlit, ChromaDB, LangChain, LangGraph agents, and Ollama integrations.
Explore all available curriculum packages with our worldwide student ratings and pre-applied coupons.
What Students Say About Us
“The instructor explained clearly and its examples were easy to implement. I recommend it for introducing yourself into the latest advancements in transformers.”
“This is a nice hands-on video. The contents enhance the knowledge of fine tuning the model. I have also found that the 'theory' parts are very worth to learn.”
“The lecture is well-organized and delivered clearly, and easy to learn.”