Series
Deep learning is a subset of machine learning that employs artificial neural networks with multiple hidden layers to learn data representations and complex patterns. Deep learning architectures such as deep neural networks, deep belief networks, recu...
In one line, a vector database is a specialized database designed to efficiently store and query vector embeddings. Now if you don't know what is vector embeddings, then....⬇️ 💡 Vector embeddings are high-dimensional numerical representations of da...
The strange pause Okay, so lets say, you open a chat app and you paste a long document. Then, you ask, "Hey, can you summarize this?" You hit enter. Nothing happens. One second. Two seconds. Maybe thr
Go to https://platform.openai.com/tokenizer Put 🏡 in the text box. And see the output. Why one single emoji is giving us two tokenIDs? For that, we need to understand three different things: Uni
In our Inside an LLM Tokenizer , we understand Unicode → UTF-8 → Tokenization → Token IDs Now, the next question is: How does an LLM turn those meaningless integer IDs into numerical representations t
In Module 1, we learned that an embedding layer converts a token ID into a vector. For example: cat = [0.90, 0.10] dog = [0.85, 0.15] We said these two vectors look similar, but we haven't explained w
