Build Your First LLM from ScratchPart 2 · Section 6 of 7
What You'll Create
By the end of this series, you'll have built these files from scratch:
| File | Description |
|---|---|
| tokenizer.py | Converts text to token IDs |
| embeddings.py | Converts token IDs to vectors |
| attention.py | The attention mechanism |
| transformer.py | Transformer blocks |
| model.py | Complete model architecture |
| dataset.py | Calculator dataset generator |
| train.py | Training loop |
| generate.py | Text generation |
| app.py | Gradio demo for Hugging Face |
github.com/slahiri/small_calculator_modelHelpful?