Implement a ChatGPT-like LLM in PyTorch from scratch, step by step
-
Updated
Jun 2, 2026 - Jupyter Notebook
Implement a ChatGPT-like LLM in PyTorch from scratch, step by step
Learn it. Build it. Ship it for others.
A shader-based software renderer written from scratch in C89
Build a modern LLM from scratch. Every line commented. Explained like we are five.
Multiplayer FPS game - Counter-Strike: Football 🏉
Pure Rust implementation of a minimal Generative Pretrained Transformer
DSOD: Learning Deeply Supervised Object Detectors from Scratch. In ICCV 2017.
Agent工程师最全学习路径 · 从零精通 AI 工程 · 20 阶段 503 课 · 中文全量翻译 + 配套站点 + 动画讲解视频 · 如何成为 AI Agent 工程师的修成指南
A x86_64 C99 compiler written in Rust from scratch
C++ Path Tracer from scratch with zero third-party libraries.
A simple in memory cache written using go
An OS which is all about learning!
ncurses 3d object viewer
Build a Large Language Model (From Scratch) book and Finetuned Models
Escape is a UNIX-like microkernel operating system that runs on x86, x86_64, ECO32 and MMIX.
Build a Claude Code–like CLI coding agent from scratch.
A complete neural network built entirely in x86 assembly language that learns to recognize handwritten digits from the MNIST dataset. No frameworks, no high-level languages - just pure assembly - ~5.3× faster than NumPy
Experimental demoscene project using C99 and Direct3D 12. Fully standalone with custom windows, and d3d12 headers. No Windows SDK, libc or Visual Studio dependency. C and HLSL compilers included.
Add a description, image, and links to the from-scratch topic page so that developers can more easily learn about it.
To associate your repository with the from-scratch topic, visit your repo's landing page and select "manage topics."