from-scratch

Implement a ChatGPT-like LLM in PyTorch from scratch, step by step

Learn AI Engineering! Learn it. Build it. Ship it for others.

A 2.78-trillion-parameter Kimi K3 running inference on a single CPU in 8.24 GB of RAM. Portable C99: no BLAS, no framework, no GPU.

Build a modern LLM from scratch. Every line commented. Explained like we are five.

A shader-based software renderer written from scratch in C89

LeetCode for PyTorch — 65 ML/AI interview problems from real interviews at Google, Meta, Anthropic. Jupyter notebooks, an auto-grader, and an MCP AI tutor.

Agent工程师最全学习路径 · 从零精通 AI 工程 · 20 阶段 542 课 · 中文全量翻译 + 配套站点 + 动画讲解视频 · 如何成为 AI Agent 工程师的修成指南

Multiplayer FPS game - Counter-Strike: Football 🏉

Pure Rust implementation of a minimal Generative Pretrained Transformer

Don't memorize ML. Understand it from first principles including Inference, Cuda, Deep Learning, Data Science and Reinforcement Learning

DSOD: Learning Deeply Supervised Object Detectors from Scratch. In ICCV 2017.

A x86_64 C99 compiler written in Rust from scratch

From-scratch PyTorch replications of classic and SOTA AI/ML papers: transformers, attention, GANs, diffusion, CLIP, LoRA, MoE, plus SFT/GRPO post-training experiments.

C++ Path Tracer from scratch with zero third-party libraries.

A simple in memory cache written using go

An OS which is all about learning!

零基础入门 AI Agent 的基础教程。不只是教程，也是一个能在本地跑起来的 Agent：读写文件、执行命令、MCP、长期记忆，自带网页端看清每一步。从 100 行最小循环开始，一课加一个能力，最后拆解 Claude Code、Codex 等主流 Agent

Readable single-file PyTorch implementations of deep RL algorithms

ncurses 3d object viewer

Build a Large Language Model (From Scratch) book and Finetuned Models