Train LLM From Scratch
A straightforward method for training your LLM, from downloading data to generating text.
CourseLearningCross-PlatformFree
4.7Visit
Framework
nanoGPT
The simplest, fastest repository for training and finetuning medium-sized GPTs.
Day 43 since launch · Launched 25 August 2026
Made by Shushant LakhyaniKnow about Shushant Lakhyani hereGet all my visual guides hereSee what I can build for youAI+Tech+No-Code+Online Business Mini GuidesJoin the newsletter
Made by Shushant LakhyaniKnow about Shushant Lakhyani hereGet all my visual guides hereSee what I can build for youAI+Tech+No-Code+Online Business Mini GuidesJoin the newsletterBuilt with love by Shushant Lakhyani. Building bestproductivityresources.com
Screenshot or bookmark this page so you find it later, then share it with your network.
What is nanoGPT?
nanoGPT is Karpathy's minimal, hackable codebase for training and finetuning medium-sized GPTs — prioritising simplicity and speed over abstraction, and widely used as a teaching and research base.
Pros
- Minimal and readable GPT training code
- Fast enough for real experiments
- The standard teaching base for LLM training
Cons
- Requires GPU resources for serious runs
- Deliberately few abstractions and features
Who should use nanoGPT
Engineers and students who want to train and understand GPTs from a clean codebase.
Who may not need it
Teams wanting a batteries-included training platform.
nanoGPT alternatives
Similar resources to nanoGPT, picked from the directory.
Dive into Deep Learning
Interactive deep learning book with code, math and discussions.
CourseLearningWebFree
4.9Visit
Annotated Deep Learning Paper Implementations
60+ deep learning paper implementations with side-by-side notes.
CourseLearningWebFree
4.8Visit
LLM Course
A course to get into large language models with roadmaps and Colab notebooks.
CourseLearningWebFree
4.8Visit
Awesome LLM
A curated list of large language model papers, frameworks and resources.
WebsiteLearningWebFree
4.7Visit
Neural Networks: Zero to Hero
Karpathy's course building neural networks from scratch, step by step.
CourseLearningWebFree
4.9Visit
Free alternatives to nanoGPT
Free resources that cover similar ground.
Fast GraphRAG
RAG that intelligently adapts to your use case, data and queries.
FrameworkAI ProductivityCross-Platform, WebFree
4.7Visit
Learn Harness Engineering
Harness engineering beginner tutorial, from 0 to 1.
CourseAI ProductivityWebFree
4.7Visit
Scientific Agent Skills
Turn any AI agent into an AI scientist with ready-to-use research skills.
AI ToolAI ProductivityWebFree
4.7Visit
Spinning Up in Deep RL
OpenAI's educational resource for learning deep reinforcement learning.
CourseLearningWebFree
4.7Visit
GCF
AI-native wire format for structured data with fewer tokens than JSON.
FrameworkAutomationWeb, Cross-PlatformFree
4.5Visit
Machine Learning Systems (Harvard CS249r)
Harvard's open textbook on ML systems, agentic AI and physical AI.
BookLearningWebFree
4.5Visit
Featured on Best Productivity Resources
Made nanoGPT? Add this free badge to your website or README. It links to this page.
<a href="https://bestproductivityresources.com/resources/nanogpt" target="_blank" rel="noopener"><img src="https://bestproductivityresources.com/badges/featured-light.svg" alt="Featured on Best Productivity Resources" width="250" height="54" /></a>