karpathy/nanochat
nanochat: Train and interact with a GPT-2 quality LLM for under $100
The best ChatGPT that $100 can buy.
AI-generated summary
nanochat is an experimental, minimalist Python framework for training Large Language Models (LLMs) on a single GPU node. It covers the entire LLM lifecycle, from tokenization and pretraining to fine-tuning, evaluation, and inference. The project aims to make training models with GPT-2 capabilities accessible, costing as little as $48 on cloud instances.
Language: Python