nanochat: The best ChatGPT that $100 can buy.

Maybe I found my use case for that new NVIDIA DGX Spark. 😁

This repo is a full-stack implementation of an LLM like ChatGPT in a single, clean, minimal, hackable, dependency-lite codebase. nanochat is designed to run on a single 8XH100 node via scripts like speedrun.sh, that run the entire pipeline start to end. This includes tokenization, pretraining, finetuning, evaluation, inference, and web serving over a simple UI so that you can talk to your own LLM just like ChatGPT.

I totally dig this project and love the idea that I could train my own "good enough" model that would run on my infrastructure maybe even in my home. Reminder, I run a Gnosis Chain Validator at home and think that is incredible. Democratizing LLM capability? I like it.

Now give it a couple of weeks and I bet this is a one-line installer for that new Spark.