AI use case

Train a tiny language model to run offline on a microcontroller

A maker trained a 30-million-parameter language model from scratch, squeezed it down with 4-bit quantisation and got it answering offline on an ESP32 board, as a hands-on way to learn how LLMs work.