MicroLLM lab — tiny LLMs, Q4, in your browser
stateofutopia.com/experiments/microllmlab
What Jamie wrote
It is wild that LLMs were not even a thing a few years ago and now they seem to be everything and you can even now run some of them in your browser. You can quickly see how these "micro" LLMs are not terribly capable. I've generally considered the esoteric and expensive hardware needs of LLMs a reason to discount many concerns about agents operating autonomously. Is it reasonable to think a powerful "enough" LLM could run in a web browser? It still seems like a stretch to me.