New best story on Hacker News: Running large language models like ChatGPT on a single GPU

Running large language models like ChatGPT on a single GPU
632 by _nhynes | 230 comments on Hacker News.