Chocolate eating, linux programming geek from Manchester, UK
The article talks about the wonders of bucky balls and nanotubes - does anyone know what useful stuff has come out of those yet? I think I heard there's some work on nanotubes coming up on transistors in the next gen of chips? Not sure what bucky balls and other fullerenes are being used for? (I remember originally there was talk of lubricants?)
Nice! I'm running on CPU only, so it's interesting to compare - the Magistral-Small-2506_Q8_0.gguf runs at under 2 tokens/s on my 16 core, but your UD-IQ2_XXS gets about 5.5 tokens/s which is fast enough to be useful - but it does hallucinate a bit more and loop a little; but still actually pretty good for something so small.
This project is an enhanced reader for Ycombinator Hacker News: https://news.ycombinator.com/.
The interface also allow to comment, post and interact with the original HN platform. Credentials are stored locally and are never sent to any server, you can check the source code here: https://github.com/GabrielePicco/hacker-news-rich.
For suggestions and features requests you can write me here: gabrielepicco.github.io