New best story on Hacker News: Postgres rewritten in Rust, now passing 100% of the Postgres regression tests
Postgres rewritten in Rust, now passing 100% of the Postgres regression tests 728 by SweetSoftPillow | 610 comments on Hacker News.
Posts
New best story on Hacker News: Show HN: Getting GLM 5.2 running on my slow computer
- Get link
- X
- Other Apps
Show HN: Getting GLM 5.2 running on my slow computer 726 by vforno | 178 comments on Hacker News. A few days ago I found myself trying out GLM 5.2 and was really positively impressed. The capabilities and security I was getting from this LLM are similar to those I've gotten from models like Claude or GPT, and this really surprised me. But then I thought, "I wonder how it would work on a normal computer like mine," and above all, "I wonder if it would work without going into OOM on a computer like mine." So I started working with the help of agents to test this possibility. I started converting the model to int4, understanding MTP usage, and if possible implementing DSA for long context. How it responds in int4 and whether the quality is maintained or not. Until I got to the point, on my computer with 32GB of RAM, I was able to communicate with GLM 5.2 with times that, of course, aren't high in cold start, but even then, we're talking about 0.1 tok/s, ...
New best story on Hacker News: My thoughts on the Bun Rust rewrite
- Get link
- X
- Other Apps
New best story on Hacker News: Chatto is now Open Source
- Get link
- X
- Other Apps