Zhipu AI is founded by a superstar Tsinghua professor, did an IPO in January (Hong Kong stock exchange) hired half it's past research lab and it's stock is >10x since. This is not a "just distill Claude" thing.
Given that DeepSwe is one of the very few coding benchmarks worth taking a look at, this achieves rather excellent result at it (not far from opus 4.8).
From looking at the results and my own impression of 5.1 and other models, I think this is the best Chinese coding model by some non-insignificant margin.
I've been very pleased with it's performance over the last few days.
It's definitely not near Opus 4.8 level but it's very impressive nonetheless and it does do design extremely well.
If I have a fully maxed out MacBook Pro, would it make sense to just switch from Opus 4.8 to this? I've never tried running local models for coding...
HuggingFace says this model has 753B parameters, which will need a lot more RAM than a maxed-out MacBook Pro. With 40B active parameters, running from SSD would need patience.
I’ve wondered for a while if anyone is working on very wide channel parallel (kind of like RAID 0) SSD for this purpose. Couple that with a tensor processor and that would be interesting.
Zhipu AI is founded by a superstar Tsinghua professor, did an IPO in January (Hong Kong stock exchange) hired half it's past research lab and it's stock is >10x since. This is not a "just distill Claude" thing.
Given that DeepSwe is one of the very few coding benchmarks worth taking a look at, this achieves rather excellent result at it (not far from opus 4.8).
From looking at the results and my own impression of 5.1 and other models, I think this is the best Chinese coding model by some non-insignificant margin.
I've been very pleased with it's performance over the last few days.
It's definitely not near Opus 4.8 level but it's very impressive nonetheless and it does do design extremely well.
> it does do design extremely well
Better than Opus?
Discussion (765 points, 3 days ago, 489 comments) https://news.ycombinator.com/item?id=48518684
Blog post with more information including benchmarks: https://z.ai/blog/glm-5.2
If I have a fully maxed out MacBook Pro, would it make sense to just switch from Opus 4.8 to this? I've never tried running local models for coding...
HuggingFace says this model has 753B parameters, which will need a lot more RAM than a maxed-out MacBook Pro. With 40B active parameters, running from SSD would need patience.
I’ve wondered for a while if anyone is working on very wide channel parallel (kind of like RAID 0) SSD for this purpose. Couple that with a tensor processor and that would be interesting.
I have already tested this and it is impressive.
non-x blog post: https://z.ai/blog/glm-5.2
And previously: https://news.ycombinator.com/item?id=48518684