This new Chinese AI Is outperforming ChatGPT — and its open-source & runs locally

submitted by

https://www.tomsguide.com/ai/this-new-chinese-ai-is-outperforming-chatgpt-and-it-runs-locally

4
31

Log in to comment

Hot Top New Old

The really crazy thing is that this model still performs well at one-bit quantization, which shows it’s got a lot of room for improvement on size. It’s within an order of magnitude of being able to be run on consumer hardware, which would be an even more amazing kick in the balls to American AI companies.

 reply
20
edited

Sucks that people lump AI into a single category of whatever cloud-hosted subscription that tech bros from Silicon Valley are pushing.

 reply
14

Yet, even when heavily compressed, it requires roughly 240GB of memory just to load.

Ah I’ll just pop it in the ol’ Raspberry Pi then, easy peasy.

 reply
18

GLM 5.2

saved you a click

 reply
12
Insert image