*Western AI companies are terrified

Anyway, what do you all think of the news?

Video is 8 minutes and 30 seconds long if you’re interested.

Is it true that the DeepSeek models and that other AI model (I forgot the name already lol) can be run locally? How do they compete with Claude and OpenAI?

Also, what about that other AI thing, OpenClaw?

I am interested in AI but still very much skeptical.

I have only used Duck AI sometimes but try to avoid it.

  • PeeOnYou [he/him]@lemmygrad.ml
    link
    fedilink
    arrow-up
    4
    ·
    24 hours ago

    you need terabytes of vram if you want to run a full foundational model… otherwise you’re running a quantized version that introduces loss of information and accuracy… some models can be quantized low enough to run on 8gbof vram, and many smaller models can run fine on 16, 24, or 32gb of VRAM