Thanks to Micro Center for sponsoring this video! Shop Back to School Tech Deals: https://micro.center/a6ef91Sign up for a FREE 128 gig Flash Drive at Micro ...

*Western AI companies are terrified

Anyway, what do you all think of the news?

Video is 8 minutes and 30 seconds long if you’re interested.

Is it true that the DeepSeek models and that other AI model (I forgot the name already lol) can be run locally? How do they compete with Claude and OpenAI?

Also, what about that other AI thing, OpenClaw?

I am interested in AI but still very much skeptical.

I have only used Duck AI sometimes but try to avoid it.

  • Faux@lemmygrad.ml
    3·
    1 day ago

    If you mean using different models, yes. If you mean finetuning model weights… No, finetuning LLMs is hard in general and Strix Halo (device that I had in mind that costs 3K$ for 128GB of VRAM) is also kinda bad for it now due to having an AMD (and not really strong when it comes to compute power) GPU.

    In practice, people who try finetuning on top of newest models usually cripple them. There are plenty of finetunes of Qwen 3.6 on huggingface trying to distill stronger models and they are just bad.

    Heretic, the method for removing refusals I mentioned, also requires more VRAM to run it than it’s required for inference.