• Cethin@lemmy.zip
    link
    fedilink
    English
    arrow-up
    4
    arrow-down
    1
    ·
    8 days ago

    Most consumers are not purchasing a GPU to run an LLM. They may choose to run one if they own a GPU. This does next to nothing for their demand.

    I don’t mean a subscription to Hugging Face. I mean a subscription to an LLM service. They don’t want you owning. They want you renting.

    • nilloc@discuss.tchncs.de
      link
      fedilink
      English
      arrow-up
      2
      arrow-down
      1
      ·
      8 days ago

      I could see nvidia de-porting the hugging face models and making them harder to run on anything but their chips.