I have a good PC, but the problem is with my RAM. The model is LLM, which makes the memory requirement understandable, but I can’t afford to get that much RAM right now so I’m looking for a roundabout. Any help?

  • The-Protomolecule@alien.topB
    link
    fedilink
    English
    arrow-up
    1
    ·
    10 months ago

    Not trying to be rude, but you’re also like saying you want to participate in a car race and you don’t have a fast car kind of a prerequisite unfortunately.

    You could look at things that offload your model to disk but they’re going to be slow as hell.