I currently run the top 8 or so per day from r/LocalLLama through my RSS reader. Actually going to reddit is eww, so I want it to be worthwhile. I usually get enough to keep roughly up to date just with title and text / graphs and only go if it looks really interesting.
With the upcoming demise of reddit RSS, I’m wondering if people have recommended (hopefully RSS friendly) places roughly equivalent. I guess I could filter HN which may be useful for many tech interests, but I don’t know what I don’t know, so I thought I’d pose the question to the crowd.
also not OP but I am interested in local models usable on low-end hardware, models for tasks like document summarizing and text rewording, fuzzy search of various types of local data, and search agents such that I can ask it a vague natural-language question and it runs 17 web searches and comes back with a summary of what it found.
For the latter I’ve found Vane pretty useful.
Low end hardware is a wide range. The best model for that is going to vary wildly by the specifics of it, like your exact GPU, CPU, CPU RAM size and speed, operating system, and so on.