Been using Perplexity AI quite a bit lately for random queries, like travel suggestions.
So I started wondering what random things people are using it for to help with daily tasks. Do you use it more than Google/etc?
Also if anyone is paying for Pro versions? Thinking if it’s worth it paying for Perplexity AI Pro or not.
Got any links teaching how to run a self hosted RAG LLM?
Never ran RAG, so unfortunately no. But there’re quite a few projects doing the necessary handling already - I’d expect them to have manuals.
Got any links to those please?
Removed by mod
You’re welcome!
As far as I understand, all of them can be made to work locally (especially if your local model is served via an OpenAI-compatible API, e.g. see llama.cpp’s
serverbinary) with varying degrees of effort required.Not comment-OP, but you could start here: !fosai@lemmy.world. the latest post is to a RAG tutorial, and there are various other resources in the sidebar.