The Post Ninja

  • 5 Posts
  • 670 Comments
Joined 3 years ago
cake
Cake day: July 8th, 2023

help-circle










  • Ollama, Open WebUI, and Qwen, or one of the edits of it. The latest Qwen 26B is in a very good delta of smart enough to know how to help with stuff (I use it as a second opinion/initial proofread code checker) and small enough to run on a macbook or a gaming pc, and Open WebUI is the self host ChatGPT-like interface that works with Ollama, the turn key ai model runner backend. Couple that with your own searxng instance self hosted to give it the ability to search the web for answers if you want to give it that. Run it all in a virtual machine, of course.

    For media content, wan2gp (wan2 for the gpu poor) has an all in one stop shop for self hosted audio, image, and video. Just beware people don’t like generated stuff in prod, but its useful for quick concepts, or to do certain types of edits of existing stuff.

    There’s also tts and speech recognition via the whisper models, which sounds a lot better than the speak and spell voices from the past (unless you enjoy the degeneracy of spamming JOHN MADDEN JOHN MADDEN in the Steven Hawking voice) and can transcribe words a lot faster (realtime) and more accurately than in the past. The best ones run via Vulkan and thus work on any card that supports Vulkan.

    If you run Nextcloud, you can also connect Ollama to it to get the Nextcloud AI working.





  • Unfortunately, the gap between what people make, what people need to survive on ramen noodles and a closet for living in, and what people need to be able to save up for retirement, not just now, but when they are ready for retirement when inflation has vastly devalued their savings, is a very big gap. Only the most successful and lucky individuals get to retire at a reasonable age. The rest are work until they die poor. This was not true for many of the oldest generation, who had more buying power out of the money they made, but true for almost everyone that’s first entered the workforce after the 1990s is facing this problem.


  • The standard should be an A/B partition system, lile a lot of phones do. Flash B while booted to A, or Flash A when booted to B. If a flash fails, you can still boot the previous firmware.

    Put your hands down, I know about security. The point is after the flash is successfully booted on the new firmware, it can be copied to the other partition to eliminate a regressive boot to old firmware.