adr1an@programming.devM to

HomeLab@programming.dev · 3 months ago

FitMyLLM — Independent benchmarks for self-hosted AI

www.fitmyllm.com

5

-6

FitMyLLM — Independent benchmarks for self-hosted AI

www.fitmyllm.com

adr1an@programming.devM to

HomeLab@programming.dev · 3 months ago

5

FitMyLLM — The data layer for self-hosted AI

www.fitmyllm.com

Independent data for every model, GPU and cloud provider. Estimates calibrated against real measurements, not vendor claims. 435 models, 1,720 GPUs, multi-provider cloud comparisons.

Check what can you use and at what rate of token per seconds would it be… It has examples of many models and quantization levels. Huge resource!

Chat

nutbutter@discuss.tchncs.de
link
fedilink
arrow-up
1·
3 months ago
By small, I mean GPUs like outdated ones, laptop GPUs, or like GPUs with only 4GB or 6GB of VRAM.

HomeLab@programming.dev

homelab@programming.dev

You are not logged in. However you can subscribe from another Fediverse account, for example Lemmy or Mastodon. To do this, paste the following into the search field of your instance: !homelab@programming.dev

A homelab is a server or multiple server setup that resides in your home and where you host sevelra applications and virtualized systems for testing and developing

Its a sandbox environment where you can experience and break and fix things in with no repercussions while its down

This is a community where you can share, discuss, or post news relating to homelabs

Visibility: Public

This community can be federated to other instances and be posted/commented in by their users.

1 user / day
1 user / week
14 users / month
99 users / 6 months
1 local subscriber
234 subscribers
10 Posts
19 Comments
Modlog

mods:
adr1an@programming.dev