It depends on the client app you use. Some support it, some don’t.

I use Jellyfin for movies and TV shows, but never tried for music because I already had Navidrome set up. It is so good, really one of my all-time favourite pieces of software. It greatly repays a well-tagged collection, relying on embedded metadata only. Not sure how Jellyfin works here, maybe there is some ability to scrape album info from online sources (?), but I believe it’s pretty strict about directory structure (one folder per album), which Navidrome doesn’t care about.