I see what you mean. Yeah it shouldn’t be by default I don’t do statistical significance tests.

I think op is refering to hypothesis tests between baseline. What’s the point in reporting variance and standard deviation? My outputs on regression tasks are always non-normal. I tend to always plot the cumulative frequency but assigning a number to the distribution such as the variance will have very little meaning.

This is the reason. People do significance tests when you want to draw conclusions with 20 samples on an entire population. If you have thousands of samples there won’t be much point.