See, I was always taught the mushrooms were just growing afterwards, wherever a large amount of magic had been discharged (like when a portal happened). They were growing after the fact, soaking up any residual magic splash.