Suppose I wanted to make a linear fit to a dataset with vector input and output, by minimizing the least square error. Then the square error equation would be $$E = \frac{1}{2}\sum_i(W\vec{x}^{(i)} - \vec{y}^{(i)})^2$$ And I have to find the weight matrix $W$ that would minimize this. Can't I treat this as a collection of linear regression problems? Like the squared error for the j'th component of the output would be $$\frac{1}{2} \sum_i ( \vec{w}_j \cdot \vec{x}^{(i)} - y^{(i)}_j )^2$$ And each component equation is independent from the next. So can I treat these as simple linear regression problems and find the rows of the weight matrix from the one step formula of linear regression that used the pseudoinverse of the input matrix?

I think I can but I see other people use methods like gradient descent or particle swarm optimization to get to the minimum instead for this sort of problems with vector outputs so I'm confused.