Well, if you consider the case of a linear regression, fitting on your output will add no new information to the weights. Try that on any notebook.