Learning from your Losses