When the Naughty Step Makes Things Worse