What is "reward misspecification"?

We don't have an answer for this question yet. Would you like to write one?