we can all be misinformed, forgetful, confused, emotional, or biased when we make moral judgments. If AIs are trained on these judgments, the AIs will reflect and perpetuate the results of our misinformation, forgetfulness, confusion, emotion, and bias.