A recent report from Harvard researchers studying innovation showcased a troubling pattern. To test how AI impacts human judgment, the researchers conducted a field experiment, asking 228 experienced evaluators to assess 48 submissions to an MIT global social impact innovation challenge. The researchers tested three conditions: 1) human-only evaluations; 2) LLM evaluations with a narrative explanation of the decision-making; and 3) LLM evaluations with no further context. They then compared the evaluators’ decisions against those made by four experts affiliated with the innovation challenge.
Business
AI Is Undermining Leaders’ Judgment. Here’s What to Do About It.
A recent report from Harvard researchers studying innovation showcased a troubling pattern. To test how AI impacts human judgment, the researchers conducted a field experiment, asking 228 experienced evaluators to assess 48 submissions to an MIT global social impact innovation challenge. The researchers tested three conditions: 1) human-only evaluations; 2) LLM evaluations with a narrative […]
