From: "jeffrey E." <jeevacation®gmail.com> To: Joi ito Subject: Re: Researchers can't evaluate novel ideas Date: Wed, 16 May 2018 15:27:19 +0000 No , Paris after 4 eastern On Wed, May 16, 2018 at 5:23 PM Joi ito c wrote: What time zone are you in? Can you talk at 1PM ET? > On May 16, 2018, at 10:35, jeffrey E. <jeevacation®gmail.com> wrote: > can talk when you like > On Wed, May 16, 2018 at 1:19 PM Joi ito c wrote: > hups://pubsonline.inforrns.org/doi/abs/10.1287/mnsc.2015.2285 > Looking Across and Looking Beyond the Knowledge Frontier: Intellectual Distance, Novelty, and Resource Allocation in Science > Selecting among alternative projects is a core management task in all innovating organizations. In this paper, we focus on the evaluation of frontier scientific research projects. We argue that the "intellectual distance" between the knowledge embodied in research proposals and an evaluator's own expertise systematically relates to the evaluations given. To estimate relationships, we designed and executed a grant proposal process at a leading research university in which we randomized the assignment of evaluators and proposals to generate 2,130 evaluator—proposal pairs. We find that evaluators systematically give lower scores to research proposals that are closer to their own areas of expertise and to those that are highly novel. The patterns are consistent with biases associated with boundedly rational evaluation of new ideas. The patterns are inconsistent with intellectual distance simply contributing "noise" or being associated with private interests of evaluators. We discuss implications for policy, managerial intervention, and allocation of resources in the ongoing accumulation of scientific knowledge. please note > The information contained in this communication is > confidential, may be attorney-client privileged, may > constitute inside information, and is intended only for > the use of the addressee. It is the property of > JE