An unethical optimization principle.

ABSTRACT: If an artificial intelligence aims to maximize risk-adjusted return, then under mild conditions it is disproportionately likely to pick an unethical strategy unless the objective function allows sufficiently for this risk. Even if the proportion η of available unethical strategies is small, the probability p _U of picking an unethical strategy can become large; indeed, unless returns are fat-tailed p _U tends to unity as the strategy space becomes large. We define an unethical odds ratio, Υ (capital upsilon), that allows us to calculate p _U from η, and we derive a simple formula for the limit of Υ as the strategy space becomes large. We discuss the estimation of Υ and p _U in f

SUBMITTER: Beale N 

PROVIDER: S-EPMC7428226 | biostudies-literature | 2020 Jul

REPOSITORIES: biostudies-literature