perverse incentive = cobra effect = overfitting

[jayrandom]

Пару ярких примеров из статьи про КобраЭффект:

The term cobra effect stems from an anecdote set at the time of British rule of colonial India. The British government was concerned about the number of venomous cobra snakes in Delhi. The government therefore offered a bounty for every dead cobra. Initially this was a successful strategy as large numbers of snakes were killed for the reward. Eventually, however, enterprising persons began to breed cobras for the income. When the government became aware of this, the reward program was scrapped, causing the cobra breeders to set the worthless snakes free. As a result, the wild cobra population further increased. The apparent solution for the problem made the situation even worse.

A similar incident occurred in Hanoi, Vietnam, under French colonial rule. The colonial regime created a bounty program that paid a reward for each rat killed. To obtain the bounty, people would provide the severed rat tail. Colonial officials, however, began noticing rats in Hanoi with no tails. The Vietnamese rat catchers would capture rats, lop off their tails, and then release them back into the sewers so that they could procreate and produce more rats, thereby increasing the rat catchers' revenue.

И ещё список примеров подлиннее из соседней статьи.

Comments

[azgar.livejournal.com]

Это проблема всех искусственных систем мотивации.
Вводят рейтинг по какой-то формуле и народ начинает оптимизировать не исходную задачу, а модельную.

[a_p]

Да-да. Но система мотивации - это всего лишь частный случай. То же самое верно для любой задачи, для оценки которой применяются формальные критерии. Но и формальные критерии - тоже частный случай проблемы цели и средств: вот, к примеру, один мальчик хотел подрасти, поэтому всё лето каждый день висел на турнике. Так у него к сентябрю руки были до земли.