“Without feedback, however, a statistical engine can continue spinning out faulty and damaging analysis while never learning mistakes.”
[Weapons of Math Destruction, Cathy O’neil]
To deal with a spoiled child effectively, parents (or teachers) should consistently observe their child. When they become rude, parents should give them feedback immediately and teach responsibility, appreciation, and respect about others.
Data-driven models also require the right feedback so that they update them in the right direction. To this end, data-driven models use their mistakes to adjust the model. However, this feedback loop commonly includes only one-side mistakes. For example, the AI HR-screening model has only data about the bad performance of chosen applicants. It cannot have data about the successful career of unchosen applicants.
Everybody makes DATA 