Back to the complete issue
Sunday, 8 December 2019

AI amplifies human biases, and only human problem-solving can help to change this

AI amplifies human biases, and only human problem-solving can help to change this. Algorithms have a powerful ability to mine data to find correlations at scale, but without the careful application of human insights as part of a continued process of learning, they will continue to reflect and amplify structural biases, theoretical neuroscientist Vivienne Ming writes in the Financial Times. Ming cites Amazon’s attempts to design an algorithm to promote fairer hiring as an example of this. The model was scrapped in 2015 because it was found to have embedded gender bias into its rating of candidates for technical positions, having been trained to observe and promote candidates based on patterns in resumes submitted to the company over a 10 year period — most of which came from men. Even when the company aimed to “de-bias” its data, the AI still discovered subtle patterns that distinguished male candidates from female, and overwhelmingly dismissed women applicants.

The problem is not biased data, but believing that an abundance of data can remove implicit biases. In fact, it is only by learning how to ask the right questions and applying human problem-solving skills (like the ability to observe and learn from failed solutions) to thorny issues like gender bias in hiring, that real progress can be made. A major trend in machine learning is training AI systems to focus on causal inference (asking “why”), and reinforcement-learning algorithms are an important move in that direction. But for now, Ming argues, the most effective way of using algorithms as helpful tools is by recognizing their limitations and focusing on training human problem solvers to ask the right questions in the first place.

Enterprise is a daily publication of Enterprise Ventures LLC, an Egyptian limited liability company (commercial register 83594), and a subsidiary of Inktank Communications. Summaries are intended for guidance only and are provided on an as-is basis; kindly refer to the source article in its original language prior to undertaking any action. Neither Enterprise Ventures nor its staff assume any responsibility or liability for the accuracy of the information contained in this publication, whether in the form of summaries or analysis. © 2022 Enterprise Ventures LLC.

Enterprise is available without charge thanks to the generous support of HSBC Egypt (tax ID: 204-901-715), the leading corporate and retail lender in Egypt; EFG Hermes (tax ID: 200-178-385), the leading financial services corporation in frontier emerging markets; SODIC (tax ID: 212-168-002), a leading Egyptian real estate developer; SomaBay (tax ID: 204-903-300), our Red Sea holiday partner; Infinity (tax ID: 474-939-359), the ultimate way to power cities, industries, and homes directly from nature right here in Egypt; CIRA (tax ID: 200-069-608), the leading providers of K-12 and higher level education in Egypt; Orascom Construction (tax ID: 229-988-806), the leading construction and engineering company building infrastructure in Egypt and abroad; Moharram & Partners (tax ID: 616-112-459), the leading public policy and government affairs partner; Palm Hills Developments (tax ID: 432-737-014), a leading developer of commercial and residential properties; Mashreq (tax ID: 204-898-862), the MENA region’s leading homegrown personal and digital bank; Industrial Development Group (IDG) (tax ID:266-965-253), the leading builder of industrial parks in Egypt; Hassan Allam Properties (tax ID:  553-096-567), one of Egypt’s most prominent and leading builders; and Saleh, Barsoum & Abdel Aziz (tax ID: 220-002-827), the leading audit, tax and accounting firm in Egypt.