AI tool can detect discrimination on basis of race, gender
New York: A team of US researchers has developed an Artificial Intelligence (AI) tool for detecting unfair discrimination — such as on the basis of race or gender.
AI systems — those involved in selecting candidates for a job or for admission to a university — are trained on large amounts of data.
“But if these data are biased, they can affect the recommendations of AI systems,” said Vasant Honavar, Professor at Pennsylvania State University.
For example, if a company historically has never hired a woman for a particular type of job, then an AI system trained on this historical data will not recommend a woman for a new job.