A prominent artificial-intelligence computer scientist who helped pioneer research into facial recognition software’s bias against people of colour said she was abruptly fired from Google for sending an email criticising the company’s treatment of minority employees and saying she felt “constantly dehumanised.”
Timnit Gebru is considered a pioneer in the field and researched the risks and inequalities found in large language models.
Gebru claims she was fired by Google over an unpublished paper and sending an email critical of the company’s practices.
The paper questions whether language models can be too big, who benefits from them, and whether they can increase prejudice and inequalities. Some recent cases validate her claims about large models and datasets in general.
For example, MIT was forced to remove a large dataset earlier this year called 80 Million Tiny Images. The dataset is popular for training AIs but was found to contain images labelled with racist, misogynistic, and other unacceptable terms.
A statement on MIT’s website claims it was unaware of the offensive labels and they were “a consequence of the automated data collection procedure that relied on nouns from WordNet.”
The statement goes on to explain the 80 million images contained in the dataset – with sizes of just 32×32 pixels – meant that manual inspection would be almost impossible and couldn’t guarantee all offensive images would be removed.
Gebru reportedly sent an email to the Google Brain Women and Allies listserv that is “inconsistent with the expectations of a Google manager.”
In the email, Gebru expressed her frustration with a perceived lack of progress at Google in hiring women at Google. Gebru claimed she was also told not to publish a piece of research and advised employees to stop filling out diversity paperwork because it didn’t matter.
On top of the questionable reasons for her firing, Gebru says her former colleagues were emailed saying she offered her resignation—which she claims was not the case:
Platformer obtained an email from Jeff Dean, Head of Google Research, which was sent to employees and offers his take on Gebru’s claims:
“We’ve approved dozens of papers that Timnit and/or the other Googlers have authored and then published, but as you know, papers often require changes during the internal review process (or are even deemed unsuitable for submission). Unfortunately, this particular paper was only shared with a day’s notice before its deadline — we require two weeks for this sort of review — and then instead of awaiting reviewer feedback, it was approved for submission and submitted.
A cross functional team then reviewed the paper as part of our regular process and the authors were informed that it didn’t meet our bar for publication and were given feedback about why. It ignored too much relevant research — for example, it talked about the environmental impact of large models, but disregarded subsequent research showing much greater efficiencies. Similarly, it raised concerns about bias in language models, but didn’t take into account recent research to mitigate these issues.”
Dean goes on to claim Gebru made demands which included revealing the identities of the individuals he and Google Research VP of Engineering Megan Kacholia consulted with as part of the paper’s review. If the demands weren’t met, Gebru reportedly said she would leave the company.
Since Gebru’s announcement, she’s received an outpouring of support from those in the tech community.
Google declined to comment for this story but pointed to an internal email from Jeff Dean, Gebru’s boss. In that email, Dean said:
Given Timnit’s role as a respected researcher and a manager in our Ethical AI team, I feel badly that Timnit has gotten to a place where she feels this way about the work we’re doing. I also feel badly that hundreds of you received an email just this week from Timnit telling you to stop work on critical DEI programs. Please don’t. I understand the frustration about the pace of progress, but we have important work ahead and we need to keep at it.
More Great Dubai Route Stories
Thailand reopens for long-stay travellers from the Middle East
SS Global Partners wins Dubai Route’s Best Practices Award
Russia to offer ‘golden visas’ to foreigners looking to take advantage of low tax rates
Top 5 immigration and second citizenship consultants in the UAE
SHUAA and Arton announce partnership to encourage foreign direct investment in high growth markets
St Kitts and Nevis to allow siblings as dependants in its CBI Programme applications
Source: AINEWS