AI-powered tool aims to help reduce bias and racially charged language on websites


22% of more than 500,000 business websites contain some form of racial and gender bias, according to UserWay.

Getty Images/iStockphoto

Website accessibility tech provider UserWay has released an AI-powered tool designed to help organizations ensure their websites are free from discriminatory, biased, and racially charged language.

The tool, Content Moderator, flags content for review, and nothing is deleted or removed without approval from site administrators, according to UserWay.

UserWay’s customers are using its AI-powered accessibility widget, an advanced AI-based compliance-as-a-service (CaaS) technology that ensures brands provide an accessible digital experience that meets strict governmental and ADA regulations, the company said.

“Focusing on digital racism and bias is long past due, and our team is eager to contribute to the conversation positively,” UserWay founder and CEO Allon Mason said in a statement.

In June, Google announced that it would be reevaluating what it considers acceptable language, Mason noted. So far, Google has changed terms including “blacklist” to “blocked list,” “whitelist” to “allowed list,” and “master-slave” to “primary/secondary,” among others, he said.

“That was the spark that triggered us to build this tool. At the time, we were enhancing our AI-powered capabilities that supply [alternate] text descriptions of images for screen readers,” Mason said. “We realized that if word choices can make our customers’ digital content inaccessible even without intending to, UserWay should help.”

The goal of the Content Moderator isn’t to censor or silence, he added, but to make web teams aware of problematic language in user-generated content or in content they may have overlooked.

SEE: Robotic process automation: A cheat sheet (free PDF) (TechRepublic) 

Discriminatory language on websites is pervasive

Before launching Content Moderator, UserWay ran its rule engine across more than 500,000 websites. The findings were concerning, the company said.

Some 22% of the sites scanned contained some form of biased, racially charged, or offensive language, UserWay said. Of those:

  • 52% were sites with instances of racial bias
  • 24% were sites with instances of gender bias
  • 12% were sites with instances of age bias
  • 5% were sites with racial slurs
  • 3% were sites with disability bias

Words that the tool most often flagged for gender bias included “chairman,” “fireman,” “mankind,” “forefather,” and “man-made,” UserWay said.

Many of these terms have only recently been understood to be divisive and prejudicial. It is an enormous task for most site owners to keep track of the latest consensus around culturally sensitive terms, the company noted. The tool aims to make this task simple, centralized, and scalable, UserWay said.

Gender Decoder and blind resumes: How to remove bias in your hiring process


How Content Moderator works

Historically, content moderation software using AI to detect racial bias and divisive speech has been site-specific, expensive, and available only within large social media platforms, the company maintained. A website owner can drop in the UserWay widget and will be alerted to divisive or offensive language as it appears, in real time. The widget works in three steps: 

  • Scan: Content Moderator scans all the content on a website, both static and dynamic.
  • Flag: The tool then flags words and phrases that may inadvertently promote stereotypes or prejudice, including text that could be considered racist, sexist, anti-Semitic, homophobic, xenophobic, violent, intolerant, or otherwise offensive.
  • Review: Site administrators review the suggestions and choose the ones they would like to accept. They can also edit the suggestions to flow with the site’s content or recommend alternative replacements that are then fed back into UserWay’s AI.

More inclusive speech is needed now

In the past few weeks, many legacy brands such as Aunt Jemima, Uncle Ben’s, and Eskimo Pie, among others have yielded to mounting pressure from consumers to rid products of racial and ethnic stereotypes. Technology companies have likewise been reevaluating the usage of racialized words like “blacklist” and “whitelist” in favor of more inclusive language

But brand integrity isn’t the sole issue. Civil rights advocates, led by the Anti-Defamation League (ADL), have increased pressure to ensure websites are carefully moderated, and recent calls for repeal of Section 230 of the US Communications Decency Act may expose online publishers to future legal action for defamation based on opinions or reviews created by platform users, according to UserWay.

In tandem with UserWay’s Accessibility Widget, Content Moderator helps organizations mitigate the legal risk of both ADA- and ADL-related violations, the company said

“We all know a list of words that are mocking (to put it mildly) of a variety of racial groups, or a variety of religious groups, or other political or gender persuasions,” UserWay quoted Israel W. Charny, Israeli psychologist, genocide scholar, and executive director of the Institute on the Holocaust and Genocide in Jerusalem, as saying. “UserWay’s … tool flags these words and allows you to change them, an act of voluntary editing with cultural sensitivity. Giving options for improvement reduces the onus of the coerciveness that some people are feeling.”

In the same way that HTML code is remediated, Content Moderator can help users pinpoint and update word choices on their site, Mason said.

“While Google and Apple are approaching the issue as a simple search-and-replace, UserWay looks deeper into the problem of bias,” he said.

The tool looks to detect verbalization patterns that consistently and routinely marginalize and disempower specific cohorts, he said. Its dictionary is frequently updated to align with cultural and social changes.

A content owner can choose to agree, modify, or ignore the Content Moderator’s suggestions, Mason added.

“We intend to empower users by making them aware of the content that exists on their site–especially legacy and user-generated text that may not reflect their brand values,” he said. “More importantly, we hope that by removing blatantly and subtly offensive content, we can help these sites become barrier-free and inviting for all users.”

Tech News You Can Use Newsletter

We deliver the top business tech news stories about the companies, the people, and the products revolutionizing the planet.
Delivered Daily

Sign up today

Also see

How an award-winning AI-powered software is helping students with remote learning


Amira has received four new awards for effectiveness and innovation with helping students become better readers from afar.

Amira software in action

Image: Amira

Amira, the artificial intelligence (AI)-powered software remotely helping students become more proficient readers, has received four new awards for effectiveness and innovation, according to a press release on Wednesday. 

SEE: Robotic process automation: A cheat sheet (free PDF) (TechRepublic)

Amira is a Codie nominee for the Best Use of Emerging Technology for Learning in Education, the winner of the Best Online tutor in the 2020 Edtech Breakthrough Awards, recipient of the 2020 Award of Excellence from Tech & Learning, and a 2020 Extreme Tech Challenge (XTC) Finalist. 

The coronavirus pandemic forced many schools to close their doors, resulting in students and teachers transitioning to online learning using video conferencing platforms such as Zoom and WebEx. 

However, this remote mode of learning hasn’t proven to be very effective, as many students fail to log in to classes or complete assignments.The number of students logging into classes has  declined by 43% since the start of this switch, and the amount of students completing at least one virtual lesson has dropped by 44%, an Achieve3000 report found.

The transition to e-learning has been particularly difficult to struggling readers, who need more time and individual assistance with lessons, the report found. 

However, AI-powered tools like Amira might be able to help. 

What is Amira? 

Using the Amira software, students read appropriately challenging stories aloud and are given interactive tutoring as they stumble or mispronounce words, according to the release. 

“Amira is the first intelligent reading assistant. Designed from decades of research on the science of reading (University of Texas) and artificial intelligence in support of reading development (Carnegie Mellon University), Amira listens, delivers in-the-moment error-specific feedback, and reports progress for every reading session,” said Sara Erickson, vice president of customer success at Amira.

“Amira gives teachers valuable time back for instruction, intervention, and connection,” Erickson said. “Amira is changing how teachers focus their reading instruction with the help of machine learning to accelerate student reading growth.”

As the student reads, Amira uses AI to decipher what obstacles the young reader is facing, delivering micro-interventions that help to bridge the reading skills gaps. The software helps assess reading fluency, pinpoint errors, and help improve those weaknesses. 

Amira can help struggling learners both in and out of the classroom, but can prove especially useful during this time of remote learning. 

“Even though the pandemic has created a reality where teachers have limited interaction with their students, with Amira, teachers and school leaders receive data in reports to help them hone in on what students need next,” Erickson said. 

“For example, Amira will be able to notice patterns in a student’s articulation of a particular sound, and flag those sounds for the teacher to focus on in small-group instruction,” Erickson noted. “Amira multiplies the teacher’s power, an essential capability in a time of distance learning.”

While Amira is especially helpful during the pandemic, its capabilities will also prove useful after the COVID-19 crisis has passed, Erickson said. 

“Amira serves teachers in a post-pandemic world in her ability to both eliminate the time teachers spend manually administering 1:1 reading assessments, and her ability to deliver responsive, personalized guided reading practice to students,” Erickson said.

“Teachers will never be replaced by software, but they can be supported by it. Amira frees up a teacher to do what they do best while maximizing students’ time actually reading,” Erickson added.

Approximately 125 school districts are currently using Amira, with the K-3 student population in those districts totaling more than 600,000, said Mark Angel, CEO of Amira.

For more, check out Eighth grader builds IBM Watson-powered AI chatbot for students making college plans on TechRepublic.  

Tech News You Can Use Newsletter

We deliver the top business tech news stories about the companies, the people, and the products revolutionizing the planet.
Delivered Daily

Sign up today

Also see