Roblox introduces real-time AI-powered chat rephraser for inappropriate language

Roblox has launched an AI-powered feature that can rephrase inappropriate language in real time. The online game has been using AI filters to block any language that goes against its policy for some time, but it has replaced censored discussions with a series of pound signs (####). Roblox admits that encountering too many hashmarks can be confusing and make conversations difficult to follow. This new feature will replace words and phrases with what the AI ​​considers to be more suitable substitutes.

Rajiv Bhatia, Roblox’s head of security, said the game started with profanity. For example, if a user sends “Hurry up TF” in the chat, the system will replace it with “Hurry up!” Everyone in the chat will see a note when a message has been reworded and the sender will see what language was removed. A user who continues to swear in chat will still be penalized for violating Roblox policy, even if the AI ​​rephrases its messages. “As these systems evolve, they create a flywheel for civility, where real-time feedback helps users learn and adopt our community standards,” Bhatia said in a blog post.

The rewording was rolled out in chats among users of similar age groups and in all languages ​​supported by the game’s translation tool. Roblox introduced a mandatory age verification system in January after reports emerged of a “pedophile problem”, with adult players allegedly using the game to groom their children. Children under 13 can no longer use in-game chat outside of certain experiences, while everyone can chat with players their age. Age verification hasn’t stopped authorities from suing Roblox, however: Los Angeles County, in a lawsuit filed in February, said Roblox knew its platform “made children easy prey for pedophiles.” The Louisiana AG also just filed a lawsuit, claiming that Roblox “created a public park and filled it with sexual predators who prey on… children.”