Roblox Rolls Out System to Spot Child-Endangerment Chat Messages
Roblox is a popular online game platform for children. But it is also a place where people who want to exploit children know that they can find an audience. Roblox announced Roblox Sentinel, a artificial intelligence system This is designed to report inappropriate messages in its cat function. Roblox already prohibits sharing real images and personal information, such as telephone numbers and user names. The company hopes that Sentinel will point out more messages earlier for investigation. It has been working on the platform since 2024, but has just been announced this week.
A Roblox representative did not immediately respond to a request for comments.
How Roblox Sentinel works
Roblox has created Roblox Sentinel, an AI system to help detect the signs of children endangering. Once Roblox is aware of the problems, representatives can investigate and report to the police.
Sentinel performs a real -time analysis on more than six billion chat messages every day. You need continuously one minute snapshots, which are automatically analyzed by AI to identify messages that could be harmful to children. These messages are also compiled over time to show models that can be studied and reported further.
Sentinel reports messages according to his training. He was trained to distinguish between safe messages and those who were previously reported because they violated Roblox’s policy in childhood.
Roblox Sentinel is available in open source
According to Roblox, so far in 2025, Sentinel has helped detect 1,200 potential operating reports for children who have been reported to the National Center for Missing and Exploited Children. Roblox hopes to make Roblox Sentinel available depending on the open source so that other companies integrate into their systems. The code is available on the Roblox website now.
This is not Roblox’s first attempt to use AI to monitor content and improve online security. In early July, he explained how he used AI to moderate the content in 25 languages in real time. Age verification is now available for adolescents who wish to discuss.
